-- Logs begin at Thu 2022-07-14 14:49:27 UTC, end at Thu 2022-07-14 16:28:10 UTC. -- Jul 14 15:22:41.401959 dv-cinder-831247-21-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 14 15:22:41.411524 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 14 15:22:41.413585 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 15:22:41 2022] *** Jul 14 15:22:41.413585 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 15:22:41.413585 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 15:22:41.413585 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: nodename: dv-cinder-831247-21-iscsi Jul 14 15:22:41.413585 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: machine: x86_64 Jul 14 15:22:41.413585 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: clock source: unix Jul 14 15:22:41.413585 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: pcre jit disabled Jul 14 15:22:41.413585 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: detected number of CPU cores: 4 Jul 14 15:22:41.413585 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: current working directory: / Jul 14 15:22:41.413585 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: detected binary path: /usr/bin/uwsgi-core Jul 14 15:22:41.414177 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: your processes number limit is 47680 Jul 14 15:22:41.414177 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: your memory page size is 4096 bytes Jul 14 15:22:41.414177 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: detected max file descriptor number: 2048 Jul 14 15:22:41.414177 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: lock engine: pthread robust mutexes Jul 14 15:22:41.414177 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: thunder lock: enabled Jul 14 15:22:41.414177 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 14 15:22:41.414177 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 14 15:22:41.459188 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: Python main interpreter initialized at 0x55f0333139c0 Jul 14 15:22:41.459188 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: python threads support enabled Jul 14 15:22:41.459188 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: your server socket listen backlog is limited to 100 connections Jul 14 15:22:41.459188 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: your mercy for graceful operations on workers is 90 seconds Jul 14 15:22:41.459605 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 15:22:41.459678 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: *** Operational MODE: preforking *** Jul 14 15:22:41.459952 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: *** uWSGI is running in multiple interpreter mode *** Jul 14 15:22:41.459952 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: spawned uWSGI master process (pid: 80183) Jul 14 15:22:41.460171 dv-cinder-831247-21-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 14 15:22:41.463616 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: spawned uWSGI worker 1 (pid: 80190, cores: 1) Jul 14 15:22:41.463616 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: spawned uWSGI worker 2 (pid: 80191, cores: 1) Jul 14 15:22:41.463616 dv-cinder-831247-21-iscsi devstack@keystone.service[80183]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 15:22:47.129230 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:22:47.129230 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: from cryptography.utils import int_from_bytes Jul 14 15:22:47.130062 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:22:47.130062 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: from cryptography.utils import int_from_bytes Jul 14 15:22:47.131391 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:22:47.131391 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: from cryptography.utils import int_from_bytes Jul 14 15:22:47.131883 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:22:47.131883 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: from cryptography.utils import int_from_bytes Jul 14 15:22:47.180293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 15:22:47.180484 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 15:22:47.180662 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] command line args: [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 15:22:47.180935 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 15:22:47.181115 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ================================================================================ {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 15:22:47.181201 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 15:22:47.181373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] admin_token = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.181459 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 15:22:47.181575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] command line args: [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 15:22:47.181660 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] config_dir = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.181798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.181878 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 15:22:47.181984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] config_source = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.182061 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ================================================================================ {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 15:22:47.182214 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] debug = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.182314 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] admin_token = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.182395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.182635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] config_dir = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.182705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.182763 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.182885 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] config_source = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.182976 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.183043 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] debug = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.183173 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.183253 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.183426 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.183508 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.183646 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.183723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] list_limit = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.183832 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] log_config_append = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.183906 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.184011 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.184137 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.184223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] log_dir = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.184341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] log_file = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.184425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] list_limit = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.184529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] log_config_append = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.184613 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.184721 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.184823 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.184903 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] log_dir = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.185041 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] log_file = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.185127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.185282 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.185434 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.185519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.185602 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.185670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.185836 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.185961 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.186045 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.186139 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.186210 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.186369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.186482 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.186614 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.186703 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.186843 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.186925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.187075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.187176 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.187306 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.187419 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.187593 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.187716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.187848 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.187999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.188140 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.188327 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.188933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.189084 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.189197 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] publish_errors = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.189429 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.189574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.189666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.189834 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] publish_errors = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.189916 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.190112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.190249 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.190375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.190480 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.190573 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.190671 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] standard_threads = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.190796 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.190882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.191023 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.191105 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.191225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.191308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] standard_threads = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.191407 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] use_journal = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.191487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.191590 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] use_json = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.191710 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.191856 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] use_stderr = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.191934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.192039 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] use_syslog = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.192116 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] use_journal = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.192216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] use_json = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.192300 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.192379 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] use_stderr = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.192532 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.192616 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] use_syslog = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.192773 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:22:47.192853 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.193034 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.193112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.193274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.193352 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.193525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.193604 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.193763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.193848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.194013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.194106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.194277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.194361 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.194525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.194603 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.194764 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.194849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.195014 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.195094 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.195253 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.195337 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.195499 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.195587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.195736 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.195862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.195983 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.196068 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.196221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.196299 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.196458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.196538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.196700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.196778 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.196940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.197026 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.197191 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.197270 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.197436 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.197521 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.197681 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.197759 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.197919 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.197999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.198203 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.198284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.198467 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.198557 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.198715 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.198799 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.198957 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.199040 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.199186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.199264 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.199418 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.199504 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.199649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.199727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.199884 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.199968 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.200125 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.200204 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.200365 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.200444 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.200587 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.200677 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.200816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.200901 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.201061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.201138 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.201306 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.201395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.201537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.201621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.201775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.201859 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.202003 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.202191 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.202276 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.202353 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.202495 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.202578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.202702 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.202790 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.203015 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.203157 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.203279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.203357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.203429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.203511 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.203585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.203722 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.203874 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.203982 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.204114 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.204234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.204343 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.204448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.204553 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.204662 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.204788 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.204912 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.205019 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.205118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.205324 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.205441 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.205578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.205672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.205748 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.205875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.205952 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.206063 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.206171 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.206303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.206389 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.206509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.206639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.206766 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.206926 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.207091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.207227 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.207360 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.207447 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.207569 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.207654 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.207728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.207860 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.207980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.208065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.208165 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.208245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.208407 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.208489 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.208649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.208734 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.208890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.208972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.209160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.209295 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.209385 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.209459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.209629 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.209752 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.209868 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.209945 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.210139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.210236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.210365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.210506 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.210614 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.210722 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.210947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.211030 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.211188 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.211271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.211426 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.211517 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.211666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.211747 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.211900 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.211981 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.212137 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.212228 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.212374 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.212455 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.212607 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.212688 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.212843 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.212933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.213105 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.213192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.213343 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.213424 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.213584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.213747 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.213824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.213944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.214045 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.214138 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.214307 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.214399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.214544 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.214638 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.214778 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.214859 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.215007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.215088 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.215238 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.215329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.215470 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.215552 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.215701 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.215787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.215914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.215999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.216154 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.216237 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.216390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.216480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.216638 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.216728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.216872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.216962 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.217126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.217215 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.217382 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.217473 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.217621 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] auth.external = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.217704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.217848 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] auth.external = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.217930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.218127 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.218226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.218399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.218503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.218626 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.218720 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] auth.password = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.218899 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] auth.password = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.219020 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] auth.token = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.219110 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] auth.token = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.219235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.219344 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.219425 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.219679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.219749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.219931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.220009 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.220163 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.220382 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.220519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.220658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.220793 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.220920 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.221051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.221177 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] credential.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.221305 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] credential.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.221434 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.221568 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.221694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.221829 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.221966 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.222117 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.222246 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.222392 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.222520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.222648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.222772 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.222899 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.222899 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.223152 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.223279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.223404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.223530 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.223659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.223795 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.223933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.224059 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.224188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.224315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.224444 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.224568 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.224705 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.224831 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.224953 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.225078 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.225209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.225335 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.225483 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.225613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.225751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.225881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.226010 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.226169 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.226307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.226439 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.226569 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.226698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.226828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.226959 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.227095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.227225 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.227365 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.227496 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.227634 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.227764 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.227901 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.228031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.228156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.228280 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.228410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.228547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.228749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.228880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.229010 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.229149 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.229279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.229409 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.229409 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.229665 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.229665 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.229919 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.229919 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.230151 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.230269 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.230416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.230546 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.230624 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.230697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.230777 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.230853 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.230924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.230996 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.231115 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.231192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.231321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.231399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.231471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.231543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.231663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.231739 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.231867 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.231945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.232051 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.232131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.232203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.232277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.232358 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.232433 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.232504 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.232575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.232646 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.232717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.232796 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.232869 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.232941 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.233012 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.233083 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.233153 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.233234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.233308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.233379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.233517 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.233598 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.233766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.233855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.233998 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.234159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.234287 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.234408 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.234489 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.234666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.234804 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.234904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.234980 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.235671 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.235756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.235924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.235996 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.236163 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.236233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.236394 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.236463 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.236630 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.236712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.236867 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.236950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.237111 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.237194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.237346 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.237431 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.237583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.237663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.237824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.237903 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.238083 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.238171 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.238318 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.238397 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.238552 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.238632 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.238800 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.238889 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.239045 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.239125 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.239281 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.239361 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.239517 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.239599 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.239751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.239831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.239982 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.240062 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.240221 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.240301 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.240455 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.240535 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.240692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.240771 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.240937 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.241019 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.241174 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.241296 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.241414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.241499 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.241640 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.241721 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.241869 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.241950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.242125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.242225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.242364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.242445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.242598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.242677 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.242827 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.242915 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.243065 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.243145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.243300 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.243379 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.243541 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.243635 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.243786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.243867 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.244028 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.244107 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.244258 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.244348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.244502 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.244582 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.244732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.244814 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.244962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.245049 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.245195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.245276 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.245428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.245508 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.245662 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.245749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.245900 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.245980 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.246156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.246238 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.246413 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.246504 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.246650 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.246729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.246895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.246977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.247124 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.247212 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.247356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.247435 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.247592 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.247673 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.247827 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.247914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.248065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.248145 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.248295 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.248375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.248535 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.248623 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.248771 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.248850 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.249008 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.249087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.249251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.249339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.249485 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.249565 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.249732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.249813 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.249971 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.250178 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.250268 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.250342 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.250459 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.250541 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.250808 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.251512 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.251662 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.251763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.251863 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.251963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] role.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.252063 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.252173 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] role.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.252291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] role.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.252397 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.252592 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] role.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.252673 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.252880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.252970 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.253128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.253208 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.253376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.253456 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.253623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.253715 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.253868 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.253952 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.254134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.254220 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.254385 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.254469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.254617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.254700 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.254863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.254946 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.255108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.255190 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.255353 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.255437 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.255598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.255679 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.255858 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.256031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.256112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.256267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.256515 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.256594 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.256754 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.256838 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.256996 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.257075 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.257244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.257325 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.257478 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.257561 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.257732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.257816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.257967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.258045 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.258240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.258325 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.258477 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.258561 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.258717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.258801 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.258951 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.259036 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.259185 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.259264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.259423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.259502 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.259670 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.259751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.259917 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.259997 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.260154 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.260284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.260365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.260590 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.260670 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] token.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.260827 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.260985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.261073 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.261296 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.261378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.261551 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.261631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.261797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.261886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.262035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.262190 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.262303 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.262383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.262546 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.262638 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.262792 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.262873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.263027 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.263106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.263263 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.263356 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.263496 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.263576 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.263741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.263820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.263977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.264069 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.264191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.264268 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.264431 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.264511 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.264677 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.264764 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.264938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.265017 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.connection = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.265172 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.265266 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.265512 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.265605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.265680 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.265810 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.265892 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.266095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.connection = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.266193 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.266382 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.266468 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.266635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.266754 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.266901 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.266963 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.267133 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.267211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.267322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.267413 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.267561 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.267641 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.267793 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.267872 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.268030 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.268118 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.268263 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.268344 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.268504 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.268583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.268730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.268818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.268972 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.269053 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.269207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.269288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.269361 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 15:22:47.269442 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.269675 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.269908 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.270194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.270436 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:22:47.270611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 15:22:47.301950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.302244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.302531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.302619 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.302771 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.303001 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.311119 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.311701 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.341296 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.341530 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.342108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.342345 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.492817 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.515650 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.544675 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.544963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.553561 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.553800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.612337 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.612556 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.612763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.612979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.613193 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.613407 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.613492 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.613674 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.613897 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.614145 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.614365 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.614582 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.638394 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.638622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.638827 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.638921 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.639055 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.639146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.639273 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.639368 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.639488 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.639579 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.639701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.639798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.639916 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.640133 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.650959 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.651224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.664329 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.664556 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.664780 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.664929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.665026 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.665110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.665200 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.665326 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.665412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.665549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.665639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.665767 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.665983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.666230 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80190) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 15:22:47.683609 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.683743 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 15:22:47.684314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.684408 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.684520 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 15:22:47.684604 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 15:22:47.684786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.685044 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.685139 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.685275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 15:22:47.685364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.685537 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.685626 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.685799 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.686060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.686342 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.696687 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.696962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.697230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.697482 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.697575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.697762 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.698041 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.698345 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.706462 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.707208 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.709755 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.710034 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.710345 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.710559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.710651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.710839 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.710932 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.711121 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.711204 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.711382 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.711466 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.711650 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.711731 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.711914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.712009 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.712180 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.712262 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.712444 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.712525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.712709 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.712979 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.713243 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.740851 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.740994 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.742500 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.742614 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.742775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.742866 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.748039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.748126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.748318 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.748402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.748598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.748687 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.756337 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.756463 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.756615 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.756707 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.761104 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.761201 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.761391 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.761484 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.761668 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.761750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.761942 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.762025 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.762242 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.762326 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.762513 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.762595 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.762776 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.762871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.763041 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.763122 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.782669 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.782852 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.783012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.783130 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.787780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.787877 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.791471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.791557 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.791765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.791855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.797229 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.797328 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.801380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.801603 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.805100 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.805292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.805386 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.805591 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.805686 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.805883 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.805966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.806191 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.806316 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.806482 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.806596 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.806767 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.826640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.826944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.827216 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.827488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.829714 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.830037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.830502 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.830817 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.836214 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.837940 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.838239 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.840412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.841456 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.841740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.842023 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.842329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.842460 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.842619 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.842715 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.846102 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.846401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.846718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.846979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.847261 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.856266 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.856549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.856838 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.857118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.857395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.857684 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.857956 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.861145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.861422 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.861707 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.861983 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.862285 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.862558 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.862837 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.878270 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.881535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.882792 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.884892 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.886089 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.886543 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.888337 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.888615 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.888895 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.889608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.891908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.893703 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.893983 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.894287 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.897057 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.898786 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.901643 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.902163 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.902460 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.902742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.903020 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.903295 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.906617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.906837 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.907743 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.908016 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.913158 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.913444 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.913729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.917246 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.917531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.917808 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.921631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80190) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.922174 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.922466 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.922914 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.923194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.923467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.923756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.924025 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.924393 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.924673 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.924954 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.925219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.925485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.925754 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80190) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.926094 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 15:22:47.926378 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.926654 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.926923 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.927293 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.927646 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.928743 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.928743 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.929900 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.929900 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.929900 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.929900 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.929900 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.936010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 15:22:47.964753 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f0333139c0 pid: 80190 (default app) Jul 14 15:22:47.968337 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29f7b1-6201-4b04-8e7a-e9b56813ea0b None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:47.968632 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29f7b1-6201-4b04-8e7a-e9b56813ea0b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:47.968913 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29f7b1-6201-4b04-8e7a-e9b56813ea0b None None] PATH_INFO: `/v3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:47.971821 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f0333139c0 pid: 80191 (default app) Jul 14 15:22:47.973884 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Thu Jul 14 15:22:47 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:55.808806 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73541676-1c57-4cfe-9e8f-7d28d79c43ec None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:55.809384 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73541676-1c57-4cfe-9e8f-7d28d79c43ec None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:55.809384 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73541676-1c57-4cfe-9e8f-7d28d79c43ec None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:55.814544 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:22:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:22:55.820048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b050c-d3fb-4b68-9bca-6753d5a5c72d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:55.820491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b050c-d3fb-4b68-9bca-6753d5a5c72d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:55.820593 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b050c-d3fb-4b68-9bca-6753d5a5c72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:55.890344 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: INFO dbcounter [None req-f60b050c-d3fb-4b68-9bca-6753d5a5c72d None None] Registered counter for database keystone Jul 14 15:22:55.912497 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG oslo_db.sqlalchemy.engines [None req-f60b050c-d3fb-4b68-9bca-6753d5a5c72d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80190) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:22:55.918889 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writer thread running {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:22:56.107931 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG passlib.handlers.bcrypt [None req-f60b050c-d3fb-4b68-9bca-6753d5a5c72d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80190) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 15:22:56.108242 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG passlib.handlers.bcrypt [None req-f60b050c-d3fb-4b68-9bca-6753d5a5c72d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80190) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 15:22:56.164919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f60b050c-d3fb-4b68-9bca-6753d5a5c72d None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:56.166608 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f60b050c-d3fb-4b68-9bca-6753d5a5c72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:56.300874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:22:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 15:22:56.542969 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73541676-1c57-4cfe-9e8f-7d28d79c43ec None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:56.616219 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: INFO dbcounter [None req-73541676-1c57-4cfe-9e8f-7d28d79c43ec None None] Registered counter for database keystone Jul 14 15:22:56.635903 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG oslo_db.sqlalchemy.engines [None req-73541676-1c57-4cfe-9e8f-7d28d79c43ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:22:56.642446 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writer thread running {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:22:56.769207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73541676-1c57-4cfe-9e8f-7d28d79c43ec None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:56.773541 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8df51-f77b-4b72-9bf9-71d26f1f7d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:56.774233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8df51-f77b-4b72-9bf9-71d26f1f7d99 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:56.774523 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8df51-f77b-4b72-9bf9-71d26f1f7d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:56.774806 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8df51-f77b-4b72-9bf9-71d26f1f7d99 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:56.783894 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8df51-f77b-4b72-9bf9-71d26f1f7d99 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:56.843619 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fcd8df51-f77b-4b72-9bf9-71d26f1f7d99 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 15:22:56.844489 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8df51-f77b-4b72-9bf9-71d26f1f7d99 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:56.855495 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Thu Jul 14 15:22:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 15:22:56.862063 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b050c-d3fb-4b68-9bca-6753d5a5c72d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:56.877038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b050c-d3fb-4b68-9bca-6753d5a5c72d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:56.881488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6506bc0-a447-483e-89b2-0bf7fc21b611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:56.882646 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6506bc0-a447-483e-89b2-0bf7fc21b611 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:56.882935 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6506bc0-a447-483e-89b2-0bf7fc21b611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:56.883214 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6506bc0-a447-483e-89b2-0bf7fc21b611 admin admin] PATH_INFO: `/v3/projects/758a2be557ed4a1ab6684561497d3b7f` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:56.887378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6506bc0-a447-483e-89b2-0bf7fc21b611 admin admin] RBAC: Authorizing `identity:get_project(project_id=758a2be557ed4a1ab6684561497d3b7f)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:56.940871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e6506bc0-a447-483e-89b2-0bf7fc21b611 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 15:22:56.941210 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6506bc0-a447-483e-89b2-0bf7fc21b611 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:56.945975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Thu Jul 14 15:22:56 2022] GET /identity/v3/projects/758a2be557ed4a1ab6684561497d3b7f => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:22:59.042903 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3f34d-d7b8-4848-899b-a74169109c45 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:59.043443 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3f34d-d7b8-4848-899b-a74169109c45 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:59.043443 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3f34d-d7b8-4848-899b-a74169109c45 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:59.048338 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:22:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:22:59.054208 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51b385-00b7-4611-952e-0d9513fda550 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:59.054689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51b385-00b7-4611-952e-0d9513fda550 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:59.054778 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51b385-00b7-4611-952e-0d9513fda550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:59.074977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2d51b385-00b7-4611-952e-0d9513fda550 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:22:59.076540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2d51b385-00b7-4611-952e-0d9513fda550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:22:59.084925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:22:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 14 15:22:59.108459 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3f34d-d7b8-4848-899b-a74169109c45 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:59.121357 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3f34d-d7b8-4848-899b-a74169109c45 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:59.125706 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6247584-1e81-4f6e-845b-c2b58381722b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:59.126981 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6247584-1e81-4f6e-845b-c2b58381722b admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:59.127267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6247584-1e81-4f6e-845b-c2b58381722b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:59.127548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6247584-1e81-4f6e-845b-c2b58381722b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:59.135865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6247584-1e81-4f6e-845b-c2b58381722b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:59.137691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6247584-1e81-4f6e-845b-c2b58381722b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:59.146926 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Thu Jul 14 15:22:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 15:22:59.152741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51b385-00b7-4611-952e-0d9513fda550 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:22:59.162999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51b385-00b7-4611-952e-0d9513fda550 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:22:59.167449 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9c6ef-ec3a-44b8-b433-71b42001bfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:22:59.168325 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9c6ef-ec3a-44b8-b433-71b42001bfc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:22:59.168617 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9c6ef-ec3a-44b8-b433-71b42001bfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:22:59.168900 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9c6ef-ec3a-44b8-b433-71b42001bfc1 admin admin] PATH_INFO: `/v3/users/d66fbdf53c464c5aaadd47b4124dad03` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:22:59.170344 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9c6ef-ec3a-44b8-b433-71b42001bfc1 admin admin] RBAC: Authorizing `identity:get_user(user_id=d66fbdf53c464c5aaadd47b4124dad03)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:22:59.172217 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9c6ef-ec3a-44b8-b433-71b42001bfc1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:22:59.174990 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Thu Jul 14 15:22:59 2022] GET /identity/v3/users/d66fbdf53c464c5aaadd47b4124dad03 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:01.403381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75522df4-60db-4ebe-861d-d14c660fc69c None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:01.403929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75522df4-60db-4ebe-861d-d14c660fc69c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:01.403929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75522df4-60db-4ebe-861d-d14c660fc69c None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:01.405269 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:01.410707 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d2e1c-292a-42be-b180-08703504b13c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:01.411195 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d2e1c-292a-42be-b180-08703504b13c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:01.411405 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d2e1c-292a-42be-b180-08703504b13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:01.430885 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-447d2e1c-292a-42be-b180-08703504b13c None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:01.432093 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-447d2e1c-292a-42be-b180-08703504b13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:01.513474 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5a407-f675-4c23-a8b6-357caef0afee None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:01.513795 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5a407-f675-4c23-a8b6-357caef0afee None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:01.514121 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5a407-f675-4c23-a8b6-357caef0afee None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:01.515581 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:23:01.519895 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:01.521428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cc5b4-3cf0-4300-b401-d38a862ed52a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:01.521725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cc5b4-3cf0-4300-b401-d38a862ed52a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:01.522007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cc5b4-3cf0-4300-b401-d38a862ed52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:01.545463 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d2e1c-292a-42be-b180-08703504b13c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:01.563832 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG passlib.handlers.bcrypt [None req-c94cc5b4-3cf0-4300-b401-d38a862ed52a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80191) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 15:23:01.564360 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG passlib.handlers.bcrypt [None req-c94cc5b4-3cf0-4300-b401-d38a862ed52a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80191) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 15:23:01.571455 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:01.609958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c94cc5b4-3cf0-4300-b401-d38a862ed52a None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:01.612286 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c94cc5b4-3cf0-4300-b401-d38a862ed52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:01.659645 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d2e1c-292a-42be-b180-08703504b13c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:01.702145 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0bf06-472b-453a-a0f2-fbd370ef07e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:01.702947 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0bf06-472b-453a-a0f2-fbd370ef07e0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:01.703527 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0bf06-472b-453a-a0f2-fbd370ef07e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:01.703669 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0bf06-472b-453a-a0f2-fbd370ef07e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:01.716312 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0bf06-472b-453a-a0f2-fbd370ef07e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:01.719150 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:01.729551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-65a0bf06-472b-453a-a0f2-fbd370ef07e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:01.729551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:01.729551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:01.729551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:01.729551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:01.729551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:01.729551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:01.729551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:01.729551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:01.729551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:01.729551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:01.729551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:01.729551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:01.729551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:01.729551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:01.729551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:01.730713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:01.730713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:01.730713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:01.730713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:01.730713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:01.730713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:01.730713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:01.730713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:01.730713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:01.730713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:01.730713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:01.730713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:01.730713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:01.730713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:01.730713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:01.730713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:01.731691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:01.731691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:01.731691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:01.731691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:01.731691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:01.731691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:01.731691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:01.731691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:01.731691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:01.731691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:01.731691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:01.731691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:01.731691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 7/14] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:23:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:23:01.739916 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94cc5b4-3cf0-4300-b401-d38a862ed52a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:01.742999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0bf06-472b-453a-a0f2-fbd370ef07e0 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:01.827191 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:01.848322 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0bf06-472b-453a-a0f2-fbd370ef07e0 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:01.851795 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94cc5b4-3cf0-4300-b401-d38a862ed52a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:01.854219 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:01.885482 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ef3ad-3161-40a8-a348-a6fc72c2d5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:01.886239 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ef3ad-3161-40a8-a348-a6fc72c2d5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:01.886576 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ef3ad-3161-40a8-a348-a6fc72c2d5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:01.886940 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ef3ad-3161-40a8-a348-a6fc72c2d5a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:01.891108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d194d-ad12-44d0-8e72-3810c193c59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:01.892189 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d194d-ad12-44d0-8e72-3810c193c59f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:01.892464 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d194d-ad12-44d0-8e72-3810c193c59f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:01.892749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d194d-ad12-44d0-8e72-3810c193c59f None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:01.893681 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d194d-ad12-44d0-8e72-3810c193c59f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:01.893988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d194d-ad12-44d0-8e72-3810c193c59f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:01.895491 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d194d-ad12-44d0-8e72-3810c193c59f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:01.908373 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 8/15] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:01.914187 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d194d-ad12-44d0-8e72-3810c193c59f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:01.958674 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ef3ad-3161-40a8-a348-a6fc72c2d5a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:01.960196 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ef3ad-3161-40a8-a348-a6fc72c2d5a6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:02.020615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d194d-ad12-44d0-8e72-3810c193c59f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:02.045188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:02.060427 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf363a5-660f-4143-8ce7-b5c868015472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:02.061314 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf363a5-660f-4143-8ce7-b5c868015472 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:02.061603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf363a5-660f-4143-8ce7-b5c868015472 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:02.061884 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf363a5-660f-4143-8ce7-b5c868015472 None admin] PATH_INFO: `/v3/users/d66fbdf53c464c5aaadd47b4124dad03` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:02.063808 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 8/16] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 15:23:02.064001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf363a5-660f-4143-8ce7-b5c868015472 None admin] RBAC: Authorizing `identity:get_user(user_id=d66fbdf53c464c5aaadd47b4124dad03)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:02.065525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf363a5-660f-4143-8ce7-b5c868015472 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:02.067242 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 9/17] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:01 2022] GET /identity/v3/users/d66fbdf53c464c5aaadd47b4124dad03 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:02.069842 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ef3ad-3161-40a8-a348-a6fc72c2d5a6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:02.072393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf363a5-660f-4143-8ce7-b5c868015472 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:02.109189 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:02.178939 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ef3ad-3161-40a8-a348-a6fc72c2d5a6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:02.181794 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf363a5-660f-4143-8ce7-b5c868015472 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:02.214008 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969defdb-7278-4e84-acbe-7f9f8ec2e6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:02.214832 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969defdb-7278-4e84-acbe-7f9f8ec2e6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:02.215117 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969defdb-7278-4e84-acbe-7f9f8ec2e6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:02.215397 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969defdb-7278-4e84-acbe-7f9f8ec2e6c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:02.218446 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a3f5b-cc7e-45ab-8310-64ca5f4497c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:02.219242 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a3f5b-cc7e-45ab-8310-64ca5f4497c8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:02.219666 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a3f5b-cc7e-45ab-8310-64ca5f4497c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:02.219872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a3f5b-cc7e-45ab-8310-64ca5f4497c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:02.221724 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a3f5b-cc7e-45ab-8310-64ca5f4497c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:02.223241 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a3f5b-cc7e-45ab-8310-64ca5f4497c8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:02.224848 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 10/18] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:02.226523 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969defdb-7278-4e84-acbe-7f9f8ec2e6c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:02.228005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969defdb-7278-4e84-acbe-7f9f8ec2e6c0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:02.230731 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a3f5b-cc7e-45ab-8310-64ca5f4497c8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:02.247855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-969defdb-7278-4e84-acbe-7f9f8ec2e6c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:02.247855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:02.247855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:02.247855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:02.247855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:02.247855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:02.247855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:02.247855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:02.247855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:02.247855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:02.247855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:02.247855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:02.247855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:02.247855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:02.247855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:02.248745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:02.248745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:02.248745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:02.248745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:02.248745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:02.248745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:02.248745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:02.248745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:02.248745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:02.248745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:02.248745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:02.248745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:02.248745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:02.248745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:02.248745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:02.248745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:02.248745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:02.249547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:02.249547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:02.249547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:02.249547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:02.249547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 9/19] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:02.255350 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969defdb-7278-4e84-acbe-7f9f8ec2e6c0 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:02.291865 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:02.335804 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a3f5b-cc7e-45ab-8310-64ca5f4497c8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:02.337375 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:02.371936 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224dc8a-e07a-49c9-b1d0-f5d135dd3239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:02.372595 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224dc8a-e07a-49c9-b1d0-f5d135dd3239 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:02.372872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224dc8a-e07a-49c9-b1d0-f5d135dd3239 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:02.373100 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969defdb-7278-4e84-acbe-7f9f8ec2e6c0 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:02.373202 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224dc8a-e07a-49c9-b1d0-f5d135dd3239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:02.374133 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224dc8a-e07a-49c9-b1d0-f5d135dd3239 None admin] RBAC: Adding query filter params (role.id=87f040877bfa47bda56305eb022af09e, scope.domain.id=default, user.id=d66fbdf53c464c5aaadd47b4124dad03) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:02.374451 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224dc8a-e07a-49c9-b1d0-f5d135dd3239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:02.376457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224dc8a-e07a-49c9-b1d0-f5d135dd3239 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:02.386062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 11/20] 10.222.0.39 () {56 vars in 1322 bytes} [Thu Jul 14 15:23:02 2022] GET /identity/v3/role_assignments?user.id=d66fbdf53c464c5aaadd47b4124dad03&scope.domain.id=default&role.id=87f040877bfa47bda56305eb022af09e => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:02.426050 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28961c-5b96-4afb-9e3e-b8effa138dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:02.426885 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28961c-5b96-4afb-9e3e-b8effa138dcb None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:02.427206 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28961c-5b96-4afb-9e3e-b8effa138dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:02.427508 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28961c-5b96-4afb-9e3e-b8effa138dcb None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:02.428283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28961c-5b96-4afb-9e3e-b8effa138dcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:02.428641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28961c-5b96-4afb-9e3e-b8effa138dcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:02.430457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28961c-5b96-4afb-9e3e-b8effa138dcb None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:02.457547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 10/21] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:04.794733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a46d9a-f2ea-4425-be61-248a9781ed39 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:04.795289 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a46d9a-f2ea-4425-be61-248a9781ed39 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:04.795568 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a46d9a-f2ea-4425-be61-248a9781ed39 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:04.798573 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 12/22] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:04.804547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4e4fa-f25b-4b66-9406-d9b9987da16b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:04.805536 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4e4fa-f25b-4b66-9406-d9b9987da16b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:04.806049 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4e4fa-f25b-4b66-9406-d9b9987da16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:04.833975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8ed4e4fa-f25b-4b66-9406-d9b9987da16b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:04.835596 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8ed4e4fa-f25b-4b66-9406-d9b9987da16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:04.905381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63e0fb-34c5-4339-9efd-9405ada41925 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:04.906054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63e0fb-34c5-4339-9efd-9405ada41925 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:04.906657 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63e0fb-34c5-4339-9efd-9405ada41925 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:04.908951 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 13/23] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:04.914763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804f29b-19e5-4267-baa7-1ea1e720750f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:04.915133 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804f29b-19e5-4267-baa7-1ea1e720750f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:04.915638 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804f29b-19e5-4267-baa7-1ea1e720750f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:04.929223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 11/24] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:04.951232 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a804f29b-19e5-4267-baa7-1ea1e720750f None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:04.952370 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4e4fa-f25b-4b66-9406-d9b9987da16b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:04.952920 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a804f29b-19e5-4267-baa7-1ea1e720750f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:04.990611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:05.074336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 14/25] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:05.106698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804f29b-19e5-4267-baa7-1ea1e720750f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:05.160371 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4e4fa-f25b-4b66-9406-d9b9987da16b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:05.251840 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd51c6-3457-46af-aaf3-3130e29c7e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:05.252904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd51c6-3457-46af-aaf3-3130e29c7e1b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:05.253374 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd51c6-3457-46af-aaf3-3130e29c7e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:05.253659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd51c6-3457-46af-aaf3-3130e29c7e1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:05.254844 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:05.263606 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804f29b-19e5-4267-baa7-1ea1e720750f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:05.283193 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd51c6-3457-46af-aaf3-3130e29c7e1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:05.290965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-04dd51c6-3457-46af-aaf3-3130e29c7e1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:05.290965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:05.290965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:05.290965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:05.290965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:05.290965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:05.290965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:05.290965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:05.290965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:05.290965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:05.290965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:05.290965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:05.290965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:05.290965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:05.290965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:05.290965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:05.291816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:05.291816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:05.291816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:05.291816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:05.291816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:05.291816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:05.291816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:05.291816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:05.291816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:05.291816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:05.291816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:05.291816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:05.291816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:05.291816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:05.291816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:05.291816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:05.292585 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:05.292585 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:05.292585 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:05.292585 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:05.292585 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:05.292585 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:05.292585 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:05.292585 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:05.292585 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:05.292585 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:05.292585 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:05.292585 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:05.292585 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 12/26] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:23:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:05.305469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd51c6-3457-46af-aaf3-3130e29c7e1b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:05.311727 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f3647-3757-42cc-962e-a1904740d657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:05.313077 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f3647-3757-42cc-962e-a1904740d657 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:05.314130 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f3647-3757-42cc-962e-a1904740d657 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:05.314628 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f3647-3757-42cc-962e-a1904740d657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:05.338098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f3647-3757-42cc-962e-a1904740d657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:05.339929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f3647-3757-42cc-962e-a1904740d657 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:05.366945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-fa3f3647-3757-42cc-962e-a1904740d657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:05.366945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:05.366945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:05.366945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:05.366945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:05.366945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:05.366945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:05.366945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:05.366945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:05.366945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:05.366945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:05.366945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:05.366945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:23:05.366945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:23:05.366945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:23:05.367822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:23:05.367822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:05.367822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:05.367822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:05.367822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:05.367822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:05.367822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:05.367822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:05.367822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:05.367822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:05.367822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:05.367822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:05.367822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:05.367822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:05.367822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:05.367822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:05.367822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:05.368650 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:23:05.368650 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:23:05.368650 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:23:05.368650 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:23:05.371613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 15/27] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:05.379626 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f3647-3757-42cc-962e-a1904740d657 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:05.523580 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f3647-3757-42cc-962e-a1904740d657 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:05.538868 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:05.564719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd51c6-3457-46af-aaf3-3130e29c7e1b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:05.584260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60645a99-a619-437d-9135-bb45e7d3eece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:05.584928 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60645a99-a619-437d-9135-bb45e7d3eece None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:05.585379 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60645a99-a619-437d-9135-bb45e7d3eece None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:05.585797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60645a99-a619-437d-9135-bb45e7d3eece None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:05.586714 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60645a99-a619-437d-9135-bb45e7d3eece None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:05.587653 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60645a99-a619-437d-9135-bb45e7d3eece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:05.589532 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60645a99-a619-437d-9135-bb45e7d3eece None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:05.615010 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57ca2d-fd05-44fa-8a15-5baf4ef3ed4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:05.616446 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57ca2d-fd05-44fa-8a15-5baf4ef3ed4b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:05.616753 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 16/28] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:05.617394 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57ca2d-fd05-44fa-8a15-5baf4ef3ed4b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:05.618105 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57ca2d-fd05-44fa-8a15-5baf4ef3ed4b None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:05.618260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b51343-2e31-4c6a-92d7-c014ec5938e0 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:05.618507 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b51343-2e31-4c6a-92d7-c014ec5938e0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:05.618788 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b51343-2e31-4c6a-92d7-c014ec5938e0 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:05.620275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57ca2d-fd05-44fa-8a15-5baf4ef3ed4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:05.621140 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57ca2d-fd05-44fa-8a15-5baf4ef3ed4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:05.622811 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57ca2d-fd05-44fa-8a15-5baf4ef3ed4b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:05.625083 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 17/29] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:05.626587 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b51343-2e31-4c6a-92d7-c014ec5938e0 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:05.639081 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 13/30] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:05.640418 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:05.640894 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e25cf-8a3d-4e3d-a14e-d9496f385404 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:05.642422 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e25cf-8a3d-4e3d-a14e-d9496f385404 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:05.643057 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e25cf-8a3d-4e3d-a14e-d9496f385404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:05.668758 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-921e25cf-8a3d-4e3d-a14e-d9496f385404 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:05.670310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-921e25cf-8a3d-4e3d-a14e-d9496f385404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:05.886274 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 14/31] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:05.887945 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e25cf-8a3d-4e3d-a14e-d9496f385404 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:05.900679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b51343-2e31-4c6a-92d7-c014ec5938e0 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:05.965520 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556e2d4-f587-4f88-9d45-e1d4057b88ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:05.966740 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556e2d4-f587-4f88-9d45-e1d4057b88ed None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:05.967265 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556e2d4-f587-4f88-9d45-e1d4057b88ed None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:05.967784 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556e2d4-f587-4f88-9d45-e1d4057b88ed None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:05.969170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556e2d4-f587-4f88-9d45-e1d4057b88ed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:05.972190 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c556e2d4-f587-4f88-9d45-e1d4057b88ed None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:05.988463 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:05.999972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e25cf-8a3d-4e3d-a14e-d9496f385404 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:06.038536 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663547c-223c-4e0d-a7be-c53381503f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:06.039582 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663547c-223c-4e0d-a7be-c53381503f71 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:06.039992 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663547c-223c-4e0d-a7be-c53381503f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:06.040371 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663547c-223c-4e0d-a7be-c53381503f71 None admin] PATH_INFO: `/v3/users/d66fbdf53c464c5aaadd47b4124dad03` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:06.041800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663547c-223c-4e0d-a7be-c53381503f71 None admin] RBAC: Authorizing `identity:get_user(user_id=d66fbdf53c464c5aaadd47b4124dad03)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:06.043423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663547c-223c-4e0d-a7be-c53381503f71 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:06.045677 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 15/32] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:05 2022] GET /identity/v3/users/d66fbdf53c464c5aaadd47b4124dad03 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:06.047069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eda5b3-d58c-4d90-bb69-b49600d15fa9 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:06.047708 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eda5b3-d58c-4d90-bb69-b49600d15fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:06.048158 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eda5b3-d58c-4d90-bb69-b49600d15fa9 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:06.049510 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 16/33] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:06.050410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eda5b3-d58c-4d90-bb69-b49600d15fa9 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:06.146298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 18/34] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jul 14 15:23:05 2022] POST /identity/v3/projects => generated 301 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:06.147497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556e2d4-f587-4f88-9d45-e1d4057b88ed None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:06.176609 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eda5b3-d58c-4d90-bb69-b49600d15fa9 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:06.220007 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c24e9-cd14-4969-bf0f-86cc0cc8dac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:06.220780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c24e9-cd14-4969-bf0f-86cc0cc8dac2 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:06.221122 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c24e9-cd14-4969-bf0f-86cc0cc8dac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:06.221411 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c24e9-cd14-4969-bf0f-86cc0cc8dac2 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:06.222150 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:06.222261 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c24e9-cd14-4969-bf0f-86cc0cc8dac2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:06.223837 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c24e9-cd14-4969-bf0f-86cc0cc8dac2 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:06.279449 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c556e2d4-f587-4f88-9d45-e1d4057b88ed None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:06.319196 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4b202-11cb-4b36-926d-b4ec23bc798c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:06.320022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4b202-11cb-4b36-926d-b4ec23bc798c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:06.320308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4b202-11cb-4b36-926d-b4ec23bc798c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:06.320587 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4b202-11cb-4b36-926d-b4ec23bc798c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:06.321924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4b202-11cb-4b36-926d-b4ec23bc798c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:06.323716 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4b202-11cb-4b36-926d-b4ec23bc798c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:06.325718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 19/35] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:06.326986 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f272a9-8b16-4538-8811-78f071552c40 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:06.327282 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f272a9-8b16-4538-8811-78f071552c40 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:06.327562 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f272a9-8b16-4538-8811-78f071552c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:06.346560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-81f272a9-8b16-4538-8811-78f071552c40 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:06.348218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-81f272a9-8b16-4538-8811-78f071552c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:06.369752 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 17/36] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jul 14 15:23:06 2022] POST /identity/v3/roles => generated 225 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:06.370832 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c24e9-cd14-4969-bf0f-86cc0cc8dac2 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:06.379322 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:06.467686 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 20/37] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:06.499194 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f272a9-8b16-4538-8811-78f071552c40 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:06.551968 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c24e9-cd14-4969-bf0f-86cc0cc8dac2 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:06.599016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c93462-fa0d-4835-b269-89dc43af79ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:06.600348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c93462-fa0d-4835-b269-89dc43af79ba None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:06.600864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c93462-fa0d-4835-b269-89dc43af79ba None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:06.601365 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c93462-fa0d-4835-b269-89dc43af79ba None admin] PATH_INFO: `/v3/domains/default/users/d66fbdf53c464c5aaadd47b4124dad03/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:06.602467 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:06.604166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c93462-fa0d-4835-b269-89dc43af79ba None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d66fbdf53c464c5aaadd47b4124dad03, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:06.606158 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c93462-fa0d-4835-b269-89dc43af79ba None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:06.636146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 18/38] 10.222.0.39 () {58 vars in 1361 bytes} [Thu Jul 14 15:23:06 2022] PUT /identity/v3/domains/default/users/d66fbdf53c464c5aaadd47b4124dad03/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:06.667308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f272a9-8b16-4538-8811-78f071552c40 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:06.713451 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd7b13-f09d-40f8-aa66-b4aa4cec2068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:06.714061 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd7b13-f09d-40f8-aa66-b4aa4cec2068 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:06.714381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd7b13-f09d-40f8-aa66-b4aa4cec2068 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:06.714662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd7b13-f09d-40f8-aa66-b4aa4cec2068 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:06.715427 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd7b13-f09d-40f8-aa66-b4aa4cec2068 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:06.716970 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd7b13-f09d-40f8-aa66-b4aa4cec2068 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:06.733289 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 21/39] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jul 14 15:23:06 2022] POST /identity/v3/roles => generated 219 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:06.885783 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3963b0-86e8-497a-ab72-5f2baced516b None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:06.886521 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3963b0-86e8-497a-ab72-5f2baced516b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:06.887487 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3963b0-86e8-497a-ab72-5f2baced516b None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:06.889298 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 19/40] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:06.896108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1465239-dd7d-4f23-9551-f983990f1cfe None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:06.896396 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1465239-dd7d-4f23-9551-f983990f1cfe None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:06.896678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1465239-dd7d-4f23-9551-f983990f1cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:06.917517 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e1465239-dd7d-4f23-9551-f983990f1cfe None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:06.918885 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e1465239-dd7d-4f23-9551-f983990f1cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:06.992548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 22/41] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:07.016935 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3963b0-86e8-497a-ab72-5f2baced516b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:07.051688 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6afe2-e2bb-48df-88fa-6913f019920f None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:07.051994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6afe2-e2bb-48df-88fa-6913f019920f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:07.052263 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6afe2-e2bb-48df-88fa-6913f019920f None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:07.053783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 23/42] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:07.060166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a65faa-49ad-4cfa-9708-a8bce05d288e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:07.060467 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a65faa-49ad-4cfa-9708-a8bce05d288e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:07.060748 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a65faa-49ad-4cfa-9708-a8bce05d288e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:07.082336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d9a65faa-49ad-4cfa-9708-a8bce05d288e None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:07.083587 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d9a65faa-49ad-4cfa-9708-a8bce05d288e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:07.092916 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:07.139776 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:07.161662 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3963b0-86e8-497a-ab72-5f2baced516b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:07.187095 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 24/43] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:07.218251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d176af-8791-4e39-8801-6252f9bc4a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:07.219069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d176af-8791-4e39-8801-6252f9bc4a53 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:07.219354 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d176af-8791-4e39-8801-6252f9bc4a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:07.219632 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d176af-8791-4e39-8801-6252f9bc4a53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:07.221861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d176af-8791-4e39-8801-6252f9bc4a53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:07.223241 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a65faa-49ad-4cfa-9708-a8bce05d288e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:07.223411 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d176af-8791-4e39-8801-6252f9bc4a53 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:07.225268 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 20/44] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:07.231305 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d176af-8791-4e39-8801-6252f9bc4a53 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:07.368922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a65faa-49ad-4cfa-9708-a8bce05d288e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:07.424079 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3f86c-b76c-49a8-8c3d-fb683df6863c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:07.424079 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3f86c-b76c-49a8-8c3d-fb683df6863c None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:07.424344 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3f86c-b76c-49a8-8c3d-fb683df6863c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:07.424707 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3f86c-b76c-49a8-8c3d-fb683df6863c None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:07.425462 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3f86c-b76c-49a8-8c3d-fb683df6863c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:07.426975 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3f86c-b76c-49a8-8c3d-fb683df6863c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:07.444956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 25/45] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jul 14 15:23:07 2022] POST /identity/v3/roles => generated 223 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:23:07.484290 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d176af-8791-4e39-8801-6252f9bc4a53 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:07.523184 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:07.529962 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721ec21-d323-4be3-9ec1-7a9b910063eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:07.530688 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721ec21-d323-4be3-9ec1-7a9b910063eb None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:07.530973 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721ec21-d323-4be3-9ec1-7a9b910063eb None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:07.531252 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721ec21-d323-4be3-9ec1-7a9b910063eb None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:07.531987 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721ec21-d323-4be3-9ec1-7a9b910063eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:07.533661 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721ec21-d323-4be3-9ec1-7a9b910063eb None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:07.565623 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 21/46] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jul 14 15:23:07 2022] POST /identity/v3/projects => generated 312 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:08.890437 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c06789-0099-4f82-9cd3-3b97b010173f None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:08.890970 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c06789-0099-4f82-9cd3-3b97b010173f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:08.890970 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c06789-0099-4f82-9cd3-3b97b010173f None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:08.893007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 26/47] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:08.899271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be1fe5-bae3-4c0a-b657-b042341a4809 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:08.899933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be1fe5-bae3-4c0a-b657-b042341a4809 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:08.900072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be1fe5-bae3-4c0a-b657-b042341a4809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:08.917731 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b5be1fe5-bae3-4c0a-b657-b042341a4809 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:08.919286 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b5be1fe5-bae3-4c0a-b657-b042341a4809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:08.984078 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 22/48] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:09.006994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c06789-0099-4f82-9cd3-3b97b010173f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:09.163781 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:09.237785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c06789-0099-4f82-9cd3-3b97b010173f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:09.293871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01996941-82b8-4319-8798-4ff076630616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:09.294713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01996941-82b8-4319-8798-4ff076630616 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:09.295004 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01996941-82b8-4319-8798-4ff076630616 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:09.295282 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01996941-82b8-4319-8798-4ff076630616 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:09.308238 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01996941-82b8-4319-8798-4ff076630616 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:09.317676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-01996941-82b8-4319-8798-4ff076630616 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:09.317676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:09.317676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:09.317676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:09.317676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:09.317676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:09.317676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:09.317676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:09.317676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:09.317676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:09.317676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:09.317676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:09.317676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:09.317676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:09.317676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:09.317676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:09.318611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:09.318611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:09.318611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:09.318611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:09.318611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:09.318611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:09.318611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:09.318611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:09.318611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:09.318611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:09.318611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:09.318611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:09.318611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:09.318611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:09.318611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:09.318611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:09.319372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:09.319372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:09.319372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:09.319372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:09.319372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:09.319372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:09.319372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:09.319372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:09.319372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:09.319372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:09.319372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:09.319372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:23:09.319372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 27/49] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:23:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:09.325028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be1fe5-bae3-4c0a-b657-b042341a4809 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:09.438295 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be1fe5-bae3-4c0a-b657-b042341a4809 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:09.454199 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:09.476921 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700709b-8d0c-44cc-bb52-13172773bbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:09.477600 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700709b-8d0c-44cc-bb52-13172773bbcb None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:09.477889 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700709b-8d0c-44cc-bb52-13172773bbcb None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:09.478201 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700709b-8d0c-44cc-bb52-13172773bbcb None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:09.478968 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700709b-8d0c-44cc-bb52-13172773bbcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:09.479285 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700709b-8d0c-44cc-bb52-13172773bbcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:09.480708 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700709b-8d0c-44cc-bb52-13172773bbcb None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:09.490205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 23/50] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:09.495958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01996941-82b8-4319-8798-4ff076630616 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:09.617262 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:09.622571 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01996941-82b8-4319-8798-4ff076630616 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:09.660289 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a9390-7f24-4e76-ad95-1e68eab48fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:09.661177 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a9390-7f24-4e76-ad95-1e68eab48fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:09.661463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a9390-7f24-4e76-ad95-1e68eab48fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:09.661741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a9390-7f24-4e76-ad95-1e68eab48fb0 None admin] PATH_INFO: `/v3/users/d66fbdf53c464c5aaadd47b4124dad03` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:09.663185 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a9390-7f24-4e76-ad95-1e68eab48fb0 None admin] RBAC: Authorizing `identity:get_user(user_id=d66fbdf53c464c5aaadd47b4124dad03)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:09.664739 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a9390-7f24-4e76-ad95-1e68eab48fb0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:09.666431 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 28/51] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:09 2022] GET /identity/v3/users/d66fbdf53c464c5aaadd47b4124dad03 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:09.671843 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700709b-8d0c-44cc-bb52-13172773bbcb None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:09.675824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3f7c6-bffc-4e49-958c-c64d9e428076 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:09.676125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3f7c6-bffc-4e49-958c-c64d9e428076 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:09.676415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3f7c6-bffc-4e49-958c-c64d9e428076 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:09.677787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 29/52] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:09.683079 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ab1a8-f07f-4659-a526-903bdf41991b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:09.683317 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ab1a8-f07f-4659-a526-903bdf41991b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:09.683599 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ab1a8-f07f-4659-a526-903bdf41991b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:09.701288 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-fe9ab1a8-f07f-4659-a526-903bdf41991b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:09.702546 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-fe9ab1a8-f07f-4659-a526-903bdf41991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:09.772098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 30/53] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:09.778334 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700709b-8d0c-44cc-bb52-13172773bbcb None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:09.796129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ab1a8-f07f-4659-a526-903bdf41991b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:09.814054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35f030-40c0-46ba-92aa-6c4c7eab457a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:09.814881 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35f030-40c0-46ba-92aa-6c4c7eab457a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:09.815172 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35f030-40c0-46ba-92aa-6c4c7eab457a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:09.815458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35f030-40c0-46ba-92aa-6c4c7eab457a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:09.816695 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35f030-40c0-46ba-92aa-6c4c7eab457a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:09.818231 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35f030-40c0-46ba-92aa-6c4c7eab457a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:09.820061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 24/54] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:09.826187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35f030-40c0-46ba-92aa-6c4c7eab457a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:09.880138 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:09.915548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:09.922815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ab1a8-f07f-4659-a526-903bdf41991b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:09.943862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35f030-40c0-46ba-92aa-6c4c7eab457a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:09.960667 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84374d75-90ca-4736-8be7-d8f14fcf7340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:09.961477 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84374d75-90ca-4736-8be7-d8f14fcf7340 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:09.961763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84374d75-90ca-4736-8be7-d8f14fcf7340 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:09.962043 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84374d75-90ca-4736-8be7-d8f14fcf7340 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:09.963285 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84374d75-90ca-4736-8be7-d8f14fcf7340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:09.964782 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84374d75-90ca-4736-8be7-d8f14fcf7340 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:09.966648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 31/55] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:09.973221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84374d75-90ca-4736-8be7-d8f14fcf7340 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:09.979584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae09ba1-a268-4def-ad34-11763e664db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:09.980247 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae09ba1-a268-4def-ad34-11763e664db6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:09.980536 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae09ba1-a268-4def-ad34-11763e664db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:09.980816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae09ba1-a268-4def-ad34-11763e664db6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:09.981659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae09ba1-a268-4def-ad34-11763e664db6 None admin] RBAC: Adding query filter params (role.id=87f040877bfa47bda56305eb022af09e, scope.domain.id=default, user.id=d66fbdf53c464c5aaadd47b4124dad03) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:09.981980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae09ba1-a268-4def-ad34-11763e664db6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:09.983500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae09ba1-a268-4def-ad34-11763e664db6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:09.991844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 25/56] 10.222.0.39 () {56 vars in 1322 bytes} [Thu Jul 14 15:23:09 2022] GET /identity/v3/role_assignments?user.id=d66fbdf53c464c5aaadd47b4124dad03&scope.domain.id=default&role.id=87f040877bfa47bda56305eb022af09e => generated 530 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:10.089673 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84374d75-90ca-4736-8be7-d8f14fcf7340 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:10.132548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2210d6d-78c4-47af-8e05-ded184aae0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:10.133231 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2210d6d-78c4-47af-8e05-ded184aae0f2 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:10.133517 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2210d6d-78c4-47af-8e05-ded184aae0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:10.133794 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2210d6d-78c4-47af-8e05-ded184aae0f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:10.134569 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2210d6d-78c4-47af-8e05-ded184aae0f2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:10.136068 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2210d6d-78c4-47af-8e05-ded184aae0f2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:10.167350 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 32/57] 10.222.0.39 () {60 vars in 1140 bytes} [Thu Jul 14 15:23:09 2022] POST /identity/v3/projects => generated 298 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:23:12.373040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8849b-e111-4853-be04-98f013f09740 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:12.373632 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8849b-e111-4853-be04-98f013f09740 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:12.373632 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8849b-e111-4853-be04-98f013f09740 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:12.375125 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 26/58] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:12.381612 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a43601-7672-405e-825f-338447711782 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:12.382129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a43601-7672-405e-825f-338447711782 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:12.382244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a43601-7672-405e-825f-338447711782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:12.400326 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-23a43601-7672-405e-825f-338447711782 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:12.401589 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-23a43601-7672-405e-825f-338447711782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:12.415096 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:12.484063 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 33/59] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:12.513971 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8849b-e111-4853-be04-98f013f09740 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:12.631224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8849b-e111-4853-be04-98f013f09740 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:12.640367 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:12.667262 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9dc717-77fe-41a8-b2b6-b2b06bc289a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:12.668061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dc717-77fe-41a8-b2b6-b2b06bc289a7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:12.668350 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dc717-77fe-41a8-b2b6-b2b06bc289a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:12.668629 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dc717-77fe-41a8-b2b6-b2b06bc289a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:12.669824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9dc717-77fe-41a8-b2b6-b2b06bc289a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:12.671453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9dc717-77fe-41a8-b2b6-b2b06bc289a7 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:12.674224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 27/60] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:12.682578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a43601-7672-405e-825f-338447711782 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:12.790846 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a43601-7672-405e-825f-338447711782 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:12.826682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bc753-f2c2-4d2b-9351-c8c92e151a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:12.827615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bc753-f2c2-4d2b-9351-c8c92e151a42 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:12.828001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bc753-f2c2-4d2b-9351-c8c92e151a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:12.828293 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bc753-f2c2-4d2b-9351-c8c92e151a42 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:12.829161 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bc753-f2c2-4d2b-9351-c8c92e151a42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:12.830834 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bc753-f2c2-4d2b-9351-c8c92e151a42 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:12.857323 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 34/61] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jul 14 15:23:12 2022] POST /identity/v3/users => generated 275 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:16.110257 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6c2a6-9be8-41de-b30e-2c259cca7a5c None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:16.111203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6c2a6-9be8-41de-b30e-2c259cca7a5c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:16.111670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6c2a6-9be8-41de-b30e-2c259cca7a5c None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:16.114685 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 28/62] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:16.132002 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b53c15-715e-4df5-ac1e-fc074f5da84f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:16.132922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b53c15-715e-4df5-ac1e-fc074f5da84f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:16.133391 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b53c15-715e-4df5-ac1e-fc074f5da84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:16.144268 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:16.160534 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-09b53c15-715e-4df5-ac1e-fc074f5da84f None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:16.162126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-09b53c15-715e-4df5-ac1e-fc074f5da84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:16.268438 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 35/63] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:16.305339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6c2a6-9be8-41de-b30e-2c259cca7a5c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:16.454801 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6c2a6-9be8-41de-b30e-2c259cca7a5c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:16.510807 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73b0a8-c794-42c3-b228-6ef20731bf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:16.511930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73b0a8-c794-42c3-b228-6ef20731bf01 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:16.512405 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73b0a8-c794-42c3-b228-6ef20731bf01 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:16.512864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73b0a8-c794-42c3-b228-6ef20731bf01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:16.531738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73b0a8-c794-42c3-b228-6ef20731bf01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:16.540375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ba73b0a8-c794-42c3-b228-6ef20731bf01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:16.540375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:16.540375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:16.540375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:16.540375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:16.540375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:16.540375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:16.540375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:16.540375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:16.540375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:16.540375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:16.540375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:16.540375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:16.540375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:16.540375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:16.540375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:16.541223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:16.541223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:16.541223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:16.541223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:16.541223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:16.541223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:16.541223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:16.541223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:16.541223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:16.541223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:16.541223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:16.541223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:16.541223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:16.541223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:16.541223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:16.541223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:16.541985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:16.541985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:16.541985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:16.541985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:16.541985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:16.541985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:16.541985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:16.541985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:16.541985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:16.541985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:16.541985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:16.541985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:16.545897 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 29/64] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:16.551919 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b53c15-715e-4df5-ac1e-fc074f5da84f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:16.673748 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a4b39-936e-45ef-83f7-dc7023f7893a None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:16.674357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a4b39-936e-45ef-83f7-dc7023f7893a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:16.674799 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a4b39-936e-45ef-83f7-dc7023f7893a None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:16.677298 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 30/65] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:16.694685 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfc429-de8b-4bf0-aafc-251b4b2b2a8b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:16.695292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfc429-de8b-4bf0-aafc-251b4b2b2a8b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:16.695800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfc429-de8b-4bf0-aafc-251b4b2b2a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:16.698097 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b53c15-715e-4df5-ac1e-fc074f5da84f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:16.714732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-5dcfc429-de8b-4bf0-aafc-251b4b2b2a8b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:16.716275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5dcfc429-de8b-4bf0-aafc-251b4b2b2a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:16.750537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:16.756849 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:16.772403 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c70564-7357-475e-bf02-609a44973d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:16.775855 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c70564-7357-475e-bf02-609a44973d63 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:16.777446 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c70564-7357-475e-bf02-609a44973d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:16.777935 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c70564-7357-475e-bf02-609a44973d63 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:16.779131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c70564-7357-475e-bf02-609a44973d63 None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:16.780335 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c70564-7357-475e-bf02-609a44973d63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:16.782848 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c70564-7357-475e-bf02-609a44973d63 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:16.793697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 36/66] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:16.799560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c70564-7357-475e-bf02-609a44973d63 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:16.850595 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 31/67] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:16.867088 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa7689-e2af-4956-96fd-5452b713af59 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:16.867522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa7689-e2af-4956-96fd-5452b713af59 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:16.867700 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa7689-e2af-4956-96fd-5452b713af59 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:16.869201 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 32/68] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:16.874579 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539af55-9430-490d-b166-0a3baf7ba802 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:16.874872 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539af55-9430-490d-b166-0a3baf7ba802 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:16.875197 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539af55-9430-490d-b166-0a3baf7ba802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:16.899995 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2539af55-9430-490d-b166-0a3baf7ba802 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:16.901201 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2539af55-9430-490d-b166-0a3baf7ba802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:16.947530 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c70564-7357-475e-bf02-609a44973d63 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:16.987375 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4e093-4397-4f13-afec-6a0fe935b7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:16.987979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4e093-4397-4f13-afec-6a0fe935b7ef None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:16.988275 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4e093-4397-4f13-afec-6a0fe935b7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:16.988555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4e093-4397-4f13-afec-6a0fe935b7ef None admin] PATH_INFO: `/v3/users/a2d7884a8ac747abb51f87cce5fefa29` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:16.993585 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 33/69] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:16.998296 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539af55-9430-490d-b166-0a3baf7ba802 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:17.010544 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4e093-4397-4f13-afec-6a0fe935b7ef None admin] RBAC: Authorizing `identity:get_user(user_id=a2d7884a8ac747abb51f87cce5fefa29)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:17.012154 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4e093-4397-4f13-afec-6a0fe935b7ef None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:17.013937 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 37/70] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:16 2022] GET /identity/v3/users/a2d7884a8ac747abb51f87cce5fefa29 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:17.015294 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c68cf-da73-42b7-b289-24efbb3c0cf8 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.015587 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c68cf-da73-42b7-b289-24efbb3c0cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.015872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c68cf-da73-42b7-b289-24efbb3c0cf8 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.017844 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 38/71] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:17.022949 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c68cf-da73-42b7-b289-24efbb3c0cf8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:17.087375 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:17.123731 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:17.131099 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539af55-9430-490d-b166-0a3baf7ba802 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:17.146938 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c68cf-da73-42b7-b289-24efbb3c0cf8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:17.169157 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c6387-582b-43a6-b71a-5eb50e0ce1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:17.169965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c6387-582b-43a6-b71a-5eb50e0ce1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.170284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c6387-582b-43a6-b71a-5eb50e0ce1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.170568 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c6387-582b-43a6-b71a-5eb50e0ce1c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.181471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c6387-582b-43a6-b71a-5eb50e0ce1c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:17.183759 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754c759-89db-4d4c-9541-596a1e553072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:17.184411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754c759-89db-4d4c-9541-596a1e553072 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.184700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754c759-89db-4d4c-9541-596a1e553072 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.184982 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754c759-89db-4d4c-9541-596a1e553072 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.189896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-c59c6387-582b-43a6-b71a-5eb50e0ce1c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:17.189896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:17.189896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:17.189896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:17.189896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:17.189896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:17.189896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:17.189896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:17.189896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:17.189896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:17.189896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:17.189896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:17.189896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:17.189896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:17.189896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:17.189896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:17.190964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:17.190964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:17.190964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:17.190964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:17.190964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:17.190964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:17.190964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:17.190964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:17.190964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:17.190964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:17.190964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:17.190964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:17.190964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:17.190964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:17.190964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:17.190964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:17.196727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:17.196727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:17.196727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:17.196727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:17.196727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:17.196727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:17.196727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:17.196727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:17.196727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:17.196727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:17.196727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:17.196727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:17.196727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 34/72] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:23:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:17.196727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a24ce-9813-4bb7-af2c-00a1b84f7a87 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.197395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a24ce-9813-4bb7-af2c-00a1b84f7a87 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.197395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a24ce-9813-4bb7-af2c-00a1b84f7a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.210911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-538a24ce-9813-4bb7-af2c-00a1b84f7a87 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:17.212141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-538a24ce-9813-4bb7-af2c-00a1b84f7a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:17.258443 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754c759-89db-4d4c-9541-596a1e553072 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:17.259939 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754c759-89db-4d4c-9541-596a1e553072 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:17.282059 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 35/73] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:17.283497 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a24ce-9813-4bb7-af2c-00a1b84f7a87 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:17.325687 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:17.377493 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:17.378433 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 39/74] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:17.379947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234eb7e-41e4-4176-a700-3d3a080d60d4 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.380244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234eb7e-41e4-4176-a700-3d3a080d60d4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.380528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234eb7e-41e4-4176-a700-3d3a080d60d4 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.382108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 40/75] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:17.382684 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234eb7e-41e4-4176-a700-3d3a080d60d4 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:17.394802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a24ce-9813-4bb7-af2c-00a1b84f7a87 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:17.435047 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1174d-648b-4e18-bd40-55bcc7c69963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:17.435862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1174d-648b-4e18-bd40-55bcc7c69963 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.436145 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1174d-648b-4e18-bd40-55bcc7c69963 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.436424 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1174d-648b-4e18-bd40-55bcc7c69963 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.447762 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1174d-648b-4e18-bd40-55bcc7c69963 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:17.456489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ded1174d-648b-4e18-bd40-55bcc7c69963 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:17.456489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:17.456489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:17.456489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:17.456489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:17.456489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:17.456489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:17.456489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:17.456489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:17.456489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:17.456489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:17.456489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:17.456489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:17.456489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:17.456489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:17.456489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:17.457439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:17.457439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:17.457439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:17.457439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:17.457439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:17.457439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:17.457439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:17.457439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:17.457439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:17.457439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:17.457439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:17.457439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:17.457439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:17.457439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:17.457439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:17.457439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:17.458240 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:17.458240 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:17.458240 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:17.458240 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:17.458240 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:17.458240 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:17.458240 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:17.458240 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:17.458240 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:17.458240 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:17.458240 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:17.458240 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:17.458240 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 36/76] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:17.458860 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1174d-648b-4e18-bd40-55bcc7c69963 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:17.502815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234eb7e-41e4-4176-a700-3d3a080d60d4 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:17.538789 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da7ef2-8bc0-4dc6-98da-63d82ce4481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:17.539471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da7ef2-8bc0-4dc6-98da-63d82ce4481b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.539757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da7ef2-8bc0-4dc6-98da-63d82ce4481b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.540037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da7ef2-8bc0-4dc6-98da-63d82ce4481b None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.540799 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da7ef2-8bc0-4dc6-98da-63d82ce4481b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:17.541111 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da7ef2-8bc0-4dc6-98da-63d82ce4481b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:17.542565 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da7ef2-8bc0-4dc6-98da-63d82ce4481b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:17.551569 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 41/77] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:17.553498 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da7ef2-8bc0-4dc6-98da-63d82ce4481b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:17.562998 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1174d-648b-4e18-bd40-55bcc7c69963 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:17.573574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:17.600160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3de26-b878-4796-85f8-56d4000bec52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:17.600899 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3de26-b878-4796-85f8-56d4000bec52 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.601187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3de26-b878-4796-85f8-56d4000bec52 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.601448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3de26-b878-4796-85f8-56d4000bec52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.612605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3de26-b878-4796-85f8-56d4000bec52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:17.620432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-2bc3de26-b878-4796-85f8-56d4000bec52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:17.620432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:17.620432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:17.620432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:17.620432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:17.620432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:17.620432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:17.620432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:17.620432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:17.620432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:17.620432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:17.620432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:17.620432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:17.620432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:17.620432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:17.620432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:17.621271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:17.621271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:17.621271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:17.621271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:17.621271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:17.621271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:17.621271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:17.621271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:17.621271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:17.621271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:17.621271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:17.621271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:17.621271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:17.621271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:17.621271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:17.621271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:17.622027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:17.622027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:17.622027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:17.622027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:17.622027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:17.622027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:17.622027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:17.622027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:17.622027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:17.622027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:17.622027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:17.622027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:17.622027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 37/78] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:17.623098 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d750c1-b9f9-4e21-bbe4-36be18a5bc99 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.623381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d750c1-b9f9-4e21-bbe4-36be18a5bc99 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.623574 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d750c1-b9f9-4e21-bbe4-36be18a5bc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.638107 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:17.644877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-83d750c1-b9f9-4e21-bbe4-36be18a5bc99 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:17.646101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-83d750c1-b9f9-4e21-bbe4-36be18a5bc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:17.664428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da7ef2-8bc0-4dc6-98da-63d82ce4481b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:17.701295 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c75ad9-94ad-4080-b87e-156603d83301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:17.702274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c75ad9-94ad-4080-b87e-156603d83301 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.702640 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c75ad9-94ad-4080-b87e-156603d83301 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.702988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c75ad9-94ad-4080-b87e-156603d83301 None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.704710 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c75ad9-94ad-4080-b87e-156603d83301 None admin] RBAC: Authorizing `identity:get_project(project_id=4d0d3a63468d4aeba187ed301b2ea4d0)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:17.706208 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c75ad9-94ad-4080-b87e-156603d83301 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:17.708166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 42/79] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:17 2022] GET /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:17.708870 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c75ad9-94ad-4080-b87e-156603d83301 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:17.720572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 38/80] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:17.721430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d750c1-b9f9-4e21-bbe4-36be18a5bc99 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:17.813113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:17.832036 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d750c1-b9f9-4e21-bbe4-36be18a5bc99 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:17.832554 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c75ad9-94ad-4080-b87e-156603d83301 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:17.868317 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d94d0-9d00-49f6-ad7c-14fd17b25a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:17.869155 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d94d0-9d00-49f6-ad7c-14fd17b25a77 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.869551 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d94d0-9d00-49f6-ad7c-14fd17b25a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.874324 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d94d0-9d00-49f6-ad7c-14fd17b25a77 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.874324 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d94d0-9d00-49f6-ad7c-14fd17b25a77 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:17.874324 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d94d0-9d00-49f6-ad7c-14fd17b25a77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:17.874745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132af43-98c1-4b40-8869-adb1e0795023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:17.874745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132af43-98c1-4b40-8869-adb1e0795023 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:17.874745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132af43-98c1-4b40-8869-adb1e0795023 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:17.883457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d94d0-9d00-49f6-ad7c-14fd17b25a77 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:17.883574 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6132af43-98c1-4b40-8869-adb1e0795023 None admin] PATH_INFO: `/v3/users/d66fbdf53c464c5aaadd47b4124dad03` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:17.883574 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132af43-98c1-4b40-8869-adb1e0795023 None admin] RBAC: Authorizing `identity:get_user(user_id=d66fbdf53c464c5aaadd47b4124dad03)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:17.883574 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6132af43-98c1-4b40-8869-adb1e0795023 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:17.883574 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 39/81] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:17 2022] GET /identity/v3/users/d66fbdf53c464c5aaadd47b4124dad03 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:17.883574 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132af43-98c1-4b40-8869-adb1e0795023 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:17.883916 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 43/82] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:23:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:17.883916 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d94d0-9d00-49f6-ad7c-14fd17b25a77 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:17.884981 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:17.983421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6132af43-98c1-4b40-8869-adb1e0795023 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:18.013440 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d94d0-9d00-49f6-ad7c-14fd17b25a77 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:18.020841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaac19c-d46d-4df7-a440-c0ffd2de4c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:18.021578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaac19c-d46d-4df7-a440-c0ffd2de4c9f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:18.021870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaac19c-d46d-4df7-a440-c0ffd2de4c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:18.022187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaac19c-d46d-4df7-a440-c0ffd2de4c9f None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:18.022956 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaac19c-d46d-4df7-a440-c0ffd2de4c9f None admin] RBAC: Adding query filter params (name=member) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:18.023269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaac19c-d46d-4df7-a440-c0ffd2de4c9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:18.024702 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaac19c-d46d-4df7-a440-c0ffd2de4c9f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:18.033963 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 40/83] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:18.038661 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaac19c-d46d-4df7-a440-c0ffd2de4c9f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:18.051658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8429cce-3afa-40e7-9193-f726c43c45ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:18.052329 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8429cce-3afa-40e7-9193-f726c43c45ea None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:18.052617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8429cce-3afa-40e7-9193-f726c43c45ea None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:18.052908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8429cce-3afa-40e7-9193-f726c43c45ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:18.053755 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8429cce-3afa-40e7-9193-f726c43c45ea None admin] RBAC: Adding query filter params (role.id=d98d81dd45ce4c4095c99ee0de89aab3, scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0, user.id=a2d7884a8ac747abb51f87cce5fefa29) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:18.054097 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8429cce-3afa-40e7-9193-f726c43c45ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:18.055575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8429cce-3afa-40e7-9193-f726c43c45ea None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:18.061421 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 44/84] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:23:17 2022] GET /identity/v3/role_assignments?user.id=a2d7884a8ac747abb51f87cce5fefa29&scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0&role.id=d98d81dd45ce4c4095c99ee0de89aab3 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:18.062677 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8429cce-3afa-40e7-9193-f726c43c45ea None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:18.085773 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:18.113400 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:18.159052 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaac19c-d46d-4df7-a440-c0ffd2de4c9f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:18.199302 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8429cce-3afa-40e7-9193-f726c43c45ea None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:18.201968 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e6c36-c3fd-4173-b977-5ce441004194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:18.203105 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e6c36-c3fd-4173-b977-5ce441004194 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:18.203400 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e6c36-c3fd-4173-b977-5ce441004194 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:18.203681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e6c36-c3fd-4173-b977-5ce441004194 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:18.205760 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e6c36-c3fd-4173-b977-5ce441004194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:18.207369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e6c36-c3fd-4173-b977-5ce441004194 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:18.209361 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 41/85] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:18.209947 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e6c36-c3fd-4173-b977-5ce441004194 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:18.249932 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3570a-7a0e-417a-a9eb-41a96934d70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:18.251253 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3570a-7a0e-417a-a9eb-41a96934d70d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:18.251831 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3570a-7a0e-417a-a9eb-41a96934d70d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:18.252313 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3570a-7a0e-417a-a9eb-41a96934d70d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:18.332648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e6c36-c3fd-4173-b977-5ce441004194 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:18.353434 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3570a-7a0e-417a-a9eb-41a96934d70d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:18.355043 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3570a-7a0e-417a-a9eb-41a96934d70d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:18.367076 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:18.370727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763f8c7-ed1f-4f3e-aaa9-a7ce5b92630b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:18.371615 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763f8c7-ed1f-4f3e-aaa9-a7ce5b92630b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:18.371904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763f8c7-ed1f-4f3e-aaa9-a7ce5b92630b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:18.372186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763f8c7-ed1f-4f3e-aaa9-a7ce5b92630b None admin] PATH_INFO: `/v3/users/a2d7884a8ac747abb51f87cce5fefa29` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:18.373417 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763f8c7-ed1f-4f3e-aaa9-a7ce5b92630b None admin] RBAC: Authorizing `identity:get_user(user_id=a2d7884a8ac747abb51f87cce5fefa29)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:18.374938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763f8c7-ed1f-4f3e-aaa9-a7ce5b92630b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:18.376979 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 42/86] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:18 2022] GET /identity/v3/users/a2d7884a8ac747abb51f87cce5fefa29 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:18.382214 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763f8c7-ed1f-4f3e-aaa9-a7ce5b92630b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:18.385013 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:18.483584 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 45/87] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:18.483584 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3570a-7a0e-417a-a9eb-41a96934d70d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:18.502749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763f8c7-ed1f-4f3e-aaa9-a7ce5b92630b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:18.539638 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60818bdf-dea0-4b1c-a296-4486ffd0fcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:18.540518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60818bdf-dea0-4b1c-a296-4486ffd0fcc7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:18.541015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60818bdf-dea0-4b1c-a296-4486ffd0fcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:18.541132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60818bdf-dea0-4b1c-a296-4486ffd0fcc7 None admin] PATH_INFO: `/v3/users/a2d7884a8ac747abb51f87cce5fefa29` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:18.542406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60818bdf-dea0-4b1c-a296-4486ffd0fcc7 None admin] RBAC: Authorizing `identity:get_user(user_id=a2d7884a8ac747abb51f87cce5fefa29)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:18.543893 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60818bdf-dea0-4b1c-a296-4486ffd0fcc7 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:18.545641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 43/88] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:18 2022] GET /identity/v3/users/a2d7884a8ac747abb51f87cce5fefa29 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:18.546374 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60818bdf-dea0-4b1c-a296-4486ffd0fcc7 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:18.593683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3570a-7a0e-417a-a9eb-41a96934d70d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:18.605890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:18.624696 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:18.637417 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f235bfe-351c-48c1-971c-50fffff25b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:18.638225 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f235bfe-351c-48c1-971c-50fffff25b7f None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:18.638588 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f235bfe-351c-48c1-971c-50fffff25b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:18.638942 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f235bfe-351c-48c1-971c-50fffff25b7f None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:18.639837 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f235bfe-351c-48c1-971c-50fffff25b7f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:18.641433 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f235bfe-351c-48c1-971c-50fffff25b7f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:18.662649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60818bdf-dea0-4b1c-a296-4486ffd0fcc7 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:18.663872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 46/89] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jul 14 15:23:18 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:18.665878 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f235bfe-351c-48c1-971c-50fffff25b7f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:18.706300 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7346fc9-d164-4bda-b5e4-385276c4e4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:18.706974 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7346fc9-d164-4bda-b5e4-385276c4e4fa None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:18.707321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7346fc9-d164-4bda-b5e4-385276c4e4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:18.707603 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7346fc9-d164-4bda-b5e4-385276c4e4fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:18.806176 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7346fc9-d164-4bda-b5e4-385276c4e4fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:18.808980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7346fc9-d164-4bda-b5e4-385276c4e4fa None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:18.848911 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f235bfe-351c-48c1-971c-50fffff25b7f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:18.903517 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d2729-c688-4ffb-b8e7-5ef421ec28b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:18.904635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d2729-c688-4ffb-b8e7-5ef421ec28b8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:18.905072 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d2729-c688-4ffb-b8e7-5ef421ec28b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:18.905516 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d2729-c688-4ffb-b8e7-5ef421ec28b8 None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:18.907152 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d2729-c688-4ffb-b8e7-5ef421ec28b8 None admin] RBAC: Authorizing `identity:get_project(project_id=4d0d3a63468d4aeba187ed301b2ea4d0)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:18.909689 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d2729-c688-4ffb-b8e7-5ef421ec28b8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:18.911875 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 47/90] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:18 2022] GET /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:18.912930 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d2729-c688-4ffb-b8e7-5ef421ec28b8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:18.916802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:18.951332 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:18.974408 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 44/91] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:18.975660 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7346fc9-d164-4bda-b5e4-385276c4e4fa None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:19.065260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d2729-c688-4ffb-b8e7-5ef421ec28b8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:19.113179 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac7f78-e7e4-4c1f-ab67-ca1829438d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:19.113705 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7346fc9-d164-4bda-b5e4-385276c4e4fa None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:19.113841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac7f78-e7e4-4c1f-ab67-ca1829438d02 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:19.114141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac7f78-e7e4-4c1f-ab67-ca1829438d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:19.114426 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac7f78-e7e4-4c1f-ab67-ca1829438d02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:19.159053 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09db16-2f2a-42e1-b80d-49cd852d2b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:19.159998 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09db16-2f2a-42e1-b80d-49cd852d2b9c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:19.160541 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09db16-2f2a-42e1-b80d-49cd852d2b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:19.160541 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09db16-2f2a-42e1-b80d-49cd852d2b9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:19.162191 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09db16-2f2a-42e1-b80d-49cd852d2b9c None admin] RBAC: Adding query filter params (role.id=87f040877bfa47bda56305eb022af09e, scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0, user.id=d66fbdf53c464c5aaadd47b4124dad03) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:19.166493 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09db16-2f2a-42e1-b80d-49cd852d2b9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:19.168578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09db16-2f2a-42e1-b80d-49cd852d2b9c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:19.178785 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 45/92] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:23:18 2022] GET /identity/v3/role_assignments?user.id=d66fbdf53c464c5aaadd47b4124dad03&scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0&role.id=87f040877bfa47bda56305eb022af09e => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:19.179902 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09db16-2f2a-42e1-b80d-49cd852d2b9c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:19.208646 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac7f78-e7e4-4c1f-ab67-ca1829438d02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:19.210779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac7f78-e7e4-4c1f-ab67-ca1829438d02 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:19.228333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:19.259943 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:19.333628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09db16-2f2a-42e1-b80d-49cd852d2b9c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:19.358571 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 48/93] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:19.371330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac7f78-e7e4-4c1f-ab67-ca1829438d02 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:19.380808 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61546917-a654-4b0a-9fae-605554c0146e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:19.381980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61546917-a654-4b0a-9fae-605554c0146e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:19.382454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61546917-a654-4b0a-9fae-605554c0146e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:19.382902 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61546917-a654-4b0a-9fae-605554c0146e None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:19.384690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61546917-a654-4b0a-9fae-605554c0146e None admin] RBAC: Authorizing `identity:get_project(project_id=4d0d3a63468d4aeba187ed301b2ea4d0)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:19.386471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61546917-a654-4b0a-9fae-605554c0146e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:19.388524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 46/94] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:19 2022] GET /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:19.396742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61546917-a654-4b0a-9fae-605554c0146e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:19.601742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61546917-a654-4b0a-9fae-605554c0146e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:19.610101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:19.610284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac7f78-e7e4-4c1f-ab67-ca1829438d02 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:19.668153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe89265-87da-43cd-8db8-203782fc1c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:19.668850 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe89265-87da-43cd-8db8-203782fc1c15 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:19.669347 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe89265-87da-43cd-8db8-203782fc1c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:19.669645 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe89265-87da-43cd-8db8-203782fc1c15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:19.670566 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe89265-87da-43cd-8db8-203782fc1c15 None admin] RBAC: Adding query filter params (role.id=26bfea3cd8164feeb8043fd508a5268c, scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0, user.id=a2d7884a8ac747abb51f87cce5fefa29) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:19.670895 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe89265-87da-43cd-8db8-203782fc1c15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:19.672435 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe89265-87da-43cd-8db8-203782fc1c15 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:19.690485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 47/95] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:23:19 2022] GET /identity/v3/role_assignments?user.id=a2d7884a8ac747abb51f87cce5fefa29&scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0&role.id=26bfea3cd8164feeb8043fd508a5268c => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:19.702646 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:19.719368 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ccd3d-d292-4010-9233-ccf8d805bd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:19.721631 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ccd3d-d292-4010-9233-ccf8d805bd88 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:19.722199 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ccd3d-d292-4010-9233-ccf8d805bd88 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:19.722686 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ccd3d-d292-4010-9233-ccf8d805bd88 None admin] PATH_INFO: `/v3/projects/eaba4d06035741658b29c0b060452c51` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:19.725168 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ccd3d-d292-4010-9233-ccf8d805bd88 None admin] RBAC: Authorizing `identity:get_project(project_id=eaba4d06035741658b29c0b060452c51)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:19.727755 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ccd3d-d292-4010-9233-ccf8d805bd88 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:19.730824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 49/96] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:19 2022] GET /identity/v3/projects/eaba4d06035741658b29c0b060452c51 => generated 312 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:19.737838 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe89265-87da-43cd-8db8-203782fc1c15 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:19.911423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe89265-87da-43cd-8db8-203782fc1c15 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:19.961995 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c609a5-d113-40d1-91ea-b0625e2d246b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:19.962678 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c609a5-d113-40d1-91ea-b0625e2d246b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:19.962975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c609a5-d113-40d1-91ea-b0625e2d246b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:19.963256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c609a5-d113-40d1-91ea-b0625e2d246b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:19.964138 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c609a5-d113-40d1-91ea-b0625e2d246b None admin] RBAC: Adding query filter params (role.id=d98d81dd45ce4c4095c99ee0de89aab3, scope.project.id=eaba4d06035741658b29c0b060452c51, user.id=a2d7884a8ac747abb51f87cce5fefa29) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:19.964462 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c609a5-d113-40d1-91ea-b0625e2d246b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:19.965996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c609a5-d113-40d1-91ea-b0625e2d246b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:19.973230 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 48/97] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:23:19 2022] GET /identity/v3/role_assignments?user.id=a2d7884a8ac747abb51f87cce5fefa29&scope.project.id=eaba4d06035741658b29c0b060452c51&role.id=d98d81dd45ce4c4095c99ee0de89aab3 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:20.885267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b002cd-62b1-41cf-93cb-151c13490963 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.885970 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b002cd-62b1-41cf-93cb-151c13490963 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.886332 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b002cd-62b1-41cf-93cb-151c13490963 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.888523 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 50/98] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:20.905615 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49086dd9-ef7d-4b38-8c43-41c426daac84 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:20.906147 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49086dd9-ef7d-4b38-8c43-41c426daac84 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:20.906224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49086dd9-ef7d-4b38-8c43-41c426daac84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:20.939386 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-49086dd9-ef7d-4b38-8c43-41c426daac84 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:20.940654 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-49086dd9-ef7d-4b38-8c43-41c426daac84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:20.969501 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:21.035847 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 49/99] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:21.071016 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b002cd-62b1-41cf-93cb-151c13490963 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:21.218858 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b002cd-62b1-41cf-93cb-151c13490963 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:21.265144 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad4d44-43f1-4121-828b-d70c24f851dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:21.265954 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad4d44-43f1-4121-828b-d70c24f851dd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:21.266272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad4d44-43f1-4121-828b-d70c24f851dd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:21.266556 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad4d44-43f1-4121-828b-d70c24f851dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:21.284187 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad4d44-43f1-4121-828b-d70c24f851dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:21.292086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-94ad4d44-43f1-4121-828b-d70c24f851dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:21.292086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:21.292086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:21.292086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:21.292086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:21.292086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:21.292086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:21.292086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:21.292086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:21.292086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:21.292086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:21.292086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:21.292086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:21.292086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:21.292086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:21.292086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:21.292962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:21.292962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:21.292962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:21.292962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:21.292962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:21.292962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:21.292962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:21.292962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:21.292962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:21.292962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:21.292962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:21.292962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:21.292962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:21.292962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:21.292962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:21.292962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:21.293756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:21.293756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:21.293756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:21.293756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:21.293756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:21.293756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:21.293756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:21.293756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:21.293756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:21.293756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:21.293756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:21.293756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:23:21.293756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 51/100] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:21.300553 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49086dd9-ef7d-4b38-8c43-41c426daac84 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:21.601524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49086dd9-ef7d-4b38-8c43-41c426daac84 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:21.675220 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b7051-7fe2-4d3e-915e-11c77128a8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:21.675912 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b7051-7fe2-4d3e-915e-11c77128a8cf None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:21.676209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b7051-7fe2-4d3e-915e-11c77128a8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:21.676496 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b7051-7fe2-4d3e-915e-11c77128a8cf None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:21.677262 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b7051-7fe2-4d3e-915e-11c77128a8cf None admin] RBAC: Adding query filter params (name=member) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:21.677579 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b7051-7fe2-4d3e-915e-11c77128a8cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:21.679013 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b7051-7fe2-4d3e-915e-11c77128a8cf None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:21.694252 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 50/101] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:21.699891 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad4d44-43f1-4121-828b-d70c24f851dd None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:21.853173 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:21.948766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad4d44-43f1-4121-828b-d70c24f851dd None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:22.004217 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d38770-5fb3-4027-9625-37c66fe8b271 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:22.005453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d38770-5fb3-4027-9625-37c66fe8b271 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:22.005978 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d38770-5fb3-4027-9625-37c66fe8b271 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:22.007625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 51/102] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:23:22.021387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7228a-d631-48b3-8459-1acf55e0a1d5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:22.022022 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7228a-d631-48b3-8459-1acf55e0a1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:22.022562 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7228a-d631-48b3-8459-1acf55e0a1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:22.049183 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb118b0-4eb0-4c81-8451-8dd4948d20a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:22.050823 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb118b0-4eb0-4c81-8451-8dd4948d20a2 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:22.051359 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb118b0-4eb0-4c81-8451-8dd4948d20a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:22.051889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb118b0-4eb0-4c81-8451-8dd4948d20a2 None admin] PATH_INFO: `/v3/users/a2d7884a8ac747abb51f87cce5fefa29` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:22.054166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb118b0-4eb0-4c81-8451-8dd4948d20a2 None admin] RBAC: Authorizing `identity:get_user(user_id=a2d7884a8ac747abb51f87cce5fefa29)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:22.054548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3ad7228a-d631-48b3-8459-1acf55e0a1d5 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:22.055960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3ad7228a-d631-48b3-8459-1acf55e0a1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:22.057081 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb118b0-4eb0-4c81-8451-8dd4948d20a2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:22.063450 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 52/103] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:21 2022] GET /identity/v3/users/a2d7884a8ac747abb51f87cce5fefa29 => generated 275 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:22.077428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb118b0-4eb0-4c81-8451-8dd4948d20a2 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:22.098486 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:22.194302 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 52/104] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:22.266426 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb118b0-4eb0-4c81-8451-8dd4948d20a2 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:22.299413 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7228a-d631-48b3-8459-1acf55e0a1d5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:22.304285 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:22.319781 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984d3f9-9597-496d-80eb-596463bd1b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:22.320677 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984d3f9-9597-496d-80eb-596463bd1b4e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:22.320970 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984d3f9-9597-496d-80eb-596463bd1b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:22.321258 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984d3f9-9597-496d-80eb-596463bd1b4e None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:22.322534 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984d3f9-9597-496d-80eb-596463bd1b4e None admin] RBAC: Authorizing `identity:get_project(project_id=4d0d3a63468d4aeba187ed301b2ea4d0)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:22.324075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984d3f9-9597-496d-80eb-596463bd1b4e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:22.325931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 53/105] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:22 2022] GET /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:22.333386 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984d3f9-9597-496d-80eb-596463bd1b4e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:22.457824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7228a-d631-48b3-8459-1acf55e0a1d5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:22.493354 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157628f2-e24e-43e4-84b8-5c913a258d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:22.494443 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157628f2-e24e-43e4-84b8-5c913a258d11 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:22.495064 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157628f2-e24e-43e4-84b8-5c913a258d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:22.495486 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157628f2-e24e-43e4-84b8-5c913a258d11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:22.496955 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157628f2-e24e-43e4-84b8-5c913a258d11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:22.498618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157628f2-e24e-43e4-84b8-5c913a258d11 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:22.500406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 53/106] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:22.501894 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d462a7b-00f2-4dd0-b332-df26c834ebe4 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:22.502531 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d462a7b-00f2-4dd0-b332-df26c834ebe4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:22.502959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d462a7b-00f2-4dd0-b332-df26c834ebe4 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:22.504446 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 54/107] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:22.509772 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e025f-bda7-4b21-af82-c6b2fe425df7 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:22.510434 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e025f-bda7-4b21-af82-c6b2fe425df7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:22.510953 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e025f-bda7-4b21-af82-c6b2fe425df7 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:22.511073 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984d3f9-9597-496d-80eb-596463bd1b4e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:22.512853 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 55/108] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:22.513714 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e025f-bda7-4b21-af82-c6b2fe425df7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:22.542472 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:22.554590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad78f3-0f76-4184-8547-10cd38ca3775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:22.555604 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad78f3-0f76-4184-8547-10cd38ca3775 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:22.555894 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad78f3-0f76-4184-8547-10cd38ca3775 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:22.556179 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad78f3-0f76-4184-8547-10cd38ca3775 None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0/users/a2d7884a8ac747abb51f87cce5fefa29/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:22.558225 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad78f3-0f76-4184-8547-10cd38ca3775 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d0d3a63468d4aeba187ed301b2ea4d0, user_id=a2d7884a8ac747abb51f87cce5fefa29, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:22.559975 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad78f3-0f76-4184-8547-10cd38ca3775 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:22.579122 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 54/109] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:23:22 2022] PUT /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0/users/a2d7884a8ac747abb51f87cce5fefa29/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:22.581537 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4d751-f1a2-4513-928b-4cda447015e4 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:22.582111 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4d751-f1a2-4513-928b-4cda447015e4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:22.582585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4d751-f1a2-4513-928b-4cda447015e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:22.605048 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-cbe4d751-f1a2-4513-928b-4cda447015e4 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:22.606891 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cbe4d751-f1a2-4513-928b-4cda447015e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:22.630436 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e025f-bda7-4b21-af82-c6b2fe425df7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:22.670875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345d750-9835-4a84-b7fd-f4b77edf6355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:22.671892 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345d750-9835-4a84-b7fd-f4b77edf6355 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:22.672356 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345d750-9835-4a84-b7fd-f4b77edf6355 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:22.672825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345d750-9835-4a84-b7fd-f4b77edf6355 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:22.674325 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345d750-9835-4a84-b7fd-f4b77edf6355 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:22.674476 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:22.676221 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345d750-9835-4a84-b7fd-f4b77edf6355 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:22.702106 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 55/110] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:22.702106 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6efd2c-5bf8-4bf1-b982-ded67c22220a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:22.702106 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6efd2c-5bf8-4bf1-b982-ded67c22220a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:22.702106 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6efd2c-5bf8-4bf1-b982-ded67c22220a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:22.721746 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3a6efd2c-5bf8-4bf1-b982-ded67c22220a None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:22.723201 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3a6efd2c-5bf8-4bf1-b982-ded67c22220a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:22.736022 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 56/111] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jul 14 15:23:22 2022] POST /identity/v3/projects => generated 302 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:22.771599 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345d750-9835-4a84-b7fd-f4b77edf6355 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:22.810775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 56/112] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:22.841740 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6efd2c-5bf8-4bf1-b982-ded67c22220a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:22.880027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:22.914431 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345d750-9835-4a84-b7fd-f4b77edf6355 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:22.951650 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4757b-0a8f-4c96-88a4-3018c6d21d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:22.952756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4757b-0a8f-4c96-88a4-3018c6d21d55 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:22.953245 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4757b-0a8f-4c96-88a4-3018c6d21d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:22.953700 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4757b-0a8f-4c96-88a4-3018c6d21d55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:22.964954 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6efd2c-5bf8-4bf1-b982-ded67c22220a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:22.967337 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4757b-0a8f-4c96-88a4-3018c6d21d55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:22.976755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-aaf4757b-0a8f-4c96-88a4-3018c6d21d55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:22.976755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:22.976755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:22.976755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:22.976755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:22.976755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:22.976755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:22.976755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:22.976755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:22.976755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:22.976755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:22.976755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:22.976755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:22.976755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:22.976755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:22.976755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:22.977672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:22.977672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:22.977672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:22.977672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:22.977672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:22.977672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:22.977672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:22.977672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:22.977672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:22.977672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:22.977672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:22.977672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:22.977672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:22.977672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:22.977672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:22.977672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:22.978479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:22.978479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:22.978479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:22.978479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:22.978479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:22.978479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:22.978479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:22.978479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:22.978479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:22.978479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:22.978479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:22.978479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:22.981180 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 57/113] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:23:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:23:22.988125 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4757b-0a8f-4c96-88a4-3018c6d21d55 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:22.994453 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:23.018587 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf31793-ed89-432c-97b4-ac5beae9d70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:23.019521 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf31793-ed89-432c-97b4-ac5beae9d70b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.019890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf31793-ed89-432c-97b4-ac5beae9d70b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.020249 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf31793-ed89-432c-97b4-ac5beae9d70b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.034187 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf31793-ed89-432c-97b4-ac5beae9d70b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:23.050283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-6cf31793-ed89-432c-97b4-ac5beae9d70b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:23.050283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:23.050283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:23.050283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:23.050283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:23.050283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:23.050283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:23.050283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:23.050283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:23.050283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:23.050283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:23.050283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:23.050283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:23.050283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:23.050283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:23.050283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:23.051633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:23.051633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:23.051633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:23.051633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:23.051633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:23.051633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:23.051633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:23.051633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:23.051633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:23.051633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:23.051633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:23.051633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:23.051633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:23.051633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:23.051633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:23.051633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:23.052376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:23.052376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:23.052376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:23.052376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:23.052376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:23.052376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:23.052376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:23.052376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:23.052376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:23.052376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:23.052376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:23.052376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:23:23.052376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 57/114] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:23:23.058630 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf31793-ed89-432c-97b4-ac5beae9d70b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:23.181536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf31793-ed89-432c-97b4-ac5beae9d70b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:23.200381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4757b-0a8f-4c96-88a4-3018c6d21d55 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:23.221264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff1671-aa6a-46de-acf4-187aa3f5601e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:23.222007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff1671-aa6a-46de-acf4-187aa3f5601e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.222342 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff1671-aa6a-46de-acf4-187aa3f5601e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.222629 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff1671-aa6a-46de-acf4-187aa3f5601e None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.223396 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff1671-aa6a-46de-acf4-187aa3f5601e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:23.223713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff1671-aa6a-46de-acf4-187aa3f5601e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:23.225194 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff1671-aa6a-46de-acf4-187aa3f5601e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:23.241439 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 58/115] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:23.244218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:23.247595 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f84b1-0002-44a6-b7c0-6026e482344e None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.247903 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f84b1-0002-44a6-b7c0-6026e482344e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.248182 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f84b1-0002-44a6-b7c0-6026e482344e None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.249848 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 59/116] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:23.250693 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f84b1-0002-44a6-b7c0-6026e482344e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:23.258782 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa030ea-630a-4621-ae18-025ff09d9301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:23.262684 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa030ea-630a-4621-ae18-025ff09d9301 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.263192 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa030ea-630a-4621-ae18-025ff09d9301 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.263676 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa030ea-630a-4621-ae18-025ff09d9301 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.265296 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa030ea-630a-4621-ae18-025ff09d9301 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:23.265822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa030ea-630a-4621-ae18-025ff09d9301 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:23.268573 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa030ea-630a-4621-ae18-025ff09d9301 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:23.280636 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 58/117] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:23.283066 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf800008-ccb1-4d84-b1ed-726ffec63022 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.283813 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf800008-ccb1-4d84-b1ed-726ffec63022 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.284301 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf800008-ccb1-4d84-b1ed-726ffec63022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.303840 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:23.312107 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-cf800008-ccb1-4d84-b1ed-726ffec63022 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:23.315588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cf800008-ccb1-4d84-b1ed-726ffec63022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:23.391258 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f84b1-0002-44a6-b7c0-6026e482344e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:23.428260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 59/118] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:23.429217 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf800008-ccb1-4d84-b1ed-726ffec63022 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:23.435847 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493617bd-1829-4e87-8405-6338c97cdb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:23.436845 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493617bd-1829-4e87-8405-6338c97cdb26 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.437238 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493617bd-1829-4e87-8405-6338c97cdb26 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.437618 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493617bd-1829-4e87-8405-6338c97cdb26 None admin] PATH_INFO: `/v3/users/1c6142b5a34148588ee6aee765481550` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.453465 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493617bd-1829-4e87-8405-6338c97cdb26 None admin] RBAC: Authorizing `identity:get_user(user_id=1c6142b5a34148588ee6aee765481550)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:23.455271 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493617bd-1829-4e87-8405-6338c97cdb26 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:23.457532 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 60/119] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:23 2022] GET /identity/v3/users/1c6142b5a34148588ee6aee765481550 => generated 289 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:23.459068 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d62963-c6cc-46cc-b7f1-00af84660b90 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.459488 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d62963-c6cc-46cc-b7f1-00af84660b90 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.459840 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d62963-c6cc-46cc-b7f1-00af84660b90 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.461165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 61/120] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:23.462544 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d62963-c6cc-46cc-b7f1-00af84660b90 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:23.576525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:23.577573 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf800008-ccb1-4d84-b1ed-726ffec63022 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:23.585320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d62963-c6cc-46cc-b7f1-00af84660b90 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:23.604516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:23.618634 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb5d44-7f36-4e34-86da-608ab48237db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:23.619494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb5d44-7f36-4e34-86da-608ab48237db None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.619782 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb5d44-7f36-4e34-86da-608ab48237db None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.620111 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb5d44-7f36-4e34-86da-608ab48237db None admin] PATH_INFO: `/v3/users/d66fbdf53c464c5aaadd47b4124dad03` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.621417 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb5d44-7f36-4e34-86da-608ab48237db None admin] RBAC: Authorizing `identity:get_user(user_id=d66fbdf53c464c5aaadd47b4124dad03)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:23.622977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb5d44-7f36-4e34-86da-608ab48237db None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:23.625296 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 60/121] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:23 2022] GET /identity/v3/users/d66fbdf53c464c5aaadd47b4124dad03 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:23.625968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca5beb-958d-4d11-9c13-7df093d3f802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:23.627103 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8592ca-d244-4b35-a4e0-ede00855ab03 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.627391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8592ca-d244-4b35-a4e0-ede00855ab03 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.627671 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8592ca-d244-4b35-a4e0-ede00855ab03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.628186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca5beb-958d-4d11-9c13-7df093d3f802 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.628721 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca5beb-958d-4d11-9c13-7df093d3f802 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.629202 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca5beb-958d-4d11-9c13-7df093d3f802 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.645396 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-0e8592ca-d244-4b35-a4e0-ede00855ab03 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:23.646718 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0e8592ca-d244-4b35-a4e0-ede00855ab03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:23.709041 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca5beb-958d-4d11-9c13-7df093d3f802 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:23.711077 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca5beb-958d-4d11-9c13-7df093d3f802 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:23.728623 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 61/122] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:23.729491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8592ca-d244-4b35-a4e0-ede00855ab03 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:23.825451 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:23.834028 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 62/123] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 15:23:23.835130 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca5beb-958d-4d11-9c13-7df093d3f802 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:23.846779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8592ca-d244-4b35-a4e0-ede00855ab03 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:23.872095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:23.886009 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fd990-e257-42a3-91fb-fe2168272456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:23.887066 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fd990-e257-42a3-91fb-fe2168272456 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.887694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fd990-e257-42a3-91fb-fe2168272456 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.888112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fd990-e257-42a3-91fb-fe2168272456 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.900134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fd990-e257-42a3-91fb-fe2168272456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:23.909628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-928fd990-e257-42a3-91fb-fe2168272456 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:23.909628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:23.909628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:23.909628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:23.909628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:23.909628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:23.909628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:23.909628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:23.909628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:23.909628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:23.909628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:23.909628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:23.909628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:23.909628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:23.909628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:23.909628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:23.910749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:23.910749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:23.910749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:23.910749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:23.910749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:23.910749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:23.910749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:23.910749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:23.910749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:23.910749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:23.910749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:23.910749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:23.910749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:23.910749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:23.910749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:23.910749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:23.911549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:23.911549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:23.911549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:23.911549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:23.911549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:23.911549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:23.911549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:23.911549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:23.911549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:23.911549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:23.911549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:23.911549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:23.913650 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 62/124] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:23.914602 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fd990-e257-42a3-91fb-fe2168272456 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:23.947335 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca5beb-958d-4d11-9c13-7df093d3f802 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:23.983032 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d4de3-1063-40ee-8f53-b9a91dbb6e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:23.983910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d4de3-1063-40ee-8f53-b9a91dbb6e5f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:23.984198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d4de3-1063-40ee-8f53-b9a91dbb6e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:23.984553 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d4de3-1063-40ee-8f53-b9a91dbb6e5f None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:23.986774 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d4de3-1063-40ee-8f53-b9a91dbb6e5f None admin] RBAC: Authorizing `identity:get_project(project_id=4d0d3a63468d4aeba187ed301b2ea4d0)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:23.988308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d4de3-1063-40ee-8f53-b9a91dbb6e5f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:23.990475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 63/125] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:23 2022] GET /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:23.991382 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d4de3-1063-40ee-8f53-b9a91dbb6e5f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:24.031809 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fd990-e257-42a3-91fb-fe2168272456 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:24.057941 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:24.073141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc388e8e-15c3-4a64-a2a0-4d0211826877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:24.074196 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc388e8e-15c3-4a64-a2a0-4d0211826877 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:24.074756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc388e8e-15c3-4a64-a2a0-4d0211826877 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:24.075184 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc388e8e-15c3-4a64-a2a0-4d0211826877 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:24.087196 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc388e8e-15c3-4a64-a2a0-4d0211826877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:24.096741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-cc388e8e-15c3-4a64-a2a0-4d0211826877 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:24.096741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:24.096741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:24.096741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:24.096741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:24.096741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:24.096741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:24.096741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:24.096741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:24.096741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:24.096741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:24.096741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:24.096741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:24.096741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:24.096741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:24.096741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:24.097775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:24.097775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:24.097775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:24.097775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:24.097775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:24.097775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:24.097775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:24.097775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:24.097775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:24.097775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:24.097775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:24.097775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:24.097775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:24.097775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:24.097775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:24.097775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:24.098694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:24.098694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:24.098694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:24.098694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:24.098694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:24.098694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:24.098694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:24.098694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:24.098694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:24.098694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:24.098694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:24.098694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:24.099736 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d4de3-1063-40ee-8f53-b9a91dbb6e5f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:24.100743 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 63/126] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:24.101765 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc388e8e-15c3-4a64-a2a0-4d0211826877 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:24.136812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2ae21-9785-48bd-94c1-17897786fb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:24.137746 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2ae21-9785-48bd-94c1-17897786fb7e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:24.138045 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2ae21-9785-48bd-94c1-17897786fb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:24.138376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2ae21-9785-48bd-94c1-17897786fb7e None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:24.139580 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2ae21-9785-48bd-94c1-17897786fb7e None admin] RBAC: Authorizing `identity:get_project(project_id=4d0d3a63468d4aeba187ed301b2ea4d0)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:24.141124 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2ae21-9785-48bd-94c1-17897786fb7e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:24.148632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 64/127] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:23 2022] GET /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:24.149613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2ae21-9785-48bd-94c1-17897786fb7e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:24.151826 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:24.215586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc388e8e-15c3-4a64-a2a0-4d0211826877 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:24.253038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358516e-b321-4c9a-aff6-ec2debfb2750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:24.253491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358516e-b321-4c9a-aff6-ec2debfb2750 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:24.253777 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358516e-b321-4c9a-aff6-ec2debfb2750 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:24.254054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358516e-b321-4c9a-aff6-ec2debfb2750 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:24.254827 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358516e-b321-4c9a-aff6-ec2debfb2750 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:24.255137 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358516e-b321-4c9a-aff6-ec2debfb2750 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:24.256536 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358516e-b321-4c9a-aff6-ec2debfb2750 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:24.265106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 64/128] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:23:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:24.265714 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358516e-b321-4c9a-aff6-ec2debfb2750 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:24.276685 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2ae21-9785-48bd-94c1-17897786fb7e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:24.323410 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:24.332113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54d7d4-4897-40e1-8fdf-4897e3fe37f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:24.333948 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54d7d4-4897-40e1-8fdf-4897e3fe37f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:24.334412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54d7d4-4897-40e1-8fdf-4897e3fe37f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:24.335131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54d7d4-4897-40e1-8fdf-4897e3fe37f1 None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0/users/d66fbdf53c464c5aaadd47b4124dad03/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:24.338108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54d7d4-4897-40e1-8fdf-4897e3fe37f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d0d3a63468d4aeba187ed301b2ea4d0, user_id=d66fbdf53c464c5aaadd47b4124dad03, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:24.340009 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed54d7d4-4897-40e1-8fdf-4897e3fe37f1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:24.357069 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 65/129] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:23:24 2022] PUT /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0/users/d66fbdf53c464c5aaadd47b4124dad03/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:24.358956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54d7d4-4897-40e1-8fdf-4897e3fe37f1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:24.392150 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358516e-b321-4c9a-aff6-ec2debfb2750 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:24.396761 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:24.444408 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032485ec-903c-441f-bda1-4459ee38ce76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:24.445376 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032485ec-903c-441f-bda1-4459ee38ce76 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:24.446344 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032485ec-903c-441f-bda1-4459ee38ce76 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:24.446868 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032485ec-903c-441f-bda1-4459ee38ce76 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:24.447866 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032485ec-903c-441f-bda1-4459ee38ce76 None admin] RBAC: Adding query filter params (name=member) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:24.448382 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032485ec-903c-441f-bda1-4459ee38ce76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:24.450866 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032485ec-903c-441f-bda1-4459ee38ce76 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:24.463236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 65/130] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:24.464592 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032485ec-903c-441f-bda1-4459ee38ce76 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:24.570742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54d7d4-4897-40e1-8fdf-4897e3fe37f1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:24.592830 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032485ec-903c-441f-bda1-4459ee38ce76 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:24.615546 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35281b41-980f-4a43-a8fa-e77778c906a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:24.616176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35281b41-980f-4a43-a8fa-e77778c906a8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:24.616472 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35281b41-980f-4a43-a8fa-e77778c906a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:24.616759 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35281b41-980f-4a43-a8fa-e77778c906a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:24.617613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35281b41-980f-4a43-a8fa-e77778c906a8 None admin] RBAC: Adding query filter params (role.id=df27537eb8b1489a9c3d91773fee26b4, scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0, user.id=1c6142b5a34148588ee6aee765481550) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:24.617934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35281b41-980f-4a43-a8fa-e77778c906a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:24.619458 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35281b41-980f-4a43-a8fa-e77778c906a8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:24.626679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 66/131] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:23:24 2022] GET /identity/v3/role_assignments?user.id=1c6142b5a34148588ee6aee765481550&scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0&role.id=df27537eb8b1489a9c3d91773fee26b4 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:24.631331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35281b41-980f-4a43-a8fa-e77778c906a8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:24.640416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99effa1-035c-4318-a18e-342a6bcdb89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:24.644207 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99effa1-035c-4318-a18e-342a6bcdb89a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:24.644767 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99effa1-035c-4318-a18e-342a6bcdb89a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:24.649116 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99effa1-035c-4318-a18e-342a6bcdb89a None admin] PATH_INFO: `/v3/users/a2d7884a8ac747abb51f87cce5fefa29` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:24.650946 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99effa1-035c-4318-a18e-342a6bcdb89a None admin] RBAC: Authorizing `identity:get_user(user_id=a2d7884a8ac747abb51f87cce5fefa29)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:24.652690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99effa1-035c-4318-a18e-342a6bcdb89a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:24.655078 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 66/132] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:24 2022] GET /identity/v3/users/a2d7884a8ac747abb51f87cce5fefa29 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:24.661691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99effa1-035c-4318-a18e-342a6bcdb89a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:24.706552 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:24.782742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99effa1-035c-4318-a18e-342a6bcdb89a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:24.799547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:24.824729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea54c0-64b1-4aed-a5df-5292c4921884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:24.825924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea54c0-64b1-4aed-a5df-5292c4921884 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:24.826617 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea54c0-64b1-4aed-a5df-5292c4921884 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:24.827128 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea54c0-64b1-4aed-a5df-5292c4921884 None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:24.828676 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea54c0-64b1-4aed-a5df-5292c4921884 None admin] RBAC: Authorizing `identity:get_project(project_id=4d0d3a63468d4aeba187ed301b2ea4d0)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:24.831501 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea54c0-64b1-4aed-a5df-5292c4921884 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:24.833748 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 67/133] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:24 2022] GET /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:24.839642 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea54c0-64b1-4aed-a5df-5292c4921884 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:24.919527 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35281b41-980f-4a43-a8fa-e77778c906a8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:25.001095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea54c0-64b1-4aed-a5df-5292c4921884 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:25.004384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:25.030584 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7bbd3-af96-4364-8810-abaaaf113c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:25.031588 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7bbd3-af96-4364-8810-abaaaf113c5f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:25.032111 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7bbd3-af96-4364-8810-abaaaf113c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:25.032936 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7bbd3-af96-4364-8810-abaaaf113c5f None admin] PATH_INFO: `/v3/users/a2d7884a8ac747abb51f87cce5fefa29` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:25.039115 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7bbd3-af96-4364-8810-abaaaf113c5f None admin] RBAC: Authorizing `identity:get_user(user_id=a2d7884a8ac747abb51f87cce5fefa29)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:25.040709 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d7bbd3-af96-4364-8810-abaaaf113c5f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:25.042513 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 67/134] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:24 2022] GET /identity/v3/users/a2d7884a8ac747abb51f87cce5fefa29 => generated 275 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:25.044511 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45133e29-0c56-4c3e-821d-c94a1dfa328d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:25.045632 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45133e29-0c56-4c3e-821d-c94a1dfa328d None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:25.046109 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45133e29-0c56-4c3e-821d-c94a1dfa328d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:25.046576 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45133e29-0c56-4c3e-821d-c94a1dfa328d None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0/users/a2d7884a8ac747abb51f87cce5fefa29/roles/26bfea3cd8164feeb8043fd508a5268c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:25.048326 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7bbd3-af96-4364-8810-abaaaf113c5f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:25.050364 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45133e29-0c56-4c3e-821d-c94a1dfa328d None admin] RBAC: Authorizing `identity:create_grant(project_id=4d0d3a63468d4aeba187ed301b2ea4d0, user_id=a2d7884a8ac747abb51f87cce5fefa29, role_id=26bfea3cd8164feeb8043fd508a5268c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:25.059193 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45133e29-0c56-4c3e-821d-c94a1dfa328d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:25.080071 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 68/135] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:23:24 2022] PUT /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0/users/a2d7884a8ac747abb51f87cce5fefa29/roles/26bfea3cd8164feeb8043fd508a5268c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:25.198000 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7bbd3-af96-4364-8810-abaaaf113c5f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:25.226629 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:25.243231 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce62799-c238-4ae4-b01a-23057f14d40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:25.244470 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce62799-c238-4ae4-b01a-23057f14d40b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:25.245017 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce62799-c238-4ae4-b01a-23057f14d40b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:25.245487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce62799-c238-4ae4-b01a-23057f14d40b None admin] PATH_INFO: `/v3/projects/eaba4d06035741658b29c0b060452c51` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:25.247147 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce62799-c238-4ae4-b01a-23057f14d40b None admin] RBAC: Authorizing `identity:get_project(project_id=eaba4d06035741658b29c0b060452c51)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:25.248912 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce62799-c238-4ae4-b01a-23057f14d40b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:25.251293 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 68/136] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:25 2022] GET /identity/v3/projects/eaba4d06035741658b29c0b060452c51 => generated 312 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:25.257597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45133e29-0c56-4c3e-821d-c94a1dfa328d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:25.367738 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1438d2-dd74-46d4-adbe-967cf743a09d None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:25.368327 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1438d2-dd74-46d4-adbe-967cf743a09d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:25.368828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1438d2-dd74-46d4-adbe-967cf743a09d None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:25.370581 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 69/137] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:23:25.380235 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495ed57-06bf-48e1-9d91-5b9c3143c80a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:25.380829 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495ed57-06bf-48e1-9d91-5b9c3143c80a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:25.381368 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495ed57-06bf-48e1-9d91-5b9c3143c80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:25.398028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45133e29-0c56-4c3e-821d-c94a1dfa328d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:25.426766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2495ed57-06bf-48e1-9d91-5b9c3143c80a None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:25.428346 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2495ed57-06bf-48e1-9d91-5b9c3143c80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:25.446145 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132f157-e4b7-47a2-83c5-fc01cd17132f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:25.447145 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132f157-e4b7-47a2-83c5-fc01cd17132f None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:25.447505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132f157-e4b7-47a2-83c5-fc01cd17132f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:25.447859 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132f157-e4b7-47a2-83c5-fc01cd17132f None admin] PATH_INFO: `/v3/projects/eaba4d06035741658b29c0b060452c51/users/a2d7884a8ac747abb51f87cce5fefa29/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:25.449997 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132f157-e4b7-47a2-83c5-fc01cd17132f None admin] RBAC: Authorizing `identity:create_grant(project_id=eaba4d06035741658b29c0b060452c51, user_id=a2d7884a8ac747abb51f87cce5fefa29, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:25.456059 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132f157-e4b7-47a2-83c5-fc01cd17132f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:25.473230 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 69/138] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:23:25 2022] PUT /identity/v3/projects/eaba4d06035741658b29c0b060452c51/users/a2d7884a8ac747abb51f87cce5fefa29/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:25.535855 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 70/139] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:25.583672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132f157-e4b7-47a2-83c5-fc01cd17132f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:25.616733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:25.716013 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132f157-e4b7-47a2-83c5-fc01cd17132f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:25.756946 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5faf5-d0e1-4ade-aa89-c98d51d3f796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:25.757755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5faf5-d0e1-4ade-aa89-c98d51d3f796 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:25.758042 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5faf5-d0e1-4ade-aa89-c98d51d3f796 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:25.758349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5faf5-d0e1-4ade-aa89-c98d51d3f796 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:25.775779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5faf5-d0e1-4ade-aa89-c98d51d3f796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:25.784233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ffe5faf5-d0e1-4ade-aa89-c98d51d3f796 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:25.784233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:25.784233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:25.784233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:25.784233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:25.784233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:25.784233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:25.784233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:25.784233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:25.784233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:25.784233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:25.784233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:25.784233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:25.784233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:25.784233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:25.784233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:25.785120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:25.785120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:25.785120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:25.785120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:25.785120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:25.785120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:25.785120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:25.785120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:25.785120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:25.785120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:25.785120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:25.785120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:25.785120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:25.785120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:25.785120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:25.785120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:25.785894 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:25.785894 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:25.785894 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:25.785894 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:25.785894 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:25.785894 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:25.785894 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:25.785894 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:25.785894 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:25.785894 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:25.785894 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:25.785894 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:25.785894 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 70/140] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:25.791662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495ed57-06bf-48e1-9d91-5b9c3143c80a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:25.915022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495ed57-06bf-48e1-9d91-5b9c3143c80a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:25.926104 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536887e-af57-4432-893d-9c805fc55ee7 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:25.926408 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536887e-af57-4432-893d-9c805fc55ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:25.926692 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536887e-af57-4432-893d-9c805fc55ee7 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:25.928225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 71/141] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:25.938276 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f8942-5dab-47e2-9718-98771c5783ec None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:25.938615 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f8942-5dab-47e2-9718-98771c5783ec None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:25.939012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f8942-5dab-47e2-9718-98771c5783ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:25.962622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-287f8942-5dab-47e2-9718-98771c5783ec None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:25.963823 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-287f8942-5dab-47e2-9718-98771c5783ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:25.990314 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:26.020064 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc8788-a35d-4692-bf87-8c3988b273f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:26.020747 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc8788-a35d-4692-bf87-8c3988b273f4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.021029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc8788-a35d-4692-bf87-8c3988b273f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.021307 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc8788-a35d-4692-bf87-8c3988b273f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.022086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc8788-a35d-4692-bf87-8c3988b273f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:26.022397 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc8788-a35d-4692-bf87-8c3988b273f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:26.023798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc8788-a35d-4692-bf87-8c3988b273f4 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:26.045639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 71/142] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:26.052621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc8788-a35d-4692-bf87-8c3988b273f4 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:26.135453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 72/143] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:26.164241 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc8788-a35d-4692-bf87-8c3988b273f4 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:26.177811 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f8942-5dab-47e2-9718-98771c5783ec None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:26.201013 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:26.205260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b1a9e-e23a-4f94-a785-52398f621de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:26.206612 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b1a9e-e23a-4f94-a785-52398f621de5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.207265 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b1a9e-e23a-4f94-a785-52398f621de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.207776 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b1a9e-e23a-4f94-a785-52398f621de5 None admin] PATH_INFO: `/v3/users/a2d7884a8ac747abb51f87cce5fefa29` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.209281 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b1a9e-e23a-4f94-a785-52398f621de5 None admin] RBAC: Authorizing `identity:get_user(user_id=a2d7884a8ac747abb51f87cce5fefa29)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:26.211395 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b1a9e-e23a-4f94-a785-52398f621de5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:26.213289 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 72/144] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:26 2022] GET /identity/v3/users/a2d7884a8ac747abb51f87cce5fefa29 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:26.218901 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b1a9e-e23a-4f94-a785-52398f621de5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:26.297492 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:26.335931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b1a9e-e23a-4f94-a785-52398f621de5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:26.375607 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c491a-dba0-4aea-af1f-8d1bb9756734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:26.377312 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c491a-dba0-4aea-af1f-8d1bb9756734 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.377809 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c491a-dba0-4aea-af1f-8d1bb9756734 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.378354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c491a-dba0-4aea-af1f-8d1bb9756734 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.469109 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c491a-dba0-4aea-af1f-8d1bb9756734 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:26.471784 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c491a-dba0-4aea-af1f-8d1bb9756734 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:26.504655 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f8942-5dab-47e2-9718-98771c5783ec None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:26.558578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:26.585063 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 73/145] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 15:23:26.589857 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31905f-efd8-4fc4-87ee-38e0e1f4a5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:26.589857 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31905f-efd8-4fc4-87ee-38e0e1f4a5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.589857 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31905f-efd8-4fc4-87ee-38e0e1f4a5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.589857 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31905f-efd8-4fc4-87ee-38e0e1f4a5f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.591430 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c491a-dba0-4aea-af1f-8d1bb9756734 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:26.596586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31905f-efd8-4fc4-87ee-38e0e1f4a5f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:26.598676 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31905f-efd8-4fc4-87ee-38e0e1f4a5f6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:26.601749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 73/146] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:26.610767 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31905f-efd8-4fc4-87ee-38e0e1f4a5f6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:26.754999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:26.776425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c491a-dba0-4aea-af1f-8d1bb9756734 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:26.804243 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31905f-efd8-4fc4-87ee-38e0e1f4a5f6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:26.828814 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3ab43-1ef8-4b73-bdd9-2ff42901337b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:26.831170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3ab43-1ef8-4b73-bdd9-2ff42901337b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.831979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3ab43-1ef8-4b73-bdd9-2ff42901337b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.832680 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3ab43-1ef8-4b73-bdd9-2ff42901337b None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.834916 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3ab43-1ef8-4b73-bdd9-2ff42901337b None admin] RBAC: Authorizing `identity:get_project(project_id=4d0d3a63468d4aeba187ed301b2ea4d0)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:26.837341 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3ab43-1ef8-4b73-bdd9-2ff42901337b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:26.839853 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 74/147] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:26 2022] GET /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:26.848136 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3ab43-1ef8-4b73-bdd9-2ff42901337b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:26.882464 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:26.910839 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a3c9d-069a-4693-8565-2abc97668c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:26.911535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a3c9d-069a-4693-8565-2abc97668c77 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:26.911822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a3c9d-069a-4693-8565-2abc97668c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:26.912101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a3c9d-069a-4693-8565-2abc97668c77 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:26.912848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a3c9d-069a-4693-8565-2abc97668c77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:26.914357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518a3c9d-069a-4693-8565-2abc97668c77 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:26.973540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 74/148] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jul 14 15:23:26 2022] POST /identity/v3/users => generated 283 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:27.012924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3ab43-1ef8-4b73-bdd9-2ff42901337b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:27.062462 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212b7ce-c703-4471-97da-b3f84c89e61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:27.063287 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212b7ce-c703-4471-97da-b3f84c89e61e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.063380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212b7ce-c703-4471-97da-b3f84c89e61e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.064221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212b7ce-c703-4471-97da-b3f84c89e61e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.065071 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212b7ce-c703-4471-97da-b3f84c89e61e None admin] RBAC: Adding query filter params (role.id=d98d81dd45ce4c4095c99ee0de89aab3, scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0, user.id=a2d7884a8ac747abb51f87cce5fefa29) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:27.065386 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212b7ce-c703-4471-97da-b3f84c89e61e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:27.066961 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212b7ce-c703-4471-97da-b3f84c89e61e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:27.074291 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 75/149] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:23:26 2022] GET /identity/v3/role_assignments?user.id=a2d7884a8ac747abb51f87cce5fefa29&scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0&role.id=d98d81dd45ce4c4095c99ee0de89aab3 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:27.693277 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822ba04-222d-4c87-a4a0-52283a38c49b None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.693770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822ba04-222d-4c87-a4a0-52283a38c49b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.693770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822ba04-222d-4c87-a4a0-52283a38c49b None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.695181 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 75/150] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:27.701003 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d21e2-f25c-4c3d-b3d6-0876b67eb06d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.701549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d21e2-f25c-4c3d-b3d6-0876b67eb06d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.702006 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d21e2-f25c-4c3d-b3d6-0876b67eb06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.725365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-192d21e2-f25c-4c3d-b3d6-0876b67eb06d None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:27.726895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-192d21e2-f25c-4c3d-b3d6-0876b67eb06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:27.819294 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 76/151] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:27.851135 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822ba04-222d-4c87-a4a0-52283a38c49b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:27.939370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc7da0-739d-4ea3-a96a-d143fac5669a None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.940080 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc7da0-739d-4ea3-a96a-d143fac5669a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.940581 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc7da0-739d-4ea3-a96a-d143fac5669a None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.942359 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 77/152] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:27.947990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1331512-c830-4bb7-b734-2eca9ada6373 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:27.948547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1331512-c830-4bb7-b734-2eca9ada6373 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:27.949236 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1331512-c830-4bb7-b734-2eca9ada6373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:27.982285 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e1331512-c830-4bb7-b734-2eca9ada6373 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:27.983518 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e1331512-c830-4bb7-b734-2eca9ada6373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:27.997210 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:28.012808 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822ba04-222d-4c87-a4a0-52283a38c49b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:28.084282 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdaa4eb-9b9b-4df0-b2a4-bfb932af77ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:28.085085 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdaa4eb-9b9b-4df0-b2a4-bfb932af77ac None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.085367 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdaa4eb-9b9b-4df0-b2a4-bfb932af77ac None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.085639 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdaa4eb-9b9b-4df0-b2a4-bfb932af77ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.098434 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:28.105481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdaa4eb-9b9b-4df0-b2a4-bfb932af77ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:28.115314 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 78/153] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:28.117399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-1cdaa4eb-9b9b-4df0-b2a4-bfb932af77ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:28.117399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:28.117399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:28.117399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:28.117399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:28.117399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:28.117399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:28.117399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:28.117399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:28.117399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:28.117399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:28.117399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:28.117399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:28.117399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:28.117399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:28.117399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:28.118769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:28.118769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:28.118769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:28.118769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:28.118769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:28.118769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:28.118769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:28.118769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:28.118769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:28.118769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:28.118769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:28.118769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:28.118769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:28.118769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:28.118769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:28.118769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:28.119740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:28.119740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:28.119740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:28.119740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:28.119740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:28.119740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:28.119740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:28.119740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:28.119740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:28.119740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:28.119740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:28.119740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:28.121293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 76/154] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:28.127632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1331512-c830-4bb7-b734-2eca9ada6373 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:28.149321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdaa4eb-9b9b-4df0-b2a4-bfb932af77ac None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:28.322211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdaa4eb-9b9b-4df0-b2a4-bfb932af77ac None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:28.322582 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1331512-c830-4bb7-b734-2eca9ada6373 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:28.367141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4873e0-85d2-4f59-bc66-34100d9fd0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:28.367717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4873e0-85d2-4f59-bc66-34100d9fd0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.368006 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4873e0-85d2-4f59-bc66-34100d9fd0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.368284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4873e0-85d2-4f59-bc66-34100d9fd0c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.369043 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4873e0-85d2-4f59-bc66-34100d9fd0c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:28.369350 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4873e0-85d2-4f59-bc66-34100d9fd0c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:28.370841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4873e0-85d2-4f59-bc66-34100d9fd0c4 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:28.382741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 79/155] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:28.387256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48f999-ff3c-43b5-b607-37187ba707fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:28.388088 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48f999-ff3c-43b5-b607-37187ba707fb None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.388378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48f999-ff3c-43b5-b607-37187ba707fb None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.388485 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4873e0-85d2-4f59-bc66-34100d9fd0c4 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:28.388674 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48f999-ff3c-43b5-b607-37187ba707fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.398732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:28.424056 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48f999-ff3c-43b5-b607-37187ba707fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:28.441770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-fe48f999-ff3c-43b5-b607-37187ba707fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:28.441770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:28.441770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:28.441770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:28.441770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:28.441770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:28.441770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:28.441770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:28.441770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:28.441770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:28.441770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:28.441770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:28.441770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:28.441770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:28.441770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:28.441770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:28.442950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:28.442950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:28.442950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:28.442950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:28.442950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:28.442950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:28.442950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:28.442950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:28.442950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:28.442950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:28.442950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:28.442950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:28.442950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:28.442950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:28.442950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:28.442950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:28.443829 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:28.443829 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:28.443829 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:28.443829 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:28.443829 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:28.443829 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:28.443829 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:28.443829 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:28.443829 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:28.443829 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:28.443829 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:28.443829 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:28.443829 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 77/156] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:23:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:28.451032 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48f999-ff3c-43b5-b607-37187ba707fb None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:28.509620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4873e0-85d2-4f59-bc66-34100d9fd0c4 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:28.550373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:28.571866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0103c7-b766-45f2-8b90-572c26351aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:28.572856 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0103c7-b766-45f2-8b90-572c26351aab None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.573082 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0103c7-b766-45f2-8b90-572c26351aab None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.573358 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0103c7-b766-45f2-8b90-572c26351aab None admin] PATH_INFO: `/v3/users/1c6142b5a34148588ee6aee765481550` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.577025 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0103c7-b766-45f2-8b90-572c26351aab None admin] RBAC: Authorizing `identity:get_user(user_id=1c6142b5a34148588ee6aee765481550)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:28.578566 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0103c7-b766-45f2-8b90-572c26351aab None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:28.580398 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 80/157] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:28 2022] GET /identity/v3/users/1c6142b5a34148588ee6aee765481550 => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:28.581681 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fec51-049a-4c98-84f6-132b7fa0a5e1 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.581976 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fec51-049a-4c98-84f6-132b7fa0a5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.582276 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fec51-049a-4c98-84f6-132b7fa0a5e1 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.583538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 81/158] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:28.584633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36ae14-f5db-492e-b2df-f83d7189cb86 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.584892 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36ae14-f5db-492e-b2df-f83d7189cb86 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.585172 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36ae14-f5db-492e-b2df-f83d7189cb86 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.586479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 82/159] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:28.587309 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36ae14-f5db-492e-b2df-f83d7189cb86 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:28.628988 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48f999-ff3c-43b5-b607-37187ba707fb None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:28.711041 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:28.717509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e6886-0a40-4d9a-965d-71eb358936f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:28.718336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e6886-0a40-4d9a-965d-71eb358936f5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.718724 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e6886-0a40-4d9a-965d-71eb358936f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.719086 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e6886-0a40-4d9a-965d-71eb358936f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.720605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e6886-0a40-4d9a-965d-71eb358936f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:28.721124 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e6886-0a40-4d9a-965d-71eb358936f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:28.723094 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e6886-0a40-4d9a-965d-71eb358936f5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:28.733897 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36ae14-f5db-492e-b2df-f83d7189cb86 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:28.745943 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 78/160] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:28.747103 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef9087-45fb-4538-aed3-2e9667489ffd None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.747474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef9087-45fb-4538-aed3-2e9667489ffd None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.747829 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef9087-45fb-4538-aed3-2e9667489ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.780890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108fa9e-e792-496c-a684-ed7cd625e526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:28.784341 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108fa9e-e792-496c-a684-ed7cd625e526 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.784821 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108fa9e-e792-496c-a684-ed7cd625e526 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.785269 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108fa9e-e792-496c-a684-ed7cd625e526 None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.787118 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108fa9e-e792-496c-a684-ed7cd625e526 None admin] RBAC: Authorizing `identity:get_project(project_id=4d0d3a63468d4aeba187ed301b2ea4d0)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:28.789719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108fa9e-e792-496c-a684-ed7cd625e526 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:28.790106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f9ef9087-45fb-4538-aed3-2e9667489ffd None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:28.791688 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f9ef9087-45fb-4538-aed3-2e9667489ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:28.802368 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 83/161] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:28 2022] GET /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:28.806117 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa86bb-91ef-476b-aa4a-ec89f4649c19 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:28.809976 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa86bb-91ef-476b-aa4a-ec89f4649c19 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:28.810482 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa86bb-91ef-476b-aa4a-ec89f4649c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:28.847418 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6baa86bb-91ef-476b-aa4a-ec89f4649c19 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:28.850676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6baa86bb-91ef-476b-aa4a-ec89f4649c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:28.958660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 84/162] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:28.960554 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa86bb-91ef-476b-aa4a-ec89f4649c19 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:29.000325 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 79/163] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:29.000985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef9087-45fb-4538-aed3-2e9667489ffd None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:29.058441 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:29.081972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:29.101397 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa86bb-91ef-476b-aa4a-ec89f4649c19 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:29.139332 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57554b24-6008-427d-886d-0a7b88538f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:29.141029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57554b24-6008-427d-886d-0a7b88538f79 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:29.142234 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57554b24-6008-427d-886d-0a7b88538f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:29.142735 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57554b24-6008-427d-886d-0a7b88538f79 None admin] PATH_INFO: `/v3/users/d66fbdf53c464c5aaadd47b4124dad03` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:29.144271 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57554b24-6008-427d-886d-0a7b88538f79 None admin] RBAC: Authorizing `identity:get_user(user_id=d66fbdf53c464c5aaadd47b4124dad03)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:29.146123 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57554b24-6008-427d-886d-0a7b88538f79 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:29.148004 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 85/164] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:28 2022] GET /identity/v3/users/d66fbdf53c464c5aaadd47b4124dad03 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:29.149098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57554b24-6008-427d-886d-0a7b88538f79 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:29.199543 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef9087-45fb-4538-aed3-2e9667489ffd None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:29.303111 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57554b24-6008-427d-886d-0a7b88538f79 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:29.306344 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc05cdd-e205-4a10-aa84-a8cb9563d874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:29.307170 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc05cdd-e205-4a10-aa84-a8cb9563d874 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:29.307459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc05cdd-e205-4a10-aa84-a8cb9563d874 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:29.307740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc05cdd-e205-4a10-aa84-a8cb9563d874 None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0/users/1c6142b5a34148588ee6aee765481550/roles/df27537eb8b1489a9c3d91773fee26b4` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:29.309747 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc05cdd-e205-4a10-aa84-a8cb9563d874 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d0d3a63468d4aeba187ed301b2ea4d0, user_id=1c6142b5a34148588ee6aee765481550, role_id=df27537eb8b1489a9c3d91773fee26b4)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:29.314829 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc05cdd-e205-4a10-aa84-a8cb9563d874 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:29.345942 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72580c03-6260-4fdb-b6e3-218e683b7909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:29.346467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 80/165] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:23:29 2022] PUT /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0/users/1c6142b5a34148588ee6aee765481550/roles/df27537eb8b1489a9c3d91773fee26b4 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:29.347488 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72580c03-6260-4fdb-b6e3-218e683b7909 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:29.347790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc05cdd-e205-4a10-aa84-a8cb9563d874 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:29.348250 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72580c03-6260-4fdb-b6e3-218e683b7909 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:29.348752 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72580c03-6260-4fdb-b6e3-218e683b7909 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:29.359306 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:29.363974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72580c03-6260-4fdb-b6e3-218e683b7909 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:29.372671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-72580c03-6260-4fdb-b6e3-218e683b7909 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:29.372671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:29.372671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:29.372671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:29.372671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:29.372671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:29.372671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:29.372671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:29.372671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:29.372671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:29.372671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:29.372671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:29.372671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:29.372671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:29.372671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:29.372671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:29.373634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:29.373634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:29.373634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:29.373634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:29.373634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:29.373634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:29.373634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:29.373634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:29.373634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:29.373634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:29.373634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:29.373634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:29.373634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:29.373634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:29.373634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:29.373634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:29.374448 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:29.374448 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:29.374448 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:29.374448 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:29.374448 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:29.374448 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:29.374448 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:29.374448 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:29.374448 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:29.374448 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:29.374448 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:29.374448 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:23:29.377984 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 86/166] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:29.379316 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72580c03-6260-4fdb-b6e3-218e683b7909 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:29.502377 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72580c03-6260-4fdb-b6e3-218e683b7909 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:29.543983 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2985c-08c0-4a2b-b944-6cb5178e9215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:29.545107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2985c-08c0-4a2b-b944-6cb5178e9215 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:29.545610 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2985c-08c0-4a2b-b944-6cb5178e9215 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:29.546198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2985c-08c0-4a2b-b944-6cb5178e9215 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:29.600601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc05cdd-e205-4a10-aa84-a8cb9563d874 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:29.620999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:29.630315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:29.633234 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2985c-08c0-4a2b-b944-6cb5178e9215 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:29.634815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2985c-08c0-4a2b-b944-6cb5178e9215 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:29.678861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b55929-8985-4bcc-80c3-0c1d01b6f8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:29.680246 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b55929-8985-4bcc-80c3-0c1d01b6f8ec None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:29.680752 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b55929-8985-4bcc-80c3-0c1d01b6f8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:29.681241 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b55929-8985-4bcc-80c3-0c1d01b6f8ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:29.718354 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b55929-8985-4bcc-80c3-0c1d01b6f8ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:29.733379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-d3b55929-8985-4bcc-80c3-0c1d01b6f8ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:29.733379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:29.733379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:29.733379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:29.733379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:29.733379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:29.733379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:29.733379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:29.733379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:29.733379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:29.733379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:29.733379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:29.733379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:29.733379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:29.733379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:29.733379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:29.734453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:29.734453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:29.734453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:29.734453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:29.734453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:29.734453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:29.734453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:29.734453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:29.734453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:29.734453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:29.734453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:29.734453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:29.734453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:29.734453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:29.734453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:29.734453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:29.735321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:29.735321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:29.735321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:29.735321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:29.735321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:29.735321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:29.735321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:29.735321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:29.735321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:29.735321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:29.735321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:29.735321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:29.735321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 81/167] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:29.744367 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b55929-8985-4bcc-80c3-0c1d01b6f8ec None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:29.841877 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 87/168] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:29.842598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2985c-08c0-4a2b-b944-6cb5178e9215 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:29.968098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:29.972495 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2985c-08c0-4a2b-b944-6cb5178e9215 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:29.973446 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b55929-8985-4bcc-80c3-0c1d01b6f8ec None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:30.015369 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cce7d0-12b7-4602-b531-2da7f518ab02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:30.016057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cce7d0-12b7-4602-b531-2da7f518ab02 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:30.016348 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cce7d0-12b7-4602-b531-2da7f518ab02 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:30.016630 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cce7d0-12b7-4602-b531-2da7f518ab02 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:30.018127 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cce7d0-12b7-4602-b531-2da7f518ab02 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:30.018607 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cce7d0-12b7-4602-b531-2da7f518ab02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:30.020328 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cce7d0-12b7-4602-b531-2da7f518ab02 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:30.030527 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 88/169] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:23:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:30.031835 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cce7d0-12b7-4602-b531-2da7f518ab02 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:30.050710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d7d4d-f223-4988-a768-084da6032406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:30.051496 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d7d4d-f223-4988-a768-084da6032406 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:30.051784 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d7d4d-f223-4988-a768-084da6032406 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:30.052058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d7d4d-f223-4988-a768-084da6032406 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:30.052823 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d7d4d-f223-4988-a768-084da6032406 None admin] RBAC: Adding query filter params (name=member) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:30.053131 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d7d4d-f223-4988-a768-084da6032406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:30.054799 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d7d4d-f223-4988-a768-084da6032406 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:30.070454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 82/170] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:30.071402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d7d4d-f223-4988-a768-084da6032406 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:30.154098 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:30.208108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cce7d0-12b7-4602-b531-2da7f518ab02 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:30.326785 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d7d4d-f223-4988-a768-084da6032406 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:30.334770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa451e41-2f57-4dc3-92c4-b7ea1b862a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:30.336001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa451e41-2f57-4dc3-92c4-b7ea1b862a5e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:30.336587 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa451e41-2f57-4dc3-92c4-b7ea1b862a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:30.337065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa451e41-2f57-4dc3-92c4-b7ea1b862a5e None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:30.338537 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa451e41-2f57-4dc3-92c4-b7ea1b862a5e None admin] RBAC: Authorizing `identity:get_project(project_id=4d0d3a63468d4aeba187ed301b2ea4d0)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:30.340201 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa451e41-2f57-4dc3-92c4-b7ea1b862a5e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:30.342356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 89/171] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:30 2022] GET /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0 => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:30.343377 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa451e41-2f57-4dc3-92c4-b7ea1b862a5e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:30.367404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4052c-8b17-4ca7-a907-4beb6b1c9601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:30.369810 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4052c-8b17-4ca7-a907-4beb6b1c9601 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:30.370403 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4052c-8b17-4ca7-a907-4beb6b1c9601 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:30.370969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4052c-8b17-4ca7-a907-4beb6b1c9601 None admin] PATH_INFO: `/v3/users/a2d7884a8ac747abb51f87cce5fefa29` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:30.373105 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4052c-8b17-4ca7-a907-4beb6b1c9601 None admin] RBAC: Authorizing `identity:get_user(user_id=a2d7884a8ac747abb51f87cce5fefa29)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:30.374819 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4052c-8b17-4ca7-a907-4beb6b1c9601 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:30.377617 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 83/172] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:30 2022] GET /identity/v3/users/a2d7884a8ac747abb51f87cce5fefa29 => generated 275 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:30.382135 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4052c-8b17-4ca7-a907-4beb6b1c9601 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:30.418723 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:30.534419 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:30.548491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4052c-8b17-4ca7-a907-4beb6b1c9601 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:30.602187 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa451e41-2f57-4dc3-92c4-b7ea1b862a5e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:30.651475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e92c67-9a0e-4dc2-a9ec-fb3f909afa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:30.652549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e92c67-9a0e-4dc2-a9ec-fb3f909afa6a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:30.653062 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e92c67-9a0e-4dc2-a9ec-fb3f909afa6a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:30.653548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e92c67-9a0e-4dc2-a9ec-fb3f909afa6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:30.654676 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e92c67-9a0e-4dc2-a9ec-fb3f909afa6a None admin] RBAC: Adding query filter params (role.id=87f040877bfa47bda56305eb022af09e, scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0, user.id=d66fbdf53c464c5aaadd47b4124dad03) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:30.655204 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e92c67-9a0e-4dc2-a9ec-fb3f909afa6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:30.656917 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e92c67-9a0e-4dc2-a9ec-fb3f909afa6a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:30.676839 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 84/173] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:23:30 2022] GET /identity/v3/role_assignments?user.id=d66fbdf53c464c5aaadd47b4124dad03&scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0&role.id=87f040877bfa47bda56305eb022af09e => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:30.678039 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e92c67-9a0e-4dc2-a9ec-fb3f909afa6a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:30.682606 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7583f-9475-4620-8b4e-42378bee2d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:30.683510 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7583f-9475-4620-8b4e-42378bee2d64 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:30.683790 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7583f-9475-4620-8b4e-42378bee2d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:30.684062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7583f-9475-4620-8b4e-42378bee2d64 None admin] PATH_INFO: `/v3/users/a2d7884a8ac747abb51f87cce5fefa29` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:30.691111 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7583f-9475-4620-8b4e-42378bee2d64 None admin] RBAC: Authorizing `identity:get_user(user_id=a2d7884a8ac747abb51f87cce5fefa29)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:30.692642 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7583f-9475-4620-8b4e-42378bee2d64 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:30.694557 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 90/174] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:30 2022] GET /identity/v3/users/a2d7884a8ac747abb51f87cce5fefa29 => generated 275 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:30.700482 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7583f-9475-4620-8b4e-42378bee2d64 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:30.887666 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7583f-9475-4620-8b4e-42378bee2d64 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:30.890382 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:30.948556 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ea87c-56b0-4e47-b681-1d5f0b3b71e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:30.949248 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ea87c-56b0-4e47-b681-1d5f0b3b71e2 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:30.949538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ea87c-56b0-4e47-b681-1d5f0b3b71e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:30.949827 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ea87c-56b0-4e47-b681-1d5f0b3b71e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:30.975106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e92c67-9a0e-4dc2-a9ec-fb3f909afa6a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:31.053759 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5cc56-09c6-4f44-a5a1-9202c53cdeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:31.054825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5cc56-09c6-4f44-a5a1-9202c53cdeb3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.055349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5cc56-09c6-4f44-a5a1-9202c53cdeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.055834 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5cc56-09c6-4f44-a5a1-9202c53cdeb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.099732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ea87c-56b0-4e47-b681-1d5f0b3b71e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:31.101656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ea87c-56b0-4e47-b681-1d5f0b3b71e2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:31.121190 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:31.197513 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5cc56-09c6-4f44-a5a1-9202c53cdeb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:31.199498 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5cc56-09c6-4f44-a5a1-9202c53cdeb3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:31.321152 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:31.334107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 91/175] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 15:23:31.334107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c153cd-2443-4515-ba78-7351d53a4275 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.334107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c153cd-2443-4515-ba78-7351d53a4275 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.334107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c153cd-2443-4515-ba78-7351d53a4275 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.334107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 92/176] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:31.337315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97deb6c3-85d5-46d3-b2ca-7160883045df None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.338394 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97deb6c3-85d5-46d3-b2ca-7160883045df None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.338686 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97deb6c3-85d5-46d3-b2ca-7160883045df None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.340208 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 93/177] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:31.347505 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fede91-69f2-41c5-8ab5-87aa5d663d97 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.347802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fede91-69f2-41c5-8ab5-87aa5d663d97 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.348099 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fede91-69f2-41c5-8ab5-87aa5d663d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.369468 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f4fede91-69f2-41c5-8ab5-87aa5d663d97 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:31.371100 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f4fede91-69f2-41c5-8ab5-87aa5d663d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:31.379243 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 85/178] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:31.380672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5cc56-09c6-4f44-a5a1-9202c53cdeb3 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:31.457257 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:31.459267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 94/179] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:31.461354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a1f0b-20a8-40a5-b6c5-db63cba44c2d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.461871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a1f0b-20a8-40a5-b6c5-db63cba44c2d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.462374 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a1f0b-20a8-40a5-b6c5-db63cba44c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.482160 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-9b8a1f0b-20a8-40a5-b6c5-db63cba44c2d None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:31.483760 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9b8a1f0b-20a8-40a5-b6c5-db63cba44c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:31.503958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5cc56-09c6-4f44-a5a1-9202c53cdeb3 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:31.548357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d70f9-c302-4b64-84a4-5f11b5d1aabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:31.549343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d70f9-c302-4b64-84a4-5f11b5d1aabe None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.549628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d70f9-c302-4b64-84a4-5f11b5d1aabe None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.549906 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d70f9-c302-4b64-84a4-5f11b5d1aabe None admin] PATH_INFO: `/v3/projects/eaba4d06035741658b29c0b060452c51` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.551432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d70f9-c302-4b64-84a4-5f11b5d1aabe None admin] RBAC: Authorizing `identity:get_project(project_id=eaba4d06035741658b29c0b060452c51)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:31.552986 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d70f9-c302-4b64-84a4-5f11b5d1aabe None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:31.555041 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 86/180] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:31 2022] GET /identity/v3/projects/eaba4d06035741658b29c0b060452c51 => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:31.555643 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d70f9-c302-4b64-84a4-5f11b5d1aabe None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:31.590661 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 95/181] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:31.590661 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a1f0b-20a8-40a5-b6c5-db63cba44c2d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:31.666745 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:31.698515 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d70f9-c302-4b64-84a4-5f11b5d1aabe None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:31.717091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a1f0b-20a8-40a5-b6c5-db63cba44c2d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:31.729656 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:31.737389 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204845e2-68f3-4e86-9f0d-01241bf60e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:31.738431 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204845e2-68f3-4e86-9f0d-01241bf60e20 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.738714 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204845e2-68f3-4e86-9f0d-01241bf60e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.738991 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204845e2-68f3-4e86-9f0d-01241bf60e20 None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.740187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204845e2-68f3-4e86-9f0d-01241bf60e20 None admin] RBAC: Authorizing `identity:get_project(project_id=4d0d3a63468d4aeba187ed301b2ea4d0)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:31.741642 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204845e2-68f3-4e86-9f0d-01241bf60e20 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:31.743383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 87/182] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:31 2022] GET /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:31.744641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab9771-7c1e-4976-9e12-6327c8f518fd None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.744921 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab9771-7c1e-4976-9e12-6327c8f518fd None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.745195 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab9771-7c1e-4976-9e12-6327c8f518fd None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.746653 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 88/183] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:31.747249 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab9771-7c1e-4976-9e12-6327c8f518fd None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:31.763215 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316864c-97dd-4dee-ac3e-b23e3916533b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:31.764437 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316864c-97dd-4dee-ac3e-b23e3916533b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.764984 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316864c-97dd-4dee-ac3e-b23e3916533b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.765446 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316864c-97dd-4dee-ac3e-b23e3916533b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.778384 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316864c-97dd-4dee-ac3e-b23e3916533b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:31.787533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-a316864c-97dd-4dee-ac3e-b23e3916533b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:31.787533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:31.787533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:31.787533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:31.787533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:31.787533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:31.787533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:31.787533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:31.787533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:31.787533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:31.787533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:31.787533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:31.787533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:31.787533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:31.787533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:31.787533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:31.788481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:31.788481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:31.788481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:31.788481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:31.788481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:31.788481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:31.788481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:31.788481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:31.788481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:31.788481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:31.788481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:31.788481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:31.788481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:31.788481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:31.788481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:31.788481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:31.789283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:31.789283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:31.789283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:31.789283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:31.789283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:31.789283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:31.789283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:31.789283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:31.789283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:31.789283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:31.789283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:31.789283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:23:31.791372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 96/184] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:23:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:31.792293 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316864c-97dd-4dee-ac3e-b23e3916533b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:31.866656 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab9771-7c1e-4976-9e12-6327c8f518fd None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:31.903641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b503b6-4b7a-408a-beb7-c35b8792fc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:31.904306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b503b6-4b7a-408a-beb7-c35b8792fc6d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.904586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b503b6-4b7a-408a-beb7-c35b8792fc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.904861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b503b6-4b7a-408a-beb7-c35b8792fc6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.905693 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b503b6-4b7a-408a-beb7-c35b8792fc6d None admin] RBAC: Adding query filter params (role.id=d98d81dd45ce4c4095c99ee0de89aab3, scope.project.id=eaba4d06035741658b29c0b060452c51, user.id=a2d7884a8ac747abb51f87cce5fefa29) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:31.906005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b503b6-4b7a-408a-beb7-c35b8792fc6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:31.908059 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b503b6-4b7a-408a-beb7-c35b8792fc6d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:31.922102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 89/185] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:23:31 2022] GET /identity/v3/role_assignments?user.id=a2d7884a8ac747abb51f87cce5fefa29&scope.project.id=eaba4d06035741658b29c0b060452c51&role.id=d98d81dd45ce4c4095c99ee0de89aab3 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:31.922323 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316864c-97dd-4dee-ac3e-b23e3916533b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:31.922450 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b503b6-4b7a-408a-beb7-c35b8792fc6d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:31.958566 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:31.986566 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fd3bd-2fd5-4281-8802-e5117492bafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:31.988079 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fd3bd-2fd5-4281-8802-e5117492bafb None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:31.989056 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fd3bd-2fd5-4281-8802-e5117492bafb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:31.989509 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fd3bd-2fd5-4281-8802-e5117492bafb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:31.992338 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87fd3bd-2fd5-4281-8802-e5117492bafb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:31.995902 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87fd3bd-2fd5-4281-8802-e5117492bafb None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:32.002840 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 97/186] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:32.002840 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2ec4c-e501-4ff1-88ab-e605c0874a38 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.002840 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2ec4c-e501-4ff1-88ab-e605c0874a38 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.002840 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2ec4c-e501-4ff1-88ab-e605c0874a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.021720 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:32.035128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-87f2ec4c-e501-4ff1-88ab-e605c0874a38 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:32.038007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-87f2ec4c-e501-4ff1-88ab-e605c0874a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:32.076546 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b503b6-4b7a-408a-beb7-c35b8792fc6d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:32.124513 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ef2f8-bdcd-43fc-a1d0-9fe1e0585bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:32.125177 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ef2f8-bdcd-43fc-a1d0-9fe1e0585bdd None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.125466 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ef2f8-bdcd-43fc-a1d0-9fe1e0585bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.125743 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ef2f8-bdcd-43fc-a1d0-9fe1e0585bdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.126952 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ef2f8-bdcd-43fc-a1d0-9fe1e0585bdd None admin] RBAC: Adding query filter params (role.id=26bfea3cd8164feeb8043fd508a5268c, scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0, user.id=a2d7884a8ac747abb51f87cce5fefa29) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:32.127269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ef2f8-bdcd-43fc-a1d0-9fe1e0585bdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:32.127801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 98/187] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:32.128676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2ec4c-e501-4ff1-88ab-e605c0874a38 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:32.128781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ef2f8-bdcd-43fc-a1d0-9fe1e0585bdd None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:32.136501 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 90/188] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:23:31 2022] GET /identity/v3/role_assignments?user.id=a2d7884a8ac747abb51f87cce5fefa29&scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0&role.id=26bfea3cd8164feeb8043fd508a5268c => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:32.137478 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ef2f8-bdcd-43fc-a1d0-9fe1e0585bdd None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:32.281171 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2ec4c-e501-4ff1-88ab-e605c0874a38 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:32.291828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ef2f8-bdcd-43fc-a1d0-9fe1e0585bdd None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:32.315445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:32.326136 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:32.338604 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947dfbb7-f7be-40bc-af23-89f9a71daa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:32.339384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dfbb7-f7be-40bc-af23-89f9a71daa37 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.339750 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dfbb7-f7be-40bc-af23-89f9a71daa37 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.340105 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dfbb7-f7be-40bc-af23-89f9a71daa37 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.340839 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947dfbb7-f7be-40bc-af23-89f9a71daa37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:32.342430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947dfbb7-f7be-40bc-af23-89f9a71daa37 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:32.342909 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0f7f9-2233-4358-9d24-bd9a2cfb2ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:32.344229 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0f7f9-2233-4358-9d24-bd9a2cfb2ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.344706 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0f7f9-2233-4358-9d24-bd9a2cfb2ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.345244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0f7f9-2233-4358-9d24-bd9a2cfb2ff1 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.346296 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0f7f9-2233-4358-9d24-bd9a2cfb2ff1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:32.346793 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0f7f9-2233-4358-9d24-bd9a2cfb2ff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:32.348397 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0f7f9-2233-4358-9d24-bd9a2cfb2ff1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:32.363816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 99/189] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:32.365563 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0f7f9-2233-4358-9d24-bd9a2cfb2ff1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:32.370968 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 91/190] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jul 14 15:23:32 2022] POST /identity/v3/users => generated 297 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:32.371229 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947dfbb7-f7be-40bc-af23-89f9a71daa37 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:32.539618 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0f7f9-2233-4358-9d24-bd9a2cfb2ff1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:32.550600 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947dfbb7-f7be-40bc-af23-89f9a71daa37 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:32.582963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba562eb-4a2f-48dc-86d6-c806e6dbceed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:32.584024 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba562eb-4a2f-48dc-86d6-c806e6dbceed None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.584488 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba562eb-4a2f-48dc-86d6-c806e6dbceed None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.584913 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba562eb-4a2f-48dc-86d6-c806e6dbceed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.591204 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2627ea2-3fa8-45f2-90f4-d6881dae910b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:32.592282 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2627ea2-3fa8-45f2-90f4-d6881dae910b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.592573 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2627ea2-3fa8-45f2-90f4-d6881dae910b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.592851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2627ea2-3fa8-45f2-90f4-d6881dae910b None admin] PATH_INFO: `/v3/users/b4b71afdd1c54eedb77b66fc22762df4` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.598369 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba562eb-4a2f-48dc-86d6-c806e6dbceed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:32.608164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-8ba562eb-4a2f-48dc-86d6-c806e6dbceed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:32.608164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:32.608164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:32.608164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:32.608164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:32.608164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:32.608164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:32.608164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:32.608164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:32.608164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:32.608164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:32.608164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:32.608164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:32.608164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:32.608164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:32.608164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:32.609139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:32.609139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:32.609139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:32.609139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:32.609139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:32.609139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:32.609139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:32.609139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:32.609139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:32.609139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:32.609139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:32.609139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:32.609139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:32.609139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:32.609139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:32.609139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:32.609934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:32.609934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:32.609934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:32.609934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:32.609934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:32.609934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:32.609934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:32.609934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:32.609934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:32.609934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:32.609934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:32.609934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:23:32.610985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2627ea2-3fa8-45f2-90f4-d6881dae910b None admin] RBAC: Authorizing `identity:get_user(user_id=b4b71afdd1c54eedb77b66fc22762df4)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:32.611059 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 100/191] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:32.611125 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2627ea2-3fa8-45f2-90f4-d6881dae910b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:32.611188 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702aa13-c601-4646-af47-0929f5708828 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.611859 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702aa13-c601-4646-af47-0929f5708828 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.611859 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702aa13-c601-4646-af47-0929f5708828 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.613310 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 101/192] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:32.614667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 92/193] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:32 2022] GET /identity/v3/users/b4b71afdd1c54eedb77b66fc22762df4 => generated 283 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:32.618134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702aa13-c601-4646-af47-0929f5708828 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:32.619543 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2627ea2-3fa8-45f2-90f4-d6881dae910b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:32.672619 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:32.674771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:32.757224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702aa13-c601-4646-af47-0929f5708828 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:32.759513 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2627ea2-3fa8-45f2-90f4-d6881dae910b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:32.809270 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbc751-289b-4df4-9f7f-27cb6048d6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:32.809882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84f821-7956-4e17-971e-3359bf88fc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:32.810442 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbc751-289b-4df4-9f7f-27cb6048d6eb None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.810630 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84f821-7956-4e17-971e-3359bf88fc87 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.811042 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84f821-7956-4e17-971e-3359bf88fc87 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.811287 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbc751-289b-4df4-9f7f-27cb6048d6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.811409 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84f821-7956-4e17-971e-3359bf88fc87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.811810 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbc751-289b-4df4-9f7f-27cb6048d6eb None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.812738 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbc751-289b-4df4-9f7f-27cb6048d6eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:32.813060 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbc751-289b-4df4-9f7f-27cb6048d6eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:32.815436 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbc751-289b-4df4-9f7f-27cb6048d6eb None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:32.827638 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 102/194] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:23:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:32.830563 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30acb1-e7c2-4e3d-9087-3457e202d6f9 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:32.831178 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30acb1-e7c2-4e3d-9087-3457e202d6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:32.831811 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30acb1-e7c2-4e3d-9087-3457e202d6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:32.860291 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2f30acb1-e7c2-4e3d-9087-3457e202d6f9 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:32.864226 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2f30acb1-e7c2-4e3d-9087-3457e202d6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:32.907464 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84f821-7956-4e17-971e-3359bf88fc87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:32.909846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84f821-7956-4e17-971e-3359bf88fc87 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:32.961195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 103/195] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:32.962306 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30acb1-e7c2-4e3d-9087-3457e202d6f9 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:32.967007 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:33.000832 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:33.060035 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 93/196] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 15:23:33.062249 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84f821-7956-4e17-971e-3359bf88fc87 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:33.107652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30acb1-e7c2-4e3d-9087-3457e202d6f9 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:33.156587 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725fb7f-73cf-4ce1-8c4b-2d2d944b1411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:33.159380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725fb7f-73cf-4ce1-8c4b-2d2d944b1411 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:33.160194 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725fb7f-73cf-4ce1-8c4b-2d2d944b1411 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:33.160982 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725fb7f-73cf-4ce1-8c4b-2d2d944b1411 None admin] PATH_INFO: `/v3/users/b4b71afdd1c54eedb77b66fc22762df4` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:33.163501 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725fb7f-73cf-4ce1-8c4b-2d2d944b1411 None admin] RBAC: Authorizing `identity:get_user(user_id=b4b71afdd1c54eedb77b66fc22762df4)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:33.165243 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725fb7f-73cf-4ce1-8c4b-2d2d944b1411 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:33.167501 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 104/197] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:32 2022] GET /identity/v3/users/b4b71afdd1c54eedb77b66fc22762df4 => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:33.168520 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725fb7f-73cf-4ce1-8c4b-2d2d944b1411 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:33.211434 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84f821-7956-4e17-971e-3359bf88fc87 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:33.259444 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea237a7d-8483-4509-b06c-723c7d1aaa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:33.260205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea237a7d-8483-4509-b06c-723c7d1aaa0e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:33.260491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea237a7d-8483-4509-b06c-723c7d1aaa0e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:33.260771 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea237a7d-8483-4509-b06c-723c7d1aaa0e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:33.271195 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:33.274508 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea237a7d-8483-4509-b06c-723c7d1aaa0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:33.284577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ea237a7d-8483-4509-b06c-723c7d1aaa0e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:33.284577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:33.284577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:33.284577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:33.284577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:33.284577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:33.284577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:33.284577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:33.284577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:33.284577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:33.284577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:33.284577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:33.284577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:33.284577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:33.284577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:33.284577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:33.285558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:33.285558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:33.285558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:33.285558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:33.285558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:33.285558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:33.285558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:33.285558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:33.285558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:33.285558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:33.285558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:33.285558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:33.285558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:33.285558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:33.285558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:33.285558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:33.286391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:33.286391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:33.286391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:33.286391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:33.286391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:33.286391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:33.286391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:33.286391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:33.286391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:33.286391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:33.286391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:33.286391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:33.286391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 94/198] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:33.291936 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea237a7d-8483-4509-b06c-723c7d1aaa0e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:33.311464 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:33.319669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725fb7f-73cf-4ce1-8c4b-2d2d944b1411 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:33.366483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6be7d5-acb9-4986-b728-8854271625fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:33.368219 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6be7d5-acb9-4986-b728-8854271625fb None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:33.368705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6be7d5-acb9-4986-b728-8854271625fb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:33.369179 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6be7d5-acb9-4986-b728-8854271625fb None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:33.370629 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6be7d5-acb9-4986-b728-8854271625fb None admin] RBAC: Authorizing `identity:get_project(project_id=c02407b0147e4d3e9acde0d88630dd1c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:33.372309 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6be7d5-acb9-4986-b728-8854271625fb None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:33.374315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 105/199] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:33 2022] GET /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:33.375355 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6be7d5-acb9-4986-b728-8854271625fb None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:33.430744 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea237a7d-8483-4509-b06c-723c7d1aaa0e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:33.469288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedbcf3-e5aa-44dd-b604-a613f7b27b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:33.470178 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedbcf3-e5aa-44dd-b604-a613f7b27b2c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:33.470540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedbcf3-e5aa-44dd-b604-a613f7b27b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:33.470825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedbcf3-e5aa-44dd-b604-a613f7b27b2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:33.495675 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6be7d5-acb9-4986-b728-8854271625fb None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:33.534716 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc10bc5-5fd9-49d8-84cd-e226f58c873d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:33.535796 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc10bc5-5fd9-49d8-84cd-e226f58c873d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:33.536283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc10bc5-5fd9-49d8-84cd-e226f58c873d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:33.536776 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc10bc5-5fd9-49d8-84cd-e226f58c873d None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:33.537726 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc10bc5-5fd9-49d8-84cd-e226f58c873d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:33.538284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc10bc5-5fd9-49d8-84cd-e226f58c873d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:33.539873 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc10bc5-5fd9-49d8-84cd-e226f58c873d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:33.545691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:33.550492 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedbcf3-e5aa-44dd-b604-a613f7b27b2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:33.552328 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedbcf3-e5aa-44dd-b604-a613f7b27b2c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:33.555349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 106/200] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:33.556479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc10bc5-5fd9-49d8-84cd-e226f58c873d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:33.587827 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:33.670790 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc10bc5-5fd9-49d8-84cd-e226f58c873d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:33.671401 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 95/201] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:33.672479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedbcf3-e5aa-44dd-b604-a613f7b27b2c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:33.721013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f36b8-bab1-4d8c-8d4b-32558b214d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:33.721526 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f36b8-bab1-4d8c-8d4b-32558b214d5f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:33.722010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f36b8-bab1-4d8c-8d4b-32558b214d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:33.722329 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f36b8-bab1-4d8c-8d4b-32558b214d5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:33.723322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f36b8-bab1-4d8c-8d4b-32558b214d5f None admin] RBAC: Adding query filter params (role.id=87f040877bfa47bda56305eb022af09e, scope.project.id=c02407b0147e4d3e9acde0d88630dd1c, user.id=b4b71afdd1c54eedb77b66fc22762df4) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:33.723789 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f36b8-bab1-4d8c-8d4b-32558b214d5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:33.725936 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f36b8-bab1-4d8c-8d4b-32558b214d5f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:33.734836 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 107/202] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:23:33 2022] GET /identity/v3/role_assignments?user.id=b4b71afdd1c54eedb77b66fc22762df4&scope.project.id=c02407b0147e4d3e9acde0d88630dd1c&role.id=87f040877bfa47bda56305eb022af09e => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:33.735983 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f36b8-bab1-4d8c-8d4b-32558b214d5f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:33.857540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:33.864328 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedbcf3-e5aa-44dd-b604-a613f7b27b2c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:33.923730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:33.938422 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e5345-be09-4c40-8571-61779cffaef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:33.940132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e5345-be09-4c40-8571-61779cffaef2 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:33.940421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e5345-be09-4c40-8571-61779cffaef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:33.940699 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e5345-be09-4c40-8571-61779cffaef2 None admin] PATH_INFO: `/v3/users/1c6142b5a34148588ee6aee765481550` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:33.943662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f36b8-bab1-4d8c-8d4b-32558b214d5f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:33.946061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e5345-be09-4c40-8571-61779cffaef2 None admin] RBAC: Authorizing `identity:get_user(user_id=1c6142b5a34148588ee6aee765481550)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:33.947618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e5345-be09-4c40-8571-61779cffaef2 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:33.951081 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 96/203] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:33 2022] GET /identity/v3/users/1c6142b5a34148588ee6aee765481550 => generated 289 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:33.957299 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e5345-be09-4c40-8571-61779cffaef2 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:34.003305 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e9550-d982-4a83-bd42-3170d6ccba57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:34.004197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e9550-d982-4a83-bd42-3170d6ccba57 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.004479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e9550-d982-4a83-bd42-3170d6ccba57 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.004757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e9550-d982-4a83-bd42-3170d6ccba57 None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.007737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e9550-d982-4a83-bd42-3170d6ccba57 None admin] RBAC: Authorizing `identity:get_project(project_id=c02407b0147e4d3e9acde0d88630dd1c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:34.012406 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e9550-d982-4a83-bd42-3170d6ccba57 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:34.020216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 108/204] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:33 2022] GET /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:34.027183 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e9550-d982-4a83-bd42-3170d6ccba57 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:34.108269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e5345-be09-4c40-8571-61779cffaef2 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:34.147779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15732a59-6b0a-47e3-b41f-21161e6ea493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:34.148550 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15732a59-6b0a-47e3-b41f-21161e6ea493 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.148844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15732a59-6b0a-47e3-b41f-21161e6ea493 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.149130 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15732a59-6b0a-47e3-b41f-21161e6ea493 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.189166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:34.228035 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15732a59-6b0a-47e3-b41f-21161e6ea493 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:34.229675 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15732a59-6b0a-47e3-b41f-21161e6ea493 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:34.236524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e9550-d982-4a83-bd42-3170d6ccba57 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:34.272821 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d0412-f33f-40aa-b112-93f176f0a0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:34.273488 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d0412-f33f-40aa-b112-93f176f0a0ca None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.273774 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d0412-f33f-40aa-b112-93f176f0a0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.274049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d0412-f33f-40aa-b112-93f176f0a0ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.274928 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d0412-f33f-40aa-b112-93f176f0a0ca None admin] RBAC: Adding query filter params (role.id=26bfea3cd8164feeb8043fd508a5268c, scope.project.id=c02407b0147e4d3e9acde0d88630dd1c, user.id=b4b71afdd1c54eedb77b66fc22762df4) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:34.275247 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d0412-f33f-40aa-b112-93f176f0a0ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:34.276934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d0412-f33f-40aa-b112-93f176f0a0ca None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:34.283577 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 109/205] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:23:34 2022] GET /identity/v3/role_assignments?user.id=b4b71afdd1c54eedb77b66fc22762df4&scope.project.id=c02407b0147e4d3e9acde0d88630dd1c&role.id=26bfea3cd8164feeb8043fd508a5268c => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:34.357236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 97/206] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:34.364160 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d0412-f33f-40aa-b112-93f176f0a0ca None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:34.403450 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:34.546343 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d0412-f33f-40aa-b112-93f176f0a0ca None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:34.602887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf331a23-bbec-474d-8afe-25bc82290090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:34.603792 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf331a23-bbec-474d-8afe-25bc82290090 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.604079 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf331a23-bbec-474d-8afe-25bc82290090 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.604361 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf331a23-bbec-474d-8afe-25bc82290090 None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.605680 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf331a23-bbec-474d-8afe-25bc82290090 None admin] RBAC: Authorizing `identity:get_project(project_id=4d0d3a63468d4aeba187ed301b2ea4d0)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:34.607242 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf331a23-bbec-474d-8afe-25bc82290090 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:34.609297 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 110/207] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:34 2022] GET /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:34.616281 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15732a59-6b0a-47e3-b41f-21161e6ea493 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:34.713966 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:34.756408 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15732a59-6b0a-47e3-b41f-21161e6ea493 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:34.814312 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96460be-5c4c-4a89-9c77-3dbecc1c0cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:34.816094 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96460be-5c4c-4a89-9c77-3dbecc1c0cbc None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:34.816841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96460be-5c4c-4a89-9c77-3dbecc1c0cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:34.817568 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96460be-5c4c-4a89-9c77-3dbecc1c0cbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:34.819943 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96460be-5c4c-4a89-9c77-3dbecc1c0cbc None admin] RBAC: Adding query filter params (role.id=df27537eb8b1489a9c3d91773fee26b4, scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0, user.id=1c6142b5a34148588ee6aee765481550) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:34.820745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96460be-5c4c-4a89-9c77-3dbecc1c0cbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:34.823285 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96460be-5c4c-4a89-9c77-3dbecc1c0cbc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:34.833671 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 98/208] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:23:34 2022] GET /identity/v3/role_assignments?user.id=1c6142b5a34148588ee6aee765481550&scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0&role.id=df27537eb8b1489a9c3d91773fee26b4 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:35.247673 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaaace-3db8-4643-b8b0-0b978744c9c5 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:35.248073 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaaace-3db8-4643-b8b0-0b978744c9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:35.248260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaaace-3db8-4643-b8b0-0b978744c9c5 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:35.249920 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 111/209] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:35.255988 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb3b45-64aa-4a96-afb4-0987a8e79ac7 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:35.256501 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb3b45-64aa-4a96-afb4-0987a8e79ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:35.256614 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb3b45-64aa-4a96-afb4-0987a8e79ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:35.276889 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9edb3b45-64aa-4a96-afb4-0987a8e79ac7 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:35.278184 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9edb3b45-64aa-4a96-afb4-0987a8e79ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:35.318890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33ddd3-bcf3-4cf4-b035-9b559b3ef462 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:35.319292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33ddd3-bcf3-4cf4-b035-9b559b3ef462 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:35.319574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33ddd3-bcf3-4cf4-b035-9b559b3ef462 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:35.321453 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 112/210] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:23:35.327849 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba4292-1c37-4604-8e21-9cfe1a25fed7 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:35.328187 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba4292-1c37-4604-8e21-9cfe1a25fed7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:35.328409 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba4292-1c37-4604-8e21-9cfe1a25fed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:35.351610 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c1ba4292-1c37-4604-8e21-9cfe1a25fed7 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:35.353001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c1ba4292-1c37-4604-8e21-9cfe1a25fed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:35.386027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 99/211] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:35.420260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb3b45-64aa-4a96-afb4-0987a8e79ac7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:35.444881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 113/212] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:35.483329 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba4292-1c37-4604-8e21-9cfe1a25fed7 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:35.513232 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:35.520964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:35.567786 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb3b45-64aa-4a96-afb4-0987a8e79ac7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:35.594625 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba4292-1c37-4604-8e21-9cfe1a25fed7 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:35.607211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407dfab0-1f6a-43d0-8119-a0da64cde340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:35.608069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dfab0-1f6a-43d0-8119-a0da64cde340 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:35.608350 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dfab0-1f6a-43d0-8119-a0da64cde340 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:35.608628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407dfab0-1f6a-43d0-8119-a0da64cde340 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:35.620800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407dfab0-1f6a-43d0-8119-a0da64cde340 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:35.630893 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379ae0b-050f-4e8a-9a29-b4ae86ee042e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:35.631175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-407dfab0-1f6a-43d0-8119-a0da64cde340 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:35.631175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:35.631175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:35.631175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:35.631175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:35.631175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:35.631175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:35.631175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:35.631175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:35.631175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:35.631175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:35.631175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:35.631175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:35.631175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:35.631175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:35.631175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:35.633315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:35.633315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:35.633315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:35.633315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:35.633315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:35.633315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:35.633315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:35.633315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:35.633315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:35.633315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:35.633315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:35.633315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:35.633315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:35.633315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:35.633315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:35.633315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:35.635396 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:35.635396 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:35.635396 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:35.635396 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:35.635396 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:35.635396 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:35.635396 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:35.635396 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:35.635396 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:35.635396 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:35.635396 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:35.635396 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:35.636884 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379ae0b-050f-4e8a-9a29-b4ae86ee042e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:35.636884 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379ae0b-050f-4e8a-9a29-b4ae86ee042e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:35.636884 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379ae0b-050f-4e8a-9a29-b4ae86ee042e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:35.639229 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 100/213] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:23:35.639333 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379ae0b-050f-4e8a-9a29-b4ae86ee042e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:35.639333 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379ae0b-050f-4e8a-9a29-b4ae86ee042e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:35.639494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407dfab0-1f6a-43d0-8119-a0da64cde340 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:35.639628 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 114/214] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:35.644628 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379ae0b-050f-4e8a-9a29-b4ae86ee042e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:35.778576 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407dfab0-1f6a-43d0-8119-a0da64cde340 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:35.784095 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:35.795523 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379ae0b-050f-4e8a-9a29-b4ae86ee042e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:35.815981 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:35.835914 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6f41e-cf94-47bf-8b48-0fb4b2389126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:35.837150 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6f41e-cf94-47bf-8b48-0fb4b2389126 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:35.837716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6f41e-cf94-47bf-8b48-0fb4b2389126 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:35.838375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6f41e-cf94-47bf-8b48-0fb4b2389126 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:35.839731 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6f41e-cf94-47bf-8b48-0fb4b2389126 None admin] RBAC: Adding query filter params (name=member) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:35.840357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6f41e-cf94-47bf-8b48-0fb4b2389126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:35.841822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afb201-c3f7-4dd2-a7fb-47f71c0dd61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:35.842536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afb201-c3f7-4dd2-a7fb-47f71c0dd61e None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:35.842817 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afb201-c3f7-4dd2-a7fb-47f71c0dd61e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:35.843090 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96afb201-c3f7-4dd2-a7fb-47f71c0dd61e None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:35.843258 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6f41e-cf94-47bf-8b48-0fb4b2389126 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:35.843806 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afb201-c3f7-4dd2-a7fb-47f71c0dd61e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:35.845529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96afb201-c3f7-4dd2-a7fb-47f71c0dd61e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:35.858948 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 101/215] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:35.866837 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6f41e-cf94-47bf-8b48-0fb4b2389126 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:35.875692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 115/216] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jul 14 15:23:35 2022] POST /identity/v3/users => generated 297 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:23:36.007019 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6f41e-cf94-47bf-8b48-0fb4b2389126 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:36.049027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42a420-3909-48ff-a445-73b359985e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:36.050199 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42a420-3909-48ff-a445-73b359985e49 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:36.050634 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42a420-3909-48ff-a445-73b359985e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:36.051059 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42a420-3909-48ff-a445-73b359985e49 None admin] PATH_INFO: `/v3/users/abc3c7c815664860892bd721aa10133d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:36.069155 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42a420-3909-48ff-a445-73b359985e49 None admin] RBAC: Authorizing `identity:get_user(user_id=abc3c7c815664860892bd721aa10133d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:36.072032 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42a420-3909-48ff-a445-73b359985e49 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:36.074379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 102/217] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:35 2022] GET /identity/v3/users/abc3c7c815664860892bd721aa10133d => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:36.080639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afb201-c3f7-4dd2-a7fb-47f71c0dd61e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:36.252624 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96afb201-c3f7-4dd2-a7fb-47f71c0dd61e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:36.313267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed520d-91b7-4a90-b5c7-7dd23361c1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:36.314883 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed520d-91b7-4a90-b5c7-7dd23361c1bf None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:36.315382 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed520d-91b7-4a90-b5c7-7dd23361c1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:36.315971 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed520d-91b7-4a90-b5c7-7dd23361c1bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:36.348564 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:36.472801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed520d-91b7-4a90-b5c7-7dd23361c1bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:36.475903 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ed520d-91b7-4a90-b5c7-7dd23361c1bf None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:36.529836 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a76b99-b79e-4aaf-b986-d3858dc7d845 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:36.530956 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a76b99-b79e-4aaf-b986-d3858dc7d845 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:36.531473 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a76b99-b79e-4aaf-b986-d3858dc7d845 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:36.538195 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 103/218] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:36.543688 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267853f1-76af-49b0-855f-f8be9718a22b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:36.544306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267853f1-76af-49b0-855f-f8be9718a22b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:36.544655 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267853f1-76af-49b0-855f-f8be9718a22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:36.572158 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-267853f1-76af-49b0-855f-f8be9718a22b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:36.573847 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-267853f1-76af-49b0-855f-f8be9718a22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:36.630445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:36.676354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 116/219] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:36.682952 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed520d-91b7-4a90-b5c7-7dd23361c1bf None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:36.723593 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 104/220] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:36.756595 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:36.759405 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267853f1-76af-49b0-855f-f8be9718a22b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:36.897767 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267853f1-76af-49b0-855f-f8be9718a22b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:36.905451 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed520d-91b7-4a90-b5c7-7dd23361c1bf None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:36.945571 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ac5e0-fe87-4b0c-987e-3ddd074d1a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:36.946671 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ac5e0-fe87-4b0c-987e-3ddd074d1a95 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:36.947107 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ac5e0-fe87-4b0c-987e-3ddd074d1a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:36.947809 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ac5e0-fe87-4b0c-987e-3ddd074d1a95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:36.961996 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac1715-0be8-4ea3-8f1e-65b2c82e910c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:36.962789 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ac5e0-fe87-4b0c-987e-3ddd074d1a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:36.963551 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac1715-0be8-4ea3-8f1e-65b2c82e910c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:36.964044 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac1715-0be8-4ea3-8f1e-65b2c82e910c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:36.964555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac1715-0be8-4ea3-8f1e-65b2c82e910c None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:36.966024 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac1715-0be8-4ea3-8f1e-65b2c82e910c None admin] RBAC: Authorizing `identity:get_project(project_id=c02407b0147e4d3e9acde0d88630dd1c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:36.967749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac1715-0be8-4ea3-8f1e-65b2c82e910c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:36.971110 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 117/221] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:36 2022] GET /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:36.973379 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461c790-38c3-4323-ab51-4ee6ee5e40e7 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:36.973947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461c790-38c3-4323-ab51-4ee6ee5e40e7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:36.974491 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461c790-38c3-4323-ab51-4ee6ee5e40e7 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:36.976391 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 118/222] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:36.980727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-253ac5e0-fe87-4b0c-987e-3ddd074d1a95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:36.980727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:36.980727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:36.980727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:36.980727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:36.980727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:36.980727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:36.980727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:36.980727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:36.980727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:36.980727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:36.980727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:36.980727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:36.980727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:36.980727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:36.980727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:36.981633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:36.981633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:36.981633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:36.981633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:36.981633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:36.981633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:36.981633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:36.981633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:36.981633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:36.981633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:36.981633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:36.981633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:36.981633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:36.981633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:36.981633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:36.981633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:36.983106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:36.983106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:36.983106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:36.983106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:36.983106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:36.983106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:36.983106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:36.983106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:36.983106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:36.983106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:36.983106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:36.983106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:36.983106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 105/223] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:23:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:36.983106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ac5e0-fe87-4b0c-987e-3ddd074d1a95 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:36.985319 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461c790-38c3-4323-ab51-4ee6ee5e40e7 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:37.035869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:37.115148 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ac5e0-fe87-4b0c-987e-3ddd074d1a95 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:37.127034 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461c790-38c3-4323-ab51-4ee6ee5e40e7 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:37.148489 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:37.163376 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf9104-acd6-42ca-82ac-f386ca6ee3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:37.164503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf9104-acd6-42ca-82ac-f386ca6ee3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.164998 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf9104-acd6-42ca-82ac-f386ca6ee3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.165484 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf9104-acd6-42ca-82ac-f386ca6ee3a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.166417 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf9104-acd6-42ca-82ac-f386ca6ee3a3 None admin] RBAC: Adding query filter params (role.id=d98d81dd45ce4c4095c99ee0de89aab3, scope.project.id=c02407b0147e4d3e9acde0d88630dd1c, user.id=abc3c7c815664860892bd721aa10133d) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:37.166736 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf9104-acd6-42ca-82ac-f386ca6ee3a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:37.168567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf9104-acd6-42ca-82ac-f386ca6ee3a3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:37.175804 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 106/224] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:23:36 2022] GET /identity/v3/role_assignments?user.id=abc3c7c815664860892bd721aa10133d&scope.project.id=c02407b0147e4d3e9acde0d88630dd1c&role.id=d98d81dd45ce4c4095c99ee0de89aab3 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:37.177099 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca3cb4-992c-4c52-871d-e1fc13c2a66e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.177447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca3cb4-992c-4c52-871d-e1fc13c2a66e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.177729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca3cb4-992c-4c52-871d-e1fc13c2a66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.183965 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe23781-af13-4aa4-9cfe-58094c4be3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:37.184999 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe23781-af13-4aa4-9cfe-58094c4be3bd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.185418 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe23781-af13-4aa4-9cfe-58094c4be3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.185708 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe23781-af13-4aa4-9cfe-58094c4be3bd None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.186853 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe23781-af13-4aa4-9cfe-58094c4be3bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:37.187288 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe23781-af13-4aa4-9cfe-58094c4be3bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:37.188965 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe23781-af13-4aa4-9cfe-58094c4be3bd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:37.196413 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-34ca3cb4-992c-4c52-871d-e1fc13c2a66e None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:37.198442 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-34ca3cb4-992c-4c52-871d-e1fc13c2a66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:37.205930 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 119/225] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:37.212839 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe23781-af13-4aa4-9cfe-58094c4be3bd None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:37.285369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 107/226] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:37.315754 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca3cb4-992c-4c52-871d-e1fc13c2a66e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:37.364466 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:37.445171 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe23781-af13-4aa4-9cfe-58094c4be3bd None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:37.484487 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca3cb4-992c-4c52-871d-e1fc13c2a66e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:37.512655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85b180-6fbe-41d5-a527-5c39ed0e3a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:37.513574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85b180-6fbe-41d5-a527-5c39ed0e3a64 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.513860 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85b180-6fbe-41d5-a527-5c39ed0e3a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.514245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85b180-6fbe-41d5-a527-5c39ed0e3a64 None admin] PATH_INFO: `/v3/users/b4b71afdd1c54eedb77b66fc22762df4` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.515641 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85b180-6fbe-41d5-a527-5c39ed0e3a64 None admin] RBAC: Authorizing `identity:get_user(user_id=b4b71afdd1c54eedb77b66fc22762df4)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:37.518467 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85b180-6fbe-41d5-a527-5c39ed0e3a64 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:37.526029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 120/227] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:37 2022] GET /identity/v3/users/b4b71afdd1c54eedb77b66fc22762df4 => generated 283 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:37.528148 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85b180-6fbe-41d5-a527-5c39ed0e3a64 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:37.530803 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813fbed7-49ff-4da2-9c3e-5f5f9bfc5a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:37.532144 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fbed7-49ff-4da2-9c3e-5f5f9bfc5a8a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.532836 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fbed7-49ff-4da2-9c3e-5f5f9bfc5a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.533283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fbed7-49ff-4da2-9c3e-5f5f9bfc5a8a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.546727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813fbed7-49ff-4da2-9c3e-5f5f9bfc5a8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:37.558631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-813fbed7-49ff-4da2-9c3e-5f5f9bfc5a8a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:37.558631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:37.558631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:37.558631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:37.558631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:37.558631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:37.558631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:37.558631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:37.558631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:37.558631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:37.558631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:37.558631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:37.558631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:37.558631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:37.558631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:37.558631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:37.560491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:37.560491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:37.560491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:37.560491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:37.560491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:37.560491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:37.560491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:37.560491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:37.560491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:37.560491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:37.560491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:37.560491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:37.560491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:37.560491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:37.560491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:37.560491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:37.563082 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:37.563082 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:37.563082 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:37.563082 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:37.563082 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:37.563082 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:37.563082 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:37.563082 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:37.563082 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:37.563082 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:37.563082 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:37.563082 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:37.563082 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 108/228] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:37.570099 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813fbed7-49ff-4da2-9c3e-5f5f9bfc5a8a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:37.622557 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:37.743022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85b180-6fbe-41d5-a527-5c39ed0e3a64 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:37.749076 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:37.773137 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813fbed7-49ff-4da2-9c3e-5f5f9bfc5a8a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:37.827241 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea639e7-bed5-48dc-8788-8a5e61356d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:37.828625 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea639e7-bed5-48dc-8788-8a5e61356d76 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.829105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea639e7-bed5-48dc-8788-8a5e61356d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.829567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea639e7-bed5-48dc-8788-8a5e61356d76 None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.831169 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea639e7-bed5-48dc-8788-8a5e61356d76 None admin] RBAC: Authorizing `identity:get_project(project_id=c02407b0147e4d3e9acde0d88630dd1c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:37.832777 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea639e7-bed5-48dc-8788-8a5e61356d76 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:37.834686 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 121/229] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:37 2022] GET /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:37.842505 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea639e7-bed5-48dc-8788-8a5e61356d76 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:37.860212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07fb09-9066-4698-9f87-fb2b24edce29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:37.861054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07fb09-9066-4698-9f87-fb2b24edce29 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:37.861351 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07fb09-9066-4698-9f87-fb2b24edce29 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:37.861631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07fb09-9066-4698-9f87-fb2b24edce29 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:37.862500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07fb09-9066-4698-9f87-fb2b24edce29 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:37.862820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07fb09-9066-4698-9f87-fb2b24edce29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:37.866902 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07fb09-9066-4698-9f87-fb2b24edce29 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:37.891567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 109/230] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:23:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:37.898516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07fb09-9066-4698-9f87-fb2b24edce29 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:38.040494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea639e7-bed5-48dc-8788-8a5e61356d76 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.070430 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:38.108900 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e9cdc-c3d5-49dd-b362-66617a842e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.109801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e9cdc-c3d5-49dd-b362-66617a842e83 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.110099 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e9cdc-c3d5-49dd-b362-66617a842e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.110960 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e9cdc-c3d5-49dd-b362-66617a842e83 None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c/users/b4b71afdd1c54eedb77b66fc22762df4/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.119584 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e9cdc-c3d5-49dd-b362-66617a842e83 None admin] RBAC: Authorizing `identity:create_grant(project_id=c02407b0147e4d3e9acde0d88630dd1c, user_id=b4b71afdd1c54eedb77b66fc22762df4, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.121083 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94e9cdc-c3d5-49dd-b362-66617a842e83 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.140858 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07fb09-9066-4698-9f87-fb2b24edce29 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.147048 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 122/231] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:23:37 2022] PUT /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c/users/b4b71afdd1c54eedb77b66fc22762df4/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:38.206802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49d05c-5541-4138-9fcc-df107b10a338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.207709 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49d05c-5541-4138-9fcc-df107b10a338 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.207996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49d05c-5541-4138-9fcc-df107b10a338 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.208273 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49d05c-5541-4138-9fcc-df107b10a338 None admin] PATH_INFO: `/v3/users/b4b71afdd1c54eedb77b66fc22762df4` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.211164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49d05c-5541-4138-9fcc-df107b10a338 None admin] RBAC: Authorizing `identity:get_user(user_id=b4b71afdd1c54eedb77b66fc22762df4)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.212705 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49d05c-5541-4138-9fcc-df107b10a338 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.214743 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 110/232] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:37 2022] GET /identity/v3/users/b4b71afdd1c54eedb77b66fc22762df4 => generated 283 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:38.221120 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e9cdc-c3d5-49dd-b362-66617a842e83 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:38.364122 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e9cdc-c3d5-49dd-b362-66617a842e83 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.408676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa2ea3-b4df-4616-af77-e1f333663327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.410151 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa2ea3-b4df-4616-af77-e1f333663327 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.410643 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa2ea3-b4df-4616-af77-e1f333663327 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.411116 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa2ea3-b4df-4616-af77-e1f333663327 None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.412608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa2ea3-b4df-4616-af77-e1f333663327 None admin] RBAC: Authorizing `identity:get_project(project_id=c02407b0147e4d3e9acde0d88630dd1c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.414427 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa2ea3-b4df-4616-af77-e1f333663327 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.416397 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 123/233] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:38 2022] GET /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:38.424119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49d05c-5541-4138-9fcc-df107b10a338 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:38.456659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:38.593934 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49d05c-5541-4138-9fcc-df107b10a338 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:38.646827 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711ead1-74c2-4038-ae26-9106e49ec778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:38.647638 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711ead1-74c2-4038-ae26-9106e49ec778 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.647918 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711ead1-74c2-4038-ae26-9106e49ec778 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.648192 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711ead1-74c2-4038-ae26-9106e49ec778 None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c/users/b4b71afdd1c54eedb77b66fc22762df4/roles/26bfea3cd8164feeb8043fd508a5268c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.652042 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711ead1-74c2-4038-ae26-9106e49ec778 None admin] RBAC: Authorizing `identity:create_grant(project_id=c02407b0147e4d3e9acde0d88630dd1c, user_id=b4b71afdd1c54eedb77b66fc22762df4, role_id=26bfea3cd8164feeb8043fd508a5268c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:38.653543 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711ead1-74c2-4038-ae26-9106e49ec778 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:38.676989 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 111/234] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:23:38 2022] PUT /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c/users/b4b71afdd1c54eedb77b66fc22762df4/roles/26bfea3cd8164feeb8043fd508a5268c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:38.757512 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ca766-5b8c-4703-a6fb-af53d9375920 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.758338 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ca766-5b8c-4703-a6fb-af53d9375920 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.758338 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ca766-5b8c-4703-a6fb-af53d9375920 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.759479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 124/235] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:38.765088 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa1bda-a941-441d-83e6-dc5920eaf512 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:38.765397 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa1bda-a941-441d-83e6-dc5920eaf512 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:38.765656 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa1bda-a941-441d-83e6-dc5920eaf512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:38.785320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a9aa1bda-a941-441d-83e6-dc5920eaf512 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:38.786621 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a9aa1bda-a941-441d-83e6-dc5920eaf512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:38.915616 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 112/236] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:38.949298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ca766-5b8c-4703-a6fb-af53d9375920 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:39.019753 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:39.040776 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5687fa3-c607-43ad-9d41-43e913c87d61 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.041042 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5687fa3-c607-43ad-9d41-43e913c87d61 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.041330 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5687fa3-c607-43ad-9d41-43e913c87d61 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.042968 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 113/237] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:39.049870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efaeaf-cae9-4502-b37e-98b3f17f3046 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.050163 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efaeaf-cae9-4502-b37e-98b3f17f3046 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.050494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efaeaf-cae9-4502-b37e-98b3f17f3046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.076598 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:39.085709 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ca766-5b8c-4703-a6fb-af53d9375920 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:39.091093 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e7efaeaf-cae9-4502-b37e-98b3f17f3046 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:39.092315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e7efaeaf-cae9-4502-b37e-98b3f17f3046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:39.152954 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0fdf4-26a1-4adc-9a3c-e43bdc54cba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:39.153765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0fdf4-26a1-4adc-9a3c-e43bdc54cba8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.154051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0fdf4-26a1-4adc-9a3c-e43bdc54cba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.154358 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0fdf4-26a1-4adc-9a3c-e43bdc54cba8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.183197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0fdf4-26a1-4adc-9a3c-e43bdc54cba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:39.194866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-a1a0fdf4-26a1-4adc-9a3c-e43bdc54cba8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:39.194866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:39.194866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:39.194866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:39.194866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:39.194866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:39.194866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:39.194866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:39.194866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:39.194866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:39.194866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:39.194866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:39.194866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:39.194866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:39.194866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:39.194866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:39.195841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:39.195841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:39.195841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:39.195841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:39.195841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:39.195841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:39.195841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:39.195841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:39.195841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:39.195841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:39.195841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:39.195841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:39.195841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:39.195841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:39.195841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:39.195841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:39.196631 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:39.196631 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:39.196631 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:39.196631 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:39.196631 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:39.196631 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:39.196631 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:39.196631 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:39.196631 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:39.196631 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:39.196631 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:39.196631 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:23:39.200109 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 125/238] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:39.206193 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0fdf4-26a1-4adc-9a3c-e43bdc54cba8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:39.253800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 114/239] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:39.286016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efaeaf-cae9-4502-b37e-98b3f17f3046 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:39.376724 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:39.379923 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0fdf4-26a1-4adc-9a3c-e43bdc54cba8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:39.400780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efaeaf-cae9-4502-b37e-98b3f17f3046 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:39.416983 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c94ee-8887-4375-ad99-632386c41378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:39.417782 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c94ee-8887-4375-ad99-632386c41378 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.417997 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c94ee-8887-4375-ad99-632386c41378 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.418278 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c94ee-8887-4375-ad99-632386c41378 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.419041 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c94ee-8887-4375-ad99-632386c41378 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:39.419355 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c94ee-8887-4375-ad99-632386c41378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:39.420861 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c94ee-8887-4375-ad99-632386c41378 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:39.430630 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 126/240] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:39.436324 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c94ee-8887-4375-ad99-632386c41378 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:39.456642 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf69547-faaf-4aed-a74f-56efacd6c346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:39.460055 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf69547-faaf-4aed-a74f-56efacd6c346 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.460356 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf69547-faaf-4aed-a74f-56efacd6c346 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.460643 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf69547-faaf-4aed-a74f-56efacd6c346 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.473512 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf69547-faaf-4aed-a74f-56efacd6c346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:39.475068 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf69547-faaf-4aed-a74f-56efacd6c346 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:39.477002 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 115/241] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:39.482935 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf69547-faaf-4aed-a74f-56efacd6c346 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:39.491094 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:39.633887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf69547-faaf-4aed-a74f-56efacd6c346 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:39.645285 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c94ee-8887-4375-ad99-632386c41378 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:39.706394 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783baa51-2d59-43a1-90bb-3539a08d1089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:39.707526 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783baa51-2d59-43a1-90bb-3539a08d1089 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.708137 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783baa51-2d59-43a1-90bb-3539a08d1089 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.708601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783baa51-2d59-43a1-90bb-3539a08d1089 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.709511 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783baa51-2d59-43a1-90bb-3539a08d1089 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:39.711633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783baa51-2d59-43a1-90bb-3539a08d1089 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:39.719964 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbb03d-d130-4cae-b5ba-db16384491cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:39.721398 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbb03d-d130-4cae-b5ba-db16384491cc None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.721398 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbb03d-d130-4cae-b5ba-db16384491cc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.721637 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbb03d-d130-4cae-b5ba-db16384491cc None admin] PATH_INFO: `/v3/users/614c02590cdb47a6b87d3cbde131176c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.739547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 116/242] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jul 14 15:23:39 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:39.750053 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbb03d-d130-4cae-b5ba-db16384491cc None admin] RBAC: Authorizing `identity:get_user(user_id=614c02590cdb47a6b87d3cbde131176c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:39.752482 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbb03d-d130-4cae-b5ba-db16384491cc None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:39.755723 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 127/243] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:39 2022] GET /identity/v3/users/614c02590cdb47a6b87d3cbde131176c => generated 297 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:39.763252 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783baa51-2d59-43a1-90bb-3539a08d1089 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:39.831820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:39.879919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783baa51-2d59-43a1-90bb-3539a08d1089 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:39.918558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a406a8-33cf-427b-b4fe-3fff00a64ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:39.919234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a406a8-33cf-427b-b4fe-3fff00a64ddc None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:39.919522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a406a8-33cf-427b-b4fe-3fff00a64ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:39.919807 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a406a8-33cf-427b-b4fe-3fff00a64ddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:39.998714 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a406a8-33cf-427b-b4fe-3fff00a64ddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:40.000227 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a406a8-33cf-427b-b4fe-3fff00a64ddc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:40.063136 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:40.116680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 117/244] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:40.121891 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbb03d-d130-4cae-b5ba-db16384491cc None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:40.149346 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:40.255882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066275b2-3e20-4aae-9119-f31a611eec56 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:40.256265 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066275b2-3e20-4aae-9119-f31a611eec56 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:40.256648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066275b2-3e20-4aae-9119-f31a611eec56 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:40.259513 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbb03d-d130-4cae-b5ba-db16384491cc None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:40.262525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 118/245] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:40.266924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dc95c-c0d2-4a2c-bb98-5cba49e62c62 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:40.267435 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dc95c-c0d2-4a2c-bb98-5cba49e62c62 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:40.268193 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dc95c-c0d2-4a2c-bb98-5cba49e62c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:40.291174 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-063dc95c-c0d2-4a2c-bb98-5cba49e62c62 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:40.292708 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-063dc95c-c0d2-4a2c-bb98-5cba49e62c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:40.312565 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70113a-708e-4198-9b1a-fe616533e2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:40.314265 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70113a-708e-4198-9b1a-fe616533e2fa None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:40.314777 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70113a-708e-4198-9b1a-fe616533e2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:40.315292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70113a-708e-4198-9b1a-fe616533e2fa None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:40.316746 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70113a-708e-4198-9b1a-fe616533e2fa None admin] RBAC: Authorizing `identity:get_project(project_id=c02407b0147e4d3e9acde0d88630dd1c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:40.318474 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70113a-708e-4198-9b1a-fe616533e2fa None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:40.321374 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 128/246] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:40 2022] GET /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:40.329763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70113a-708e-4198-9b1a-fe616533e2fa None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:40.393841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 119/247] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:40.425141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063dc95c-c0d2-4a2c-bb98-5cba49e62c62 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:40.488946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:40.505254 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70113a-708e-4198-9b1a-fe616533e2fa None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:40.559319 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b25ca-ef23-48f2-afaf-945c99411199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:40.559955 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b25ca-ef23-48f2-afaf-945c99411199 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:40.560321 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b25ca-ef23-48f2-afaf-945c99411199 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:40.560607 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b25ca-ef23-48f2-afaf-945c99411199 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:40.561462 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b25ca-ef23-48f2-afaf-945c99411199 None admin] RBAC: Adding query filter params (role.id=df27537eb8b1489a9c3d91773fee26b4, scope.project.id=c02407b0147e4d3e9acde0d88630dd1c, user.id=614c02590cdb47a6b87d3cbde131176c) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:40.561779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b25ca-ef23-48f2-afaf-945c99411199 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:40.564797 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:40.566096 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b25ca-ef23-48f2-afaf-945c99411199 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:40.574165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 129/248] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:23:40 2022] GET /identity/v3/role_assignments?user.id=614c02590cdb47a6b87d3cbde131176c&scope.project.id=c02407b0147e4d3e9acde0d88630dd1c&role.id=df27537eb8b1489a9c3d91773fee26b4 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:40.583462 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063dc95c-c0d2-4a2c-bb98-5cba49e62c62 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:40.628299 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e631f-d8a9-4d0c-a5db-f76d9661969f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:40.629119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e631f-d8a9-4d0c-a5db-f76d9661969f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:40.629403 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e631f-d8a9-4d0c-a5db-f76d9661969f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:40.629774 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e631f-d8a9-4d0c-a5db-f76d9661969f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:40.643535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e631f-d8a9-4d0c-a5db-f76d9661969f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:40.651851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-939e631f-d8a9-4d0c-a5db-f76d9661969f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:40.651851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:40.651851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:40.651851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:40.651851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:40.651851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:40.651851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:40.651851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:40.651851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:40.651851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:40.651851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:40.651851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:40.651851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:40.651851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:40.651851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:40.651851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:40.652926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:40.652926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:40.652926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:40.652926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:40.652926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:40.652926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:40.652926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:40.652926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:40.652926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:40.652926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:40.652926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:40.652926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:40.652926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:40.652926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:40.652926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:40.652926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:40.653732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:40.653732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:40.653732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:40.653732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:40.653732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:40.653732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:40.653732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:40.653732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:40.653732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:40.653732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:40.653732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:40.653732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:40.653732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 120/249] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:40.660333 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b25ca-ef23-48f2-afaf-945c99411199 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:40.811606 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b25ca-ef23-48f2-afaf-945c99411199 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:40.859701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92855a21-65cb-48c8-ba2f-3794002fc061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:40.860405 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92855a21-65cb-48c8-ba2f-3794002fc061 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:40.861418 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92855a21-65cb-48c8-ba2f-3794002fc061 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:40.861418 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92855a21-65cb-48c8-ba2f-3794002fc061 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:40.862206 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92855a21-65cb-48c8-ba2f-3794002fc061 None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:40.862524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92855a21-65cb-48c8-ba2f-3794002fc061 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:40.863953 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92855a21-65cb-48c8-ba2f-3794002fc061 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:40.873768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 130/250] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:40.880392 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92855a21-65cb-48c8-ba2f-3794002fc061 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:40.880908 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d733c6-ec1c-4eea-a66d-902c54e2925d None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:40.881205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d733c6-ec1c-4eea-a66d-902c54e2925d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:40.881483 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d733c6-ec1c-4eea-a66d-902c54e2925d None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:40.882986 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 121/251] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:40.889763 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85513b4b-e007-47ff-bf1e-bad667db7678 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:40.890097 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85513b4b-e007-47ff-bf1e-bad667db7678 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:40.890356 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85513b4b-e007-47ff-bf1e-bad667db7678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:40.902064 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:40.931167 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-85513b4b-e007-47ff-bf1e-bad667db7678 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:40.932399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-85513b4b-e007-47ff-bf1e-bad667db7678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:41.019164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92855a21-65cb-48c8-ba2f-3794002fc061 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:41.059844 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6d5b6-2751-49d5-aa82-f2e2b0543bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:41.061226 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6d5b6-2751-49d5-aa82-f2e2b0543bfd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:41.061752 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6d5b6-2751-49d5-aa82-f2e2b0543bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:41.062155 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6d5b6-2751-49d5-aa82-f2e2b0543bfd None admin] PATH_INFO: `/v3/users/abc3c7c815664860892bd721aa10133d` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:41.064275 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6d5b6-2751-49d5-aa82-f2e2b0543bfd None admin] RBAC: Authorizing `identity:get_user(user_id=abc3c7c815664860892bd721aa10133d)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:41.067038 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6d5b6-2751-49d5-aa82-f2e2b0543bfd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:41.070345 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 131/252] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:40 2022] GET /identity/v3/users/abc3c7c815664860892bd721aa10133d => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:41.077537 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6d5b6-2751-49d5-aa82-f2e2b0543bfd None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:41.152293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 122/253] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:41.190013 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85513b4b-e007-47ff-bf1e-bad667db7678 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:41.219383 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:41.243628 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6d5b6-2751-49d5-aa82-f2e2b0543bfd None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:41.286795 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15f5dd-8d03-4d83-a131-f28e8e59f65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:41.288060 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15f5dd-8d03-4d83-a131-f28e8e59f65f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:41.288583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15f5dd-8d03-4d83-a131-f28e8e59f65f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:41.289070 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15f5dd-8d03-4d83-a131-f28e8e59f65f None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:41.290771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15f5dd-8d03-4d83-a131-f28e8e59f65f None admin] RBAC: Authorizing `identity:get_project(project_id=c02407b0147e4d3e9acde0d88630dd1c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:41.293564 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15f5dd-8d03-4d83-a131-f28e8e59f65f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:41.301348 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 132/254] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:41 2022] GET /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:41.309115 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15f5dd-8d03-4d83-a131-f28e8e59f65f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:41.446484 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:41.507668 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85513b4b-e007-47ff-bf1e-bad667db7678 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:41.549770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3fead-f243-433d-b01c-8feae4e94ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:41.550623 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3fead-f243-433d-b01c-8feae4e94ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:41.550909 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3fead-f243-433d-b01c-8feae4e94ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:41.551185 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3fead-f243-433d-b01c-8feae4e94ff1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:41.564931 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3fead-f243-433d-b01c-8feae4e94ff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:41.574263 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-c9d3fead-f243-433d-b01c-8feae4e94ff1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:41.574263 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:41.574263 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:41.574263 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:41.574263 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:41.574263 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:41.574263 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:41.574263 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:41.574263 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:41.574263 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:41.574263 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:41.574263 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:41.574263 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:41.574263 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:41.574263 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:41.574263 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:41.575225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:41.575225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:41.575225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:41.575225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:41.575225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:41.575225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:41.575225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:41.575225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:41.575225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:41.575225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:41.575225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:41.575225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:41.575225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:41.575225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:41.575225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:41.575225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:41.576016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:41.576016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:41.576016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:41.576016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:41.576016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:41.576016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:41.576016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:41.576016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:41.576016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:41.576016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:41.576016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:41.576016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:41.576016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 123/255] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:23:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:41.583735 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3fead-f243-433d-b01c-8feae4e94ff1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:41.592443 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15f5dd-8d03-4d83-a131-f28e8e59f65f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:41.710118 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86a457-bfbc-4fa3-b25a-cb752086ac39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:41.711224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86a457-bfbc-4fa3-b25a-cb752086ac39 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:41.711510 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86a457-bfbc-4fa3-b25a-cb752086ac39 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:41.711786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86a457-bfbc-4fa3-b25a-cb752086ac39 None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c/users/abc3c7c815664860892bd721aa10133d/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:41.716047 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86a457-bfbc-4fa3-b25a-cb752086ac39 None admin] RBAC: Authorizing `identity:create_grant(project_id=c02407b0147e4d3e9acde0d88630dd1c, user_id=abc3c7c815664860892bd721aa10133d, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:41.717532 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe86a457-bfbc-4fa3-b25a-cb752086ac39 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:41.750683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 133/256] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:23:41 2022] PUT /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c/users/abc3c7c815664860892bd721aa10133d/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:41.766662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f4f2e-82f5-4115-ab0f-1958d1923e4a None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:41.767695 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f4f2e-82f5-4115-ab0f-1958d1923e4a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:41.768181 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f4f2e-82f5-4115-ab0f-1958d1923e4a None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:41.770034 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 134/257] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:41.775796 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac8174-ccef-43a0-86ed-47d85a9f7bf2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:41.776124 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac8174-ccef-43a0-86ed-47d85a9f7bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:41.776479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac8174-ccef-43a0-86ed-47d85a9f7bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:41.811958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e1ac8174-ccef-43a0-86ed-47d85a9f7bf2 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:41.813828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e1ac8174-ccef-43a0-86ed-47d85a9f7bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:41.826539 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:41.852945 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3fead-f243-433d-b01c-8feae4e94ff1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:41.921701 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67ce16-fb9c-44c0-9bdb-aec31e13befe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:41.926653 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67ce16-fb9c-44c0-9bdb-aec31e13befe None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:41.927006 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67ce16-fb9c-44c0-9bdb-aec31e13befe None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:41.927220 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67ce16-fb9c-44c0-9bdb-aec31e13befe None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:41.928546 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67ce16-fb9c-44c0-9bdb-aec31e13befe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:41.928546 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67ce16-fb9c-44c0-9bdb-aec31e13befe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:41.934250 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67ce16-fb9c-44c0-9bdb-aec31e13befe None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:41.944564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 124/258] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:41.950437 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67ce16-fb9c-44c0-9bdb-aec31e13befe None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:41.957675 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 135/259] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:41.959936 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:41.998033 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac8174-ccef-43a0-86ed-47d85a9f7bf2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:42.086018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67ce16-fb9c-44c0-9bdb-aec31e13befe None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:42.140638 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb8650-e663-46bb-aa58-724c3a59448e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:42.141572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb8650-e663-46bb-aa58-724c3a59448e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:42.141957 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb8650-e663-46bb-aa58-724c3a59448e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:42.142357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb8650-e663-46bb-aa58-724c3a59448e None admin] PATH_INFO: `/v3/users/b4b71afdd1c54eedb77b66fc22762df4` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:42.144285 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb8650-e663-46bb-aa58-724c3a59448e None admin] RBAC: Authorizing `identity:get_user(user_id=b4b71afdd1c54eedb77b66fc22762df4)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:42.146453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb8650-e663-46bb-aa58-724c3a59448e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:42.148755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 125/260] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:41 2022] GET /identity/v3/users/b4b71afdd1c54eedb77b66fc22762df4 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:42.154470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb8650-e663-46bb-aa58-724c3a59448e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:42.257447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:42.261374 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac8174-ccef-43a0-86ed-47d85a9f7bf2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:42.325789 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb8650-e663-46bb-aa58-724c3a59448e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:42.342790 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103834e4-2d63-4d70-b57c-22f87ea63eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:42.343624 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103834e4-2d63-4d70-b57c-22f87ea63eec None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:42.343912 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103834e4-2d63-4d70-b57c-22f87ea63eec None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:42.344191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103834e4-2d63-4d70-b57c-22f87ea63eec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:42.361030 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:42.374746 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103834e4-2d63-4d70-b57c-22f87ea63eec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:42.385364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-103834e4-2d63-4d70-b57c-22f87ea63eec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:42.385364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:42.385364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:42.385364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:42.385364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:42.385364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:42.385364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:42.385364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:42.385364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:42.385364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:42.385364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:42.385364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:42.385364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:42.385364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:42.385364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:42.385364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:42.386330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:42.386330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:42.386330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:42.386330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:42.386330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:42.386330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:42.386330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:42.386330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:42.386330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:42.386330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:42.386330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:42.386330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:42.386330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:42.386330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:42.386330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:42.386330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:42.387129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:42.387129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:42.387129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:42.387129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:42.387129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:42.387129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:42.387129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:42.387129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:42.387129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:42.387129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:42.387129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:42.387129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:23:42.391598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 136/261] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:23:42.398535 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103834e4-2d63-4d70-b57c-22f87ea63eec None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:42.408172 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dd566-ec42-40fb-bec6-9cd108001920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:42.408989 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dd566-ec42-40fb-bec6-9cd108001920 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:42.409304 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dd566-ec42-40fb-bec6-9cd108001920 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:42.409586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dd566-ec42-40fb-bec6-9cd108001920 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:42.563539 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047dd566-ec42-40fb-bec6-9cd108001920 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:42.565248 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047dd566-ec42-40fb-bec6-9cd108001920 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:42.592907 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103834e4-2d63-4d70-b57c-22f87ea63eec None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:42.660935 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90025859-66d6-445e-86d1-35fe3c70965c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:42.661630 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90025859-66d6-445e-86d1-35fe3c70965c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:42.661917 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90025859-66d6-445e-86d1-35fe3c70965c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:42.662225 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90025859-66d6-445e-86d1-35fe3c70965c None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:42.662989 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90025859-66d6-445e-86d1-35fe3c70965c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:42.663302 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90025859-66d6-445e-86d1-35fe3c70965c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:42.666537 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90025859-66d6-445e-86d1-35fe3c70965c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:42.680224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 137/262] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:23:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:42.685918 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90025859-66d6-445e-86d1-35fe3c70965c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:42.742486 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:42.788636 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 126/263] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 15:23:42.807608 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dd566-ec42-40fb-bec6-9cd108001920 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:42.834268 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:42.923714 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90025859-66d6-445e-86d1-35fe3c70965c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:43.011870 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9885b-8f25-46a7-8a5d-1f1e02a0b98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:43.013084 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9885b-8f25-46a7-8a5d-1f1e02a0b98c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:43.013520 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9885b-8f25-46a7-8a5d-1f1e02a0b98c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:43.014679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9885b-8f25-46a7-8a5d-1f1e02a0b98c None admin] PATH_INFO: `/v3/users/b4b71afdd1c54eedb77b66fc22762df4` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:43.016311 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9885b-8f25-46a7-8a5d-1f1e02a0b98c None admin] RBAC: Authorizing `identity:get_user(user_id=b4b71afdd1c54eedb77b66fc22762df4)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:43.018570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dd566-ec42-40fb-bec6-9cd108001920 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:43.020671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9885b-8f25-46a7-8a5d-1f1e02a0b98c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:43.025465 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 138/264] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:42 2022] GET /identity/v3/users/b4b71afdd1c54eedb77b66fc22762df4 => generated 283 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:43.035006 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9885b-8f25-46a7-8a5d-1f1e02a0b98c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:43.100329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b6d7e-c1fd-412e-991f-b3b67dc780e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:43.101492 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b6d7e-c1fd-412e-991f-b3b67dc780e6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:43.101933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b6d7e-c1fd-412e-991f-b3b67dc780e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:43.102380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b6d7e-c1fd-412e-991f-b3b67dc780e6 None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:43.104945 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b6d7e-c1fd-412e-991f-b3b67dc780e6 None admin] RBAC: Authorizing `identity:get_project(project_id=c02407b0147e4d3e9acde0d88630dd1c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:43.107733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b6d7e-c1fd-412e-991f-b3b67dc780e6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:43.114096 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 127/265] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:42 2022] GET /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:43.132524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b6d7e-c1fd-412e-991f-b3b67dc780e6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:43.187537 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9885b-8f25-46a7-8a5d-1f1e02a0b98c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:43.198781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:43.221029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:43.229218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81b531-957b-44cb-a2c5-7d916488cb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:43.230403 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81b531-957b-44cb-a2c5-7d916488cb0b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:43.231421 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81b531-957b-44cb-a2c5-7d916488cb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:43.231896 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81b531-957b-44cb-a2c5-7d916488cb0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:43.321397 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81b531-957b-44cb-a2c5-7d916488cb0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:43.324268 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81b531-957b-44cb-a2c5-7d916488cb0b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:43.326341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b6d7e-c1fd-412e-991f-b3b67dc780e6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:43.384399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bac6d-0649-4f97-8e2f-02e4e09adfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:43.385151 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bac6d-0649-4f97-8e2f-02e4e09adfbe None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:43.385546 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bac6d-0649-4f97-8e2f-02e4e09adfbe None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:43.385935 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bac6d-0649-4f97-8e2f-02e4e09adfbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:43.386931 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bac6d-0649-4f97-8e2f-02e4e09adfbe None admin] RBAC: Adding query filter params (role.id=87f040877bfa47bda56305eb022af09e, scope.project.id=c02407b0147e4d3e9acde0d88630dd1c, user.id=b4b71afdd1c54eedb77b66fc22762df4) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:43.387448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bac6d-0649-4f97-8e2f-02e4e09adfbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:43.389116 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bac6d-0649-4f97-8e2f-02e4e09adfbe None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:43.400784 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 128/266] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:23:43 2022] GET /identity/v3/role_assignments?user.id=b4b71afdd1c54eedb77b66fc22762df4&scope.project.id=c02407b0147e4d3e9acde0d88630dd1c&role.id=87f040877bfa47bda56305eb022af09e => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:43.400784 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc4474-a5d9-4d2d-88be-19d3c277c2f1 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:43.400784 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc4474-a5d9-4d2d-88be-19d3c277c2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:43.400784 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc4474-a5d9-4d2d-88be-19d3c277c2f1 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:43.401890 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 129/267] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:43.408496 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1fe23-f521-4e64-abb0-dcafe2c736cf None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:43.409200 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1fe23-f521-4e64-abb0-dcafe2c736cf None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:43.409681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1fe23-f521-4e64-abb0-dcafe2c736cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:43.448925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8aa1fe23-f521-4e64-abb0-dcafe2c736cf None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:43.450880 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8aa1fe23-f521-4e64-abb0-dcafe2c736cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:43.510409 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 139/268] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:43.516474 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81b531-957b-44cb-a2c5-7d916488cb0b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:43.584366 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:43.625941 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 130/269] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:43.666345 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1fe23-f521-4e64-abb0-dcafe2c736cf None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:43.704612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:43.705537 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81b531-957b-44cb-a2c5-7d916488cb0b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:43.752905 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b616e34-9447-4247-9e0c-b2244286ca33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:43.754295 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b616e34-9447-4247-9e0c-b2244286ca33 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:43.754730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b616e34-9447-4247-9e0c-b2244286ca33 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:43.756024 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b616e34-9447-4247-9e0c-b2244286ca33 None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:43.757568 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b616e34-9447-4247-9e0c-b2244286ca33 None admin] RBAC: Authorizing `identity:get_project(project_id=c02407b0147e4d3e9acde0d88630dd1c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:43.759455 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b616e34-9447-4247-9e0c-b2244286ca33 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:43.762245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 140/270] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:43 2022] GET /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:43.768565 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b616e34-9447-4247-9e0c-b2244286ca33 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:43.816614 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1fe23-f521-4e64-abb0-dcafe2c736cf None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:43.878540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9799c801-73df-4aa4-b00d-add530993e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:43.879813 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799c801-73df-4aa4-b00d-add530993e6b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:43.880244 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799c801-73df-4aa4-b00d-add530993e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:43.880671 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9799c801-73df-4aa4-b00d-add530993e6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:43.883441 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799c801-73df-4aa4-b00d-add530993e6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:43.885095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9799c801-73df-4aa4-b00d-add530993e6b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:43.887274 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 131/271] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:43.888758 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb0d96-d56b-4bc0-8ead-77ae42072715 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:43.889199 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb0d96-d56b-4bc0-8ead-77ae42072715 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:43.889618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb0d96-d56b-4bc0-8ead-77ae42072715 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:43.890675 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b616e34-9447-4247-9e0c-b2244286ca33 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:43.892001 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 132/272] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:43.892992 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb0d96-d56b-4bc0-8ead-77ae42072715 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:43.894485 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:43.960335 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fccd3-58e0-433b-b1d6-f2026b307e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:43.961232 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fccd3-58e0-433b-b1d6-f2026b307e94 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:43.961661 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fccd3-58e0-433b-b1d6-f2026b307e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:43.962272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fccd3-58e0-433b-b1d6-f2026b307e94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:43.963253 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fccd3-58e0-433b-b1d6-f2026b307e94 None admin] RBAC: Adding query filter params (role.id=26bfea3cd8164feeb8043fd508a5268c, scope.project.id=c02407b0147e4d3e9acde0d88630dd1c, user.id=b4b71afdd1c54eedb77b66fc22762df4) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:43.963714 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fccd3-58e0-433b-b1d6-f2026b307e94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:43.965430 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fccd3-58e0-433b-b1d6-f2026b307e94 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:43.985959 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 141/273] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:23:43 2022] GET /identity/v3/role_assignments?user.id=b4b71afdd1c54eedb77b66fc22762df4&scope.project.id=c02407b0147e4d3e9acde0d88630dd1c&role.id=26bfea3cd8164feeb8043fd508a5268c => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:43.988590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aff284-8f93-4244-8b5a-74d733b2f49a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:43.989290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aff284-8f93-4244-8b5a-74d733b2f49a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:43.990002 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aff284-8f93-4244-8b5a-74d733b2f49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:44.023644 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-27aff284-8f93-4244-8b5a-74d733b2f49a None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:44.033745 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-27aff284-8f93-4244-8b5a-74d733b2f49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:44.100067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:44.109936 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb0d96-d56b-4bc0-8ead-77ae42072715 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:44.217409 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325bc7a7-e893-4474-bfc1-c7f10882d6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:44.218366 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bc7a7-e893-4474-bfc1-c7f10882d6da None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:44.218804 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bc7a7-e893-4474-bfc1-c7f10882d6da None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:44.219256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325bc7a7-e893-4474-bfc1-c7f10882d6da None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:44.220225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325bc7a7-e893-4474-bfc1-c7f10882d6da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:44.223030 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325bc7a7-e893-4474-bfc1-c7f10882d6da None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:44.255708 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 142/274] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:44.266100 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 133/275] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jul 14 15:23:43 2022] POST /identity/v3/users => generated 293 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:44.290812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aff284-8f93-4244-8b5a-74d733b2f49a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:44.426460 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:44.443359 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aff284-8f93-4244-8b5a-74d733b2f49a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:44.494144 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a227a-9f69-4dd0-887f-f38288d804c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:44.494968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a227a-9f69-4dd0-887f-f38288d804c8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:44.495305 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a227a-9f69-4dd0-887f-f38288d804c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:44.495591 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a227a-9f69-4dd0-887f-f38288d804c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:44.511645 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a227a-9f69-4dd0-887f-f38288d804c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:44.513828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb11483-a89a-4d4d-9a8c-2cf59dc23ffe None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:44.514396 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb11483-a89a-4d4d-9a8c-2cf59dc23ffe None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:44.514940 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb11483-a89a-4d4d-9a8c-2cf59dc23ffe None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:44.516565 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 134/276] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:44.520046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-b26a227a-9f69-4dd0-887f-f38288d804c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:44.520046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:44.520046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:44.520046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:44.520046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:44.520046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:44.520046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:44.520046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:44.520046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:44.520046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:44.520046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:44.520046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:44.520046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:44.520046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:44.520046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:44.520046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:44.521007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:44.521007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:44.521007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:44.521007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:44.521007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:44.521007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:44.521007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:44.521007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:44.521007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:44.521007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:44.521007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:44.521007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:44.521007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:44.521007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:44.521007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:44.521007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:44.522380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:44.522380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:44.522380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:44.522380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:44.522380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:44.522380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:44.522380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:44.522380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:44.522380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:44.522380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:44.522380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:44.522380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:23:44.522380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 143/277] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:23:44.528332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb11483-a89a-4d4d-9a8c-2cf59dc23ffe None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:44.529308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad7518-b22a-46ba-ac09-88ea8a9d972d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:44.529598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad7518-b22a-46ba-ac09-88ea8a9d972d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:44.529870 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad7518-b22a-46ba-ac09-88ea8a9d972d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:44.552652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-95ad7518-b22a-46ba-ac09-88ea8a9d972d None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:44.553876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-95ad7518-b22a-46ba-ac09-88ea8a9d972d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:44.652374 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 144/278] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:44.680555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad7518-b22a-46ba-ac09-88ea8a9d972d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:44.698450 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb11483-a89a-4d4d-9a8c-2cf59dc23ffe None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:44.744512 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513d8ca-716d-400b-b260-239c7fd74cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:44.745141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513d8ca-716d-400b-b260-239c7fd74cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:44.745414 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513d8ca-716d-400b-b260-239c7fd74cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:44.745694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513d8ca-716d-400b-b260-239c7fd74cb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:44.746710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513d8ca-716d-400b-b260-239c7fd74cb5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:44.746877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513d8ca-716d-400b-b260-239c7fd74cb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:44.749603 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513d8ca-716d-400b-b260-239c7fd74cb5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:44.760741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 135/279] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:44.772203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513d8ca-716d-400b-b260-239c7fd74cb5 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:44.808821 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:44.816598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:44.851416 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad7518-b22a-46ba-ac09-88ea8a9d972d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:44.921787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56144c-fcc5-4648-a641-1ba7381c675d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:44.924531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56144c-fcc5-4648-a641-1ba7381c675d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:44.925028 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56144c-fcc5-4648-a641-1ba7381c675d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:44.925488 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56144c-fcc5-4648-a641-1ba7381c675d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:44.941213 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56144c-fcc5-4648-a641-1ba7381c675d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:44.952649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-0b56144c-fcc5-4648-a641-1ba7381c675d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:44.952649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:44.952649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:44.952649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:44.952649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:44.952649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:44.952649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:44.952649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:44.952649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:44.952649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:44.952649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:44.952649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:44.952649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:44.952649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:44.952649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:44.952649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:44.953768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:44.953768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:44.953768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:44.953768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:44.953768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:44.953768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:44.953768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:44.953768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:44.953768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:44.953768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:44.953768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:44.953768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:44.953768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:44.953768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:44.953768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:44.953768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:44.955334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:44.955334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:44.955334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:44.955334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:44.955334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:44.955334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:44.955334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:44.955334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:44.955334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:44.955334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:44.955334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:44.955334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:23:44.956936 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 145/280] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:23:44.965277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56144c-fcc5-4648-a641-1ba7381c675d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:44.988919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513d8ca-716d-400b-b260-239c7fd74cb5 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:45.100736 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56144c-fcc5-4648-a641-1ba7381c675d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:45.146712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bce929-382a-49c5-b388-b6da27d03e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:45.148696 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bce929-382a-49c5-b388-b6da27d03e22 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:45.148696 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bce929-382a-49c5-b388-b6da27d03e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:45.148696 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bce929-382a-49c5-b388-b6da27d03e22 None admin] PATH_INFO: `/v3/users/614c02590cdb47a6b87d3cbde131176c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:45.161043 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bce929-382a-49c5-b388-b6da27d03e22 None admin] RBAC: Authorizing `identity:get_user(user_id=614c02590cdb47a6b87d3cbde131176c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:45.161043 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bce929-382a-49c5-b388-b6da27d03e22 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:45.161424 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 136/281] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:44 2022] GET /identity/v3/users/614c02590cdb47a6b87d3cbde131176c => generated 297 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:45.163372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652a355-1a16-482e-80c1-8dd4c4ca91df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:45.164839 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652a355-1a16-482e-80c1-8dd4c4ca91df None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:45.165393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652a355-1a16-482e-80c1-8dd4c4ca91df None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:45.165894 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652a355-1a16-482e-80c1-8dd4c4ca91df None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:45.167695 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652a355-1a16-482e-80c1-8dd4c4ca91df None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:45.168340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652a355-1a16-482e-80c1-8dd4c4ca91df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:45.170537 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652a355-1a16-482e-80c1-8dd4c4ca91df None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:45.171169 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bce929-382a-49c5-b388-b6da27d03e22 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:45.183362 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 146/282] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:45.190470 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652a355-1a16-482e-80c1-8dd4c4ca91df None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:45.198506 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:45.361918 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:45.379850 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652a355-1a16-482e-80c1-8dd4c4ca91df None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:45.381678 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bce929-382a-49c5-b388-b6da27d03e22 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:45.426645 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3962c-81ee-4a86-8714-58187606e40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:45.427794 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3962c-81ee-4a86-8714-58187606e40d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:45.428187 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3962c-81ee-4a86-8714-58187606e40d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:45.428576 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3962c-81ee-4a86-8714-58187606e40d None admin] PATH_INFO: `/v3/users/08ee117a6f8547d5b082bae9210cbec6` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:45.445417 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3962c-81ee-4a86-8714-58187606e40d None admin] RBAC: Authorizing `identity:get_user(user_id=08ee117a6f8547d5b082bae9210cbec6)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:45.447180 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3962c-81ee-4a86-8714-58187606e40d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:45.448174 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0d760-05d1-4f7d-baaa-2b649ba283b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:45.453947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 147/283] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:45 2022] GET /identity/v3/users/08ee117a6f8547d5b082bae9210cbec6 => generated 293 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:45.453947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2a59c-0ba1-40b7-8d01-79ad893136f1 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:45.453947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2a59c-0ba1-40b7-8d01-79ad893136f1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:45.453947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2a59c-0ba1-40b7-8d01-79ad893136f1 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:45.453947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 148/284] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:45.455769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0d760-05d1-4f7d-baaa-2b649ba283b1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:45.456205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0d760-05d1-4f7d-baaa-2b649ba283b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:45.456608 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0d760-05d1-4f7d-baaa-2b649ba283b1 None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:45.458316 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0d760-05d1-4f7d-baaa-2b649ba283b1 None admin] RBAC: Authorizing `identity:get_project(project_id=c02407b0147e4d3e9acde0d88630dd1c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:45.459383 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04165c31-8842-4769-913a-1fa89608ee7a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:45.459782 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04165c31-8842-4769-913a-1fa89608ee7a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:45.460174 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04165c31-8842-4769-913a-1fa89608ee7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:45.460456 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0d760-05d1-4f7d-baaa-2b649ba283b1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:45.462457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 137/285] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:45 2022] GET /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:45.463363 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0d760-05d1-4f7d-baaa-2b649ba283b1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:45.483279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-04165c31-8842-4769-913a-1fa89608ee7a None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:45.484672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-04165c31-8842-4769-913a-1fa89608ee7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:45.554160 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:45.582707 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 149/286] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:45.583790 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04165c31-8842-4769-913a-1fa89608ee7a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:45.607893 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0d760-05d1-4f7d-baaa-2b649ba283b1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:45.664184 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f631ec3-8992-40db-8ecd-983b0892a7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:45.665031 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f631ec3-8992-40db-8ecd-983b0892a7cc None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:45.666030 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f631ec3-8992-40db-8ecd-983b0892a7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:45.666555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f631ec3-8992-40db-8ecd-983b0892a7cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:45.667615 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f631ec3-8992-40db-8ecd-983b0892a7cc None admin] RBAC: Adding query filter params (role.id=d98d81dd45ce4c4095c99ee0de89aab3, user.id=08ee117a6f8547d5b082bae9210cbec6, scope.system=all) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:45.668188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f631ec3-8992-40db-8ecd-983b0892a7cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:45.670001 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f631ec3-8992-40db-8ecd-983b0892a7cc None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:45.680043 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 138/287] 10.222.0.39 () {56 vars in 1308 bytes} [Thu Jul 14 15:23:45 2022] GET /identity/v3/role_assignments?user.id=08ee117a6f8547d5b082bae9210cbec6&scope.system=all&role.id=d98d81dd45ce4c4095c99ee0de89aab3 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:45.681654 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f631ec3-8992-40db-8ecd-983b0892a7cc None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:45.722721 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:45.783217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04165c31-8842-4769-913a-1fa89608ee7a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:45.836347 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f631ec3-8992-40db-8ecd-983b0892a7cc None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:45.870111 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f499fb-1155-46d0-aeb7-a6d96dc36608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:45.871255 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f499fb-1155-46d0-aeb7-a6d96dc36608 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:45.871547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f499fb-1155-46d0-aeb7-a6d96dc36608 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:45.871831 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f499fb-1155-46d0-aeb7-a6d96dc36608 None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c/users/614c02590cdb47a6b87d3cbde131176c/roles/df27537eb8b1489a9c3d91773fee26b4` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:45.876852 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f499fb-1155-46d0-aeb7-a6d96dc36608 None admin] RBAC: Authorizing `identity:create_grant(project_id=c02407b0147e4d3e9acde0d88630dd1c, user_id=614c02590cdb47a6b87d3cbde131176c, role_id=df27537eb8b1489a9c3d91773fee26b4)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:45.882653 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f499fb-1155-46d0-aeb7-a6d96dc36608 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:45.883717 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2f927-c272-4a70-aaf6-1e3707e43e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:45.884783 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2f927-c272-4a70-aaf6-1e3707e43e1c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:45.885312 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2f927-c272-4a70-aaf6-1e3707e43e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:45.885832 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2f927-c272-4a70-aaf6-1e3707e43e1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:45.912374 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 150/288] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:23:45 2022] PUT /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c/users/614c02590cdb47a6b87d3cbde131176c/roles/df27537eb8b1489a9c3d91773fee26b4 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:45.920795 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2f927-c272-4a70-aaf6-1e3707e43e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:45.929913 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-44f2f927-c272-4a70-aaf6-1e3707e43e1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:45.929913 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:45.929913 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:45.929913 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:45.929913 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:45.929913 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:45.929913 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:45.929913 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:45.929913 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:45.929913 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:45.929913 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:45.929913 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:45.929913 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:45.929913 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:45.929913 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:45.929913 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:45.930932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:45.930932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:45.930932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:45.930932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:45.930932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:45.930932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:45.930932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:45.930932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:45.930932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:45.930932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:45.930932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:45.930932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:45.930932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:45.930932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:45.930932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:45.930932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:45.931728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:45.931728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:45.931728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:45.931728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:45.931728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:45.931728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:45.931728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:45.931728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:45.931728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:45.931728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:45.931728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:45.931728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:45.931728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 139/289] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:45.940328 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f499fb-1155-46d0-aeb7-a6d96dc36608 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:46.011663 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:46.073359 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f499fb-1155-46d0-aeb7-a6d96dc36608 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:46.120121 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72a84c-5c4a-4148-a9a5-7bedd9df21fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:46.121251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72a84c-5c4a-4148-a9a5-7bedd9df21fc None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:46.121775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72a84c-5c4a-4148-a9a5-7bedd9df21fc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:46.122308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72a84c-5c4a-4148-a9a5-7bedd9df21fc None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:46.123301 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72a84c-5c4a-4148-a9a5-7bedd9df21fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:46.123853 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72a84c-5c4a-4148-a9a5-7bedd9df21fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:46.125574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72a84c-5c4a-4148-a9a5-7bedd9df21fc None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:46.142118 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 151/290] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:46.142961 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2f927-c272-4a70-aaf6-1e3707e43e1c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:46.255303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:46.293904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2f927-c272-4a70-aaf6-1e3707e43e1c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:46.341791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123dbd0-6311-438d-a671-4c5328a1e340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:46.342764 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123dbd0-6311-438d-a671-4c5328a1e340 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:46.343056 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123dbd0-6311-438d-a671-4c5328a1e340 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:46.343334 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123dbd0-6311-438d-a671-4c5328a1e340 None admin] PATH_INFO: `/v3/users/abc3c7c815664860892bd721aa10133d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:46.345210 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123dbd0-6311-438d-a671-4c5328a1e340 None admin] RBAC: Authorizing `identity:get_user(user_id=abc3c7c815664860892bd721aa10133d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:46.347750 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123dbd0-6311-438d-a671-4c5328a1e340 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:46.351118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 140/291] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:46 2022] GET /identity/v3/users/abc3c7c815664860892bd721aa10133d => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:46.357415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72a84c-5c4a-4148-a9a5-7bedd9df21fc None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:46.470921 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72a84c-5c4a-4148-a9a5-7bedd9df21fc None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:46.495642 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:46.513193 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a1913-5b1c-4fba-9456-b75cb702bcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:46.513839 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a1913-5b1c-4fba-9456-b75cb702bcfc None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:46.514212 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a1913-5b1c-4fba-9456-b75cb702bcfc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:46.514494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a1913-5b1c-4fba-9456-b75cb702bcfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:46.603086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a1913-5b1c-4fba-9456-b75cb702bcfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:46.605835 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a1913-5b1c-4fba-9456-b75cb702bcfc None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:46.725535 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 152/292] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:46.731775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123dbd0-6311-438d-a671-4c5328a1e340 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:46.856119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123dbd0-6311-438d-a671-4c5328a1e340 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:46.903328 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973d6ec-cdea-42d0-a27d-d431817afc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:46.904684 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973d6ec-cdea-42d0-a27d-d431817afc1b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:46.905186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973d6ec-cdea-42d0-a27d-d431817afc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:46.905676 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973d6ec-cdea-42d0-a27d-d431817afc1b None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:46.907206 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973d6ec-cdea-42d0-a27d-d431817afc1b None admin] RBAC: Authorizing `identity:get_project(project_id=c02407b0147e4d3e9acde0d88630dd1c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:46.909911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973d6ec-cdea-42d0-a27d-d431817afc1b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:46.912297 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 141/293] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:46 2022] GET /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:46.918334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a1913-5b1c-4fba-9456-b75cb702bcfc None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:46.958596 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:47.125108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a1913-5b1c-4fba-9456-b75cb702bcfc None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:47.179691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3feb906-1409-4dae-abe4-b66e743b0e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:47.180375 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3feb906-1409-4dae-abe4-b66e743b0e2b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.180659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3feb906-1409-4dae-abe4-b66e743b0e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.180937 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3feb906-1409-4dae-abe4-b66e743b0e2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.181787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3feb906-1409-4dae-abe4-b66e743b0e2b None admin] RBAC: Adding query filter params (role.id=d98d81dd45ce4c4095c99ee0de89aab3, scope.project.id=c02407b0147e4d3e9acde0d88630dd1c, user.id=abc3c7c815664860892bd721aa10133d) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:47.182120 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3feb906-1409-4dae-abe4-b66e743b0e2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:47.183618 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3feb906-1409-4dae-abe4-b66e743b0e2b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:47.190663 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 153/294] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:23:46 2022] GET /identity/v3/role_assignments?user.id=abc3c7c815664860892bd721aa10133d&scope.project.id=c02407b0147e4d3e9acde0d88630dd1c&role.id=d98d81dd45ce4c4095c99ee0de89aab3 => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:47.503775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f9562-925b-478c-8cbf-e25d88f92e9e None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.504348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f9562-925b-478c-8cbf-e25d88f92e9e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.504348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f9562-925b-478c-8cbf-e25d88f92e9e None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.506006 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 142/295] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:47.511725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e8806-5b00-4411-aabd-af46b59e516b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.512227 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e8806-5b00-4411-aabd-af46b59e516b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.512328 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e8806-5b00-4411-aabd-af46b59e516b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.537326 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ba3e8806-5b00-4411-aabd-af46b59e516b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:47.538581 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ba3e8806-5b00-4411-aabd-af46b59e516b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:47.587111 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4ff02-58b9-436d-a8ec-813a65b6ae04 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.587378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4ff02-58b9-436d-a8ec-813a65b6ae04 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.587706 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4ff02-58b9-436d-a8ec-813a65b6ae04 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.589049 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 143/296] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:47.596972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f6442-7ac5-43a9-92f2-73c3249ec791 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.597269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f6442-7ac5-43a9-92f2-73c3249ec791 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.597557 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f6442-7ac5-43a9-92f2-73c3249ec791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.631839 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2a1f6442-7ac5-43a9-92f2-73c3249ec791 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:47.633069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2a1f6442-7ac5-43a9-92f2-73c3249ec791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:47.638252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 154/297] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:47.661167 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:47.690975 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e8806-5b00-4411-aabd-af46b59e516b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:47.708036 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:47.744128 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 144/298] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:47.785751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f6442-7ac5-43a9-92f2-73c3249ec791 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:47.848496 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e8806-5b00-4411-aabd-af46b59e516b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:47.891627 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de5cba-821e-4dd9-90a2-e867865993e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:47.893700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de5cba-821e-4dd9-90a2-e867865993e7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.894395 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de5cba-821e-4dd9-90a2-e867865993e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.895133 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de5cba-821e-4dd9-90a2-e867865993e7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.916764 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de5cba-821e-4dd9-90a2-e867865993e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:47.925887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-f5de5cba-821e-4dd9-90a2-e867865993e7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:47.925887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:47.925887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:47.925887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:47.925887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:47.925887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:47.925887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:47.925887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:47.925887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:47.925887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:47.925887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:47.925887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:47.925887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:47.925887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:47.925887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:47.925887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:47.927682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:47.927682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:47.927682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:47.927682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:47.927682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:47.927682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:47.927682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:47.927682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:47.927682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:47.927682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:47.927682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:47.927682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:47.927682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:47.927682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:47.927682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:47.927682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:47.929284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:47.929284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:47.929284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:47.929284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:47.929284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:47.929284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:47.929284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:47.929284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:47.929284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:47.929284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:47.929284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:47.929284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:23:47.931897 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 155/299] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:47.933179 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de5cba-821e-4dd9-90a2-e867865993e7 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:47.934794 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f6442-7ac5-43a9-92f2-73c3249ec791 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:47.988235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50f57e-0945-496a-b0d9-b16a9f517804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:47.990177 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50f57e-0945-496a-b0d9-b16a9f517804 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:47.990972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50f57e-0945-496a-b0d9-b16a9f517804 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:47.992129 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50f57e-0945-496a-b0d9-b16a9f517804 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:47.994467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50f57e-0945-496a-b0d9-b16a9f517804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:47.996901 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50f57e-0945-496a-b0d9-b16a9f517804 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:47.999714 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 145/300] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:48.006170 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50f57e-0945-496a-b0d9-b16a9f517804 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:48.019178 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:48.027433 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:48.068754 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de5cba-821e-4dd9-90a2-e867865993e7 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:48.108836 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19798e7f-f96d-448a-be5f-ece1a2451301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:48.109841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19798e7f-f96d-448a-be5f-ece1a2451301 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:48.109954 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19798e7f-f96d-448a-be5f-ece1a2451301 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:48.110224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19798e7f-f96d-448a-be5f-ece1a2451301 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:48.111339 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19798e7f-f96d-448a-be5f-ece1a2451301 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:48.111663 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19798e7f-f96d-448a-be5f-ece1a2451301 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:48.113262 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19798e7f-f96d-448a-be5f-ece1a2451301 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:48.123879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 156/301] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:48.130810 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19798e7f-f96d-448a-be5f-ece1a2451301 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:48.140645 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50f57e-0945-496a-b0d9-b16a9f517804 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:48.189962 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1b444-e243-4db4-94ff-7b0b47b894ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:48.191049 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1b444-e243-4db4-94ff-7b0b47b894ad None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:48.191541 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1b444-e243-4db4-94ff-7b0b47b894ad None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:48.192048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1b444-e243-4db4-94ff-7b0b47b894ad None admin] PATH_INFO: `/v3/groups` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:48.192948 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1b444-e243-4db4-94ff-7b0b47b894ad None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:48.195136 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1b444-e243-4db4-94ff-7b0b47b894ad None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:48.216091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 146/302] 10.222.0.39 () {60 vars in 1134 bytes} [Thu Jul 14 15:23:48 2022] POST /identity/v3/groups => generated 229 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:23:48.274485 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19798e7f-f96d-448a-be5f-ece1a2451301 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:48.312829 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:48.320714 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc708b20-3adb-42f4-a31a-b5ffbedea77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:48.322007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc708b20-3adb-42f4-a31a-b5ffbedea77e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:48.322778 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc708b20-3adb-42f4-a31a-b5ffbedea77e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:48.323266 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc708b20-3adb-42f4-a31a-b5ffbedea77e None admin] PATH_INFO: `/v3/users/f26ed1bbc8d84b54bb520ed638638375` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:48.341094 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc708b20-3adb-42f4-a31a-b5ffbedea77e None admin] RBAC: Authorizing `identity:get_user(user_id=f26ed1bbc8d84b54bb520ed638638375)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:48.343098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc708b20-3adb-42f4-a31a-b5ffbedea77e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:48.346193 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 157/303] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:48 2022] GET /identity/v3/users/f26ed1bbc8d84b54bb520ed638638375 => generated 293 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:48.355339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1b444-e243-4db4-94ff-7b0b47b894ad None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:48.373317 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c57493-480a-4662-8b15-64a07b23a032 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:48.373604 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c57493-480a-4662-8b15-64a07b23a032 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:48.373944 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c57493-480a-4662-8b15-64a07b23a032 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:48.375947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 158/304] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:23:48.389775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bdd20-0cf2-435a-a544-ad42d603bf6d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:48.390136 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bdd20-0cf2-435a-a544-ad42d603bf6d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:48.390375 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bdd20-0cf2-435a-a544-ad42d603bf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:48.418509 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c89bdd20-0cf2-435a-a544-ad42d603bf6d None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:48.421206 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c89bdd20-0cf2-435a-a544-ad42d603bf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:48.479003 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:48.524111 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1b444-e243-4db4-94ff-7b0b47b894ad None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:48.536391 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 159/305] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:48.563259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bdd20-0cf2-435a-a544-ad42d603bf6d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:48.568979 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ef4fe-721b-4f12-b6d6-502f68cdffab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:48.569654 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ef4fe-721b-4f12-b6d6-502f68cdffab None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:48.569936 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ef4fe-721b-4f12-b6d6-502f68cdffab None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:48.570246 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ef4fe-721b-4f12-b6d6-502f68cdffab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:48.571096 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ef4fe-721b-4f12-b6d6-502f68cdffab None admin] RBAC: Adding query filter params (role.id=df27537eb8b1489a9c3d91773fee26b4, user.id=f26ed1bbc8d84b54bb520ed638638375, scope.system=all) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:48.571412 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ef4fe-721b-4f12-b6d6-502f68cdffab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:48.572913 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ef4fe-721b-4f12-b6d6-502f68cdffab None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:48.586102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 147/306] 10.222.0.39 () {56 vars in 1308 bytes} [Thu Jul 14 15:23:48 2022] GET /identity/v3/role_assignments?user.id=f26ed1bbc8d84b54bb520ed638638375&scope.system=all&role.id=df27537eb8b1489a9c3d91773fee26b4 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:48.701035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bdd20-0cf2-435a-a544-ad42d603bf6d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:48.724214 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:48.744642 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd888f2-d04c-4b4b-bd42-13efb79005cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:48.745465 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd888f2-d04c-4b4b-bd42-13efb79005cf None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:48.745749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd888f2-d04c-4b4b-bd42-13efb79005cf None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:48.746026 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd888f2-d04c-4b4b-bd42-13efb79005cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:48.762757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd888f2-d04c-4b4b-bd42-13efb79005cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:48.771769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-6fd888f2-d04c-4b4b-bd42-13efb79005cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:48.771769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:48.771769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:48.771769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:48.771769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:48.771769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:48.771769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:48.771769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:48.771769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:48.771769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:48.771769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:48.771769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:48.771769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:48.771769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:48.771769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:48.771769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:48.772732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:48.772732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:48.772732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:48.772732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:48.772732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:48.772732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:48.772732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:48.772732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:48.772732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:48.772732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:48.772732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:48.772732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:48.772732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:48.772732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:48.772732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:48.772732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:48.774412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:48.774412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:48.774412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:48.774412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:48.774412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:48.774412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:48.774412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:48.774412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:48.774412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:48.774412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:48.774412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:48.774412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:23:48.774412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 160/307] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:23:48.775696 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f5098-375f-40d1-9352-5ba797f05d3a None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:48.775982 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f5098-375f-40d1-9352-5ba797f05d3a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:48.776260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f5098-375f-40d1-9352-5ba797f05d3a None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:48.777622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 148/308] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:48.781297 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd888f2-d04c-4b4b-bd42-13efb79005cf None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:48.784272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c3690-7cff-4808-93c9-b17622a786f1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:48.784557 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c3690-7cff-4808-93c9-b17622a786f1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:48.784893 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c3690-7cff-4808-93c9-b17622a786f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:48.846451 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-df6c3690-7cff-4808-93c9-b17622a786f1 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:48.847720 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-df6c3690-7cff-4808-93c9-b17622a786f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:48.924703 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd888f2-d04c-4b4b-bd42-13efb79005cf None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:48.924950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 149/309] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:48.963308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2432ee-9f8b-4c01-acbe-405a6d4f9049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:48.963546 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c3690-7cff-4808-93c9-b17622a786f1 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:48.963994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2432ee-9f8b-4c01-acbe-405a6d4f9049 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:48.964278 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2432ee-9f8b-4c01-acbe-405a6d4f9049 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:48.964552 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2432ee-9f8b-4c01-acbe-405a6d4f9049 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:48.965310 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2432ee-9f8b-4c01-acbe-405a6d4f9049 None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:48.965616 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2432ee-9f8b-4c01-acbe-405a6d4f9049 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:48.967330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2432ee-9f8b-4c01-acbe-405a6d4f9049 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:48.982212 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 161/310] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:48.985622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2432ee-9f8b-4c01-acbe-405a6d4f9049 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:49.053019 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:49.062636 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:49.100136 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c3690-7cff-4808-93c9-b17622a786f1 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:49.157968 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bd6dd-100d-489a-95a0-2f3db4ea0ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:49.159711 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bd6dd-100d-489a-95a0-2f3db4ea0ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:49.160280 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bd6dd-100d-489a-95a0-2f3db4ea0ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:49.160719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bd6dd-100d-489a-95a0-2f3db4ea0ba2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:49.168304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2432ee-9f8b-4c01-acbe-405a6d4f9049 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:49.176766 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bd6dd-100d-489a-95a0-2f3db4ea0ba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:49.186597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-e34bd6dd-100d-489a-95a0-2f3db4ea0ba2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:49.186597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:49.186597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:49.186597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:49.186597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:49.186597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:49.186597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:49.186597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:49.186597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:49.186597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:49.186597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:49.186597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:49.186597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:49.186597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:49.186597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:49.186597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:49.187798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:49.187798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:49.187798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:49.187798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:49.187798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:49.187798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:49.187798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:49.187798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:49.187798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:49.187798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:49.187798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:49.187798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:49.187798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:49.187798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:49.187798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:49.187798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:49.188977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:49.188977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:49.188977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:49.188977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:49.188977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:49.188977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:49.188977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:49.188977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:49.188977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:49.188977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:49.188977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:49.188977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:49.192910 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 150/311] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:49.194519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bd6dd-100d-489a-95a0-2f3db4ea0ba2 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:49.218623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b784d3-def3-464c-9534-5faced8cf3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:49.219836 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b784d3-def3-464c-9534-5faced8cf3bb None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:49.220614 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b784d3-def3-464c-9534-5faced8cf3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:49.221161 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b784d3-def3-464c-9534-5faced8cf3bb None admin] PATH_INFO: `/v3/users/08ee117a6f8547d5b082bae9210cbec6` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:49.223663 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b784d3-def3-464c-9534-5faced8cf3bb None admin] RBAC: Authorizing `identity:get_user(user_id=08ee117a6f8547d5b082bae9210cbec6)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:49.225730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b784d3-def3-464c-9534-5faced8cf3bb None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:49.233716 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 162/312] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:48 2022] GET /identity/v3/users/08ee117a6f8547d5b082bae9210cbec6 => generated 293 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:49.236031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b784d3-def3-464c-9534-5faced8cf3bb None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:49.336405 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bd6dd-100d-489a-95a0-2f3db4ea0ba2 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:49.373277 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:49.379956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b784d3-def3-464c-9534-5faced8cf3bb None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:49.386059 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e2369-794a-4b81-ac0a-aa108091abe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:49.387029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e2369-794a-4b81-ac0a-aa108091abe0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:49.387468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e2369-794a-4b81-ac0a-aa108091abe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:49.387902 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e2369-794a-4b81-ac0a-aa108091abe0 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:49.388824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e2369-794a-4b81-ac0a-aa108091abe0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:49.389290 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e2369-794a-4b81-ac0a-aa108091abe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:49.391420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e2369-794a-4b81-ac0a-aa108091abe0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:49.392818 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:49.406910 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 151/313] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:49.412892 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e2369-794a-4b81-ac0a-aa108091abe0 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:49.440360 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bafc63-de7e-45e9-91da-8b96b9ea4868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:49.441311 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bafc63-de7e-45e9-91da-8b96b9ea4868 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:49.441599 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bafc63-de7e-45e9-91da-8b96b9ea4868 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:49.441878 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bafc63-de7e-45e9-91da-8b96b9ea4868 None admin] PATH_INFO: `/v3/system/users/08ee117a6f8547d5b082bae9210cbec6/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:49.443454 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bafc63-de7e-45e9-91da-8b96b9ea4868 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=08ee117a6f8547d5b082bae9210cbec6, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:49.445068 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bafc63-de7e-45e9-91da-8b96b9ea4868 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:49.466103 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 163/314] 10.222.0.39 () {58 vars in 1334 bytes} [Thu Jul 14 15:23:49 2022] PUT /identity/v3/system/users/08ee117a6f8547d5b082bae9210cbec6/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:23:49.559759 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e2369-794a-4b81-ac0a-aa108091abe0 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:49.601977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba2fe9-0055-4db9-ad36-8854bb65b432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:49.602920 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2fe9-0055-4db9-ad36-8854bb65b432 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:49.603200 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2fe9-0055-4db9-ad36-8854bb65b432 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:49.603474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba2fe9-0055-4db9-ad36-8854bb65b432 None admin] PATH_INFO: `/v3/users/614c02590cdb47a6b87d3cbde131176c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:49.604781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba2fe9-0055-4db9-ad36-8854bb65b432 None admin] RBAC: Authorizing `identity:get_user(user_id=614c02590cdb47a6b87d3cbde131176c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:49.606381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba2fe9-0055-4db9-ad36-8854bb65b432 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:49.608563 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 152/315] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:49 2022] GET /identity/v3/users/614c02590cdb47a6b87d3cbde131176c => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:49.614618 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bafc63-de7e-45e9-91da-8b96b9ea4868 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:49.738767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bafc63-de7e-45e9-91da-8b96b9ea4868 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:49.777478 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aedccc-dd1a-49d8-9b1e-6dd208bbf9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:49.778589 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aedccc-dd1a-49d8-9b1e-6dd208bbf9eb None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:49.778871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aedccc-dd1a-49d8-9b1e-6dd208bbf9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:49.779151 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aedccc-dd1a-49d8-9b1e-6dd208bbf9eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:49.838476 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:49.869284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aedccc-dd1a-49d8-9b1e-6dd208bbf9eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:49.870986 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aedccc-dd1a-49d8-9b1e-6dd208bbf9eb None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:49.994487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 164/316] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:50.000401 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba2fe9-0055-4db9-ad36-8854bb65b432 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:50.071211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:50.129695 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba2fe9-0055-4db9-ad36-8854bb65b432 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:50.167968 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9f5dc-9a44-4e2d-8958-8ae4c304a07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:50.169236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9f5dc-9a44-4e2d-8958-8ae4c304a07f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:50.169738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9f5dc-9a44-4e2d-8958-8ae4c304a07f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:50.170314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9f5dc-9a44-4e2d-8958-8ae4c304a07f None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:50.171745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9f5dc-9a44-4e2d-8958-8ae4c304a07f None admin] RBAC: Authorizing `identity:get_project(project_id=c02407b0147e4d3e9acde0d88630dd1c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:50.174363 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9f5dc-9a44-4e2d-8958-8ae4c304a07f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:50.177088 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 153/317] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:49 2022] GET /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:50.183443 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aedccc-dd1a-49d8-9b1e-6dd208bbf9eb None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:50.270530 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:50.307235 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aedccc-dd1a-49d8-9b1e-6dd208bbf9eb None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:50.348200 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e161b-3b58-45ca-b060-220f85f6be34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:50.349431 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e161b-3b58-45ca-b060-220f85f6be34 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:50.349925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e161b-3b58-45ca-b060-220f85f6be34 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:50.350459 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e161b-3b58-45ca-b060-220f85f6be34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:50.351554 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e161b-3b58-45ca-b060-220f85f6be34 None admin] RBAC: Adding query filter params (role.id=df27537eb8b1489a9c3d91773fee26b4, scope.project.id=c02407b0147e4d3e9acde0d88630dd1c, user.id=614c02590cdb47a6b87d3cbde131176c) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:50.352092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e161b-3b58-45ca-b060-220f85f6be34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:50.354456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e161b-3b58-45ca-b060-220f85f6be34 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:50.362963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 165/318] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:23:50 2022] GET /identity/v3/role_assignments?user.id=614c02590cdb47a6b87d3cbde131176c&scope.project.id=c02407b0147e4d3e9acde0d88630dd1c&role.id=df27537eb8b1489a9c3d91773fee26b4 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:50.730567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5396c9-579e-41b2-80a1-f118dc0fec05 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:50.731097 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5396c9-579e-41b2-80a1-f118dc0fec05 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:50.731097 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5396c9-579e-41b2-80a1-f118dc0fec05 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:50.732459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 154/319] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:50.738774 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133922fc-2434-48d7-8abe-f75575349d87 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:50.739642 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133922fc-2434-48d7-8abe-f75575349d87 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:50.739642 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133922fc-2434-48d7-8abe-f75575349d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:50.757593 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-133922fc-2434-48d7-8abe-f75575349d87 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:50.758865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-133922fc-2434-48d7-8abe-f75575349d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:50.818809 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3106b9-450a-42da-9570-252e6e29ce74 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:50.819104 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3106b9-450a-42da-9570-252e6e29ce74 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:50.819382 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3106b9-450a-42da-9570-252e6e29ce74 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:50.820753 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 155/320] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:50.826273 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de272ab7-4298-4e27-b1a6-da8e033ba80a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:50.826564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de272ab7-4298-4e27-b1a6-da8e033ba80a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:50.826842 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de272ab7-4298-4e27-b1a6-da8e033ba80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:50.846298 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-de272ab7-4298-4e27-b1a6-da8e033ba80a None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:50.847755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-de272ab7-4298-4e27-b1a6-da8e033ba80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:50.852851 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 166/321] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:50.876386 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133922fc-2434-48d7-8abe-f75575349d87 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:50.940634 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 156/322] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:50.964682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:50.965000 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de272ab7-4298-4e27-b1a6-da8e033ba80a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:51.007030 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133922fc-2434-48d7-8abe-f75575349d87 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:51.038105 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:51.047666 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f9e48-decd-4ebd-ace6-6452bdcb6d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:51.048929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f9e48-decd-4ebd-ace6-6452bdcb6d4f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:51.049453 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f9e48-decd-4ebd-ace6-6452bdcb6d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:51.049453 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f9e48-decd-4ebd-ace6-6452bdcb6d4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:51.050703 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f9e48-decd-4ebd-ace6-6452bdcb6d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:51.052175 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f9e48-decd-4ebd-ace6-6452bdcb6d4f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:51.054055 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 167/323] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:23:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:51.059444 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f9e48-decd-4ebd-ace6-6452bdcb6d4f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:51.097034 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de272ab7-4298-4e27-b1a6-da8e033ba80a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:51.145690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d07e30-1968-48bf-a569-7e1c067fe0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:51.146540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d07e30-1968-48bf-a569-7e1c067fe0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:51.146860 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d07e30-1968-48bf-a569-7e1c067fe0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:51.147126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d07e30-1968-48bf-a569-7e1c067fe0c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:51.171835 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d07e30-1968-48bf-a569-7e1c067fe0c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:51.180922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-45d07e30-1968-48bf-a569-7e1c067fe0c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:51.180922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:51.180922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:51.180922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:51.180922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:51.180922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:51.180922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:51.180922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:51.180922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:51.180922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:51.180922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:51.180922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:51.180922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:51.180922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:51.180922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:51.180922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:51.182212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:51.182212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:51.182212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:51.182212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:51.182212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:51.182212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:51.182212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:51.182212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:51.182212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:51.182212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:51.182212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:51.182212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:51.182212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:51.182212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:51.182212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:51.182212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:51.183028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:51.183028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:51.183028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:51.183028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:51.183028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:51.183028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:51.183028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:51.183028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:51.183028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:51.183028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:51.183028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:51.183028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:51.183028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 157/324] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:51.189801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f9e48-decd-4ebd-ace6-6452bdcb6d4f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:51.192549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d07e30-1968-48bf-a569-7e1c067fe0c5 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:51.237267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61fce1-4b35-4867-bfc5-8a3866933465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:51.237946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61fce1-4b35-4867-bfc5-8a3866933465 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:51.238277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61fce1-4b35-4867-bfc5-8a3866933465 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:51.238555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61fce1-4b35-4867-bfc5-8a3866933465 None admin] PATH_INFO: `/v3/groups` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:51.239255 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61fce1-4b35-4867-bfc5-8a3866933465 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:51.240717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61fce1-4b35-4867-bfc5-8a3866933465 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:51.243814 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:51.266211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 168/325] 10.222.0.39 () {60 vars in 1134 bytes} [Thu Jul 14 15:23:51 2022] POST /identity/v3/groups => generated 226 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:23:51.335709 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d07e30-1968-48bf-a569-7e1c067fe0c5 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:51.355083 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:51.382355 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5231b35-ed22-4bdf-828e-d36a7d480d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:51.383048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5231b35-ed22-4bdf-828e-d36a7d480d21 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:51.383329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5231b35-ed22-4bdf-828e-d36a7d480d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:51.383601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5231b35-ed22-4bdf-828e-d36a7d480d21 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:51.384363 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5231b35-ed22-4bdf-828e-d36a7d480d21 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:51.384676 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5231b35-ed22-4bdf-828e-d36a7d480d21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:51.386176 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5231b35-ed22-4bdf-828e-d36a7d480d21 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:51.399995 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 158/326] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:51.407303 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61fce1-4b35-4867-bfc5-8a3866933465 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:51.537014 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61fce1-4b35-4867-bfc5-8a3866933465 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:51.585388 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4fe51a-f4cd-4ecd-b4c3-e81923121f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:51.586407 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fe51a-f4cd-4ecd-b4c3-e81923121f2b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:51.586700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fe51a-f4cd-4ecd-b4c3-e81923121f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:51.586981 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4fe51a-f4cd-4ecd-b4c3-e81923121f2b None admin] PATH_INFO: `/v3/users/f26ed1bbc8d84b54bb520ed638638375` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:51.588327 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4fe51a-f4cd-4ecd-b4c3-e81923121f2b None admin] RBAC: Authorizing `identity:get_user(user_id=f26ed1bbc8d84b54bb520ed638638375)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:51.589853 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4fe51a-f4cd-4ecd-b4c3-e81923121f2b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:51.591722 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 169/327] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:51 2022] GET /identity/v3/users/f26ed1bbc8d84b54bb520ed638638375 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:51.599609 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5231b35-ed22-4bdf-828e-d36a7d480d21 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:51.728049 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5231b35-ed22-4bdf-828e-d36a7d480d21 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:51.774621 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3a575-f6f3-411a-b0da-8c7ef28554b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:51.775515 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3a575-f6f3-411a-b0da-8c7ef28554b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:51.775801 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3a575-f6f3-411a-b0da-8c7ef28554b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:51.776080 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3a575-f6f3-411a-b0da-8c7ef28554b9 None admin] PATH_INFO: `/v3/system/users/f26ed1bbc8d84b54bb520ed638638375/roles/df27537eb8b1489a9c3d91773fee26b4` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:51.777754 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3a575-f6f3-411a-b0da-8c7ef28554b9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f26ed1bbc8d84b54bb520ed638638375, role_id=df27537eb8b1489a9c3d91773fee26b4)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:51.779116 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3a575-f6f3-411a-b0da-8c7ef28554b9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:51.800867 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 159/328] 10.222.0.39 () {58 vars in 1334 bytes} [Thu Jul 14 15:23:51 2022] PUT /identity/v3/system/users/f26ed1bbc8d84b54bb520ed638638375/roles/df27537eb8b1489a9c3d91773fee26b4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:23:51.857512 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2eabdf-28e3-4562-8f34-14c596c4f292 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:51.858047 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2eabdf-28e3-4562-8f34-14c596c4f292 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:51.858047 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2eabdf-28e3-4562-8f34-14c596c4f292 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:51.859995 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 170/329] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:51.866523 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d3568-fd68-4605-bbb7-8a9daa75938b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:51.866863 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d3568-fd68-4605-bbb7-8a9daa75938b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:51.867095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d3568-fd68-4605-bbb7-8a9daa75938b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:51.890960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-cd2d3568-fd68-4605-bbb7-8a9daa75938b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:51.892922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cd2d3568-fd68-4605-bbb7-8a9daa75938b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:51.950249 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:52.000184 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 160/330] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:52.025745 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2eabdf-28e3-4562-8f34-14c596c4f292 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:52.106508 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:52.155963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2eabdf-28e3-4562-8f34-14c596c4f292 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:52.197032 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8ced1-efb6-4c11-ab07-2bf04270c4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:52.197845 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8ced1-efb6-4c11-ab07-2bf04270c4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:52.198168 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8ced1-efb6-4c11-ab07-2bf04270c4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:52.198452 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8ced1-efb6-4c11-ab07-2bf04270c4e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:52.212525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8ced1-efb6-4c11-ab07-2bf04270c4e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:52.221050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-2cf8ced1-efb6-4c11-ab07-2bf04270c4e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:52.221050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:52.221050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:52.221050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:52.221050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:52.221050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:52.221050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:52.221050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:52.221050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:52.221050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:52.221050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:52.221050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:52.221050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:52.221050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:52.221050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:52.221050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:52.222272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:52.222272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:52.222272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:52.222272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:52.222272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:52.222272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:52.222272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:52.222272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:52.222272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:52.222272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:52.222272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:52.222272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:52.222272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:52.222272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:52.222272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:52.222272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:52.223102 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:52.223102 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:52.223102 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:52.223102 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:52.223102 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:52.223102 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:52.223102 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:52.223102 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:52.223102 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:52.223102 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:52.223102 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:52.223102 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:23:52.223102 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 171/331] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:52.228997 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d3568-fd68-4605-bbb7-8a9daa75938b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:52.346702 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d3568-fd68-4605-bbb7-8a9daa75938b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:52.393648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed14b8a-34ac-4eb6-8e22-0782dc86d669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:52.394302 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed14b8a-34ac-4eb6-8e22-0782dc86d669 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:52.394588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed14b8a-34ac-4eb6-8e22-0782dc86d669 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:52.394866 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed14b8a-34ac-4eb6-8e22-0782dc86d669 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:52.395631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed14b8a-34ac-4eb6-8e22-0782dc86d669 None admin] RBAC: Adding query filter params (name=member) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:52.395939 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed14b8a-34ac-4eb6-8e22-0782dc86d669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:52.397348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed14b8a-34ac-4eb6-8e22-0782dc86d669 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:52.407268 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 161/332] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:52.412909 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8ced1-efb6-4c11-ab07-2bf04270c4e4 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:52.624642 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8ced1-efb6-4c11-ab07-2bf04270c4e4 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:52.678998 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:52.694187 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a4c01-f58b-423a-a1c7-ad61ae3333d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:52.695082 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a4c01-f58b-423a-a1c7-ad61ae3333d5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:52.695366 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a4c01-f58b-423a-a1c7-ad61ae3333d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:52.695640 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a4c01-f58b-423a-a1c7-ad61ae3333d5 None admin] PATH_INFO: `/v3/users/08ee117a6f8547d5b082bae9210cbec6` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:52.696869 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a4c01-f58b-423a-a1c7-ad61ae3333d5 None admin] RBAC: Authorizing `identity:get_user(user_id=08ee117a6f8547d5b082bae9210cbec6)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:52.698413 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a4c01-f58b-423a-a1c7-ad61ae3333d5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:52.700461 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 172/333] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:52 2022] GET /identity/v3/users/08ee117a6f8547d5b082bae9210cbec6 => generated 293 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:52.707198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed14b8a-34ac-4eb6-8e22-0782dc86d669 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:52.779084 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:52.916391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed14b8a-34ac-4eb6-8e22-0782dc86d669 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:52.973743 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63a8d2-7e85-4a41-b225-6f1d4f42322f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:52.974821 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63a8d2-7e85-4a41-b225-6f1d4f42322f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:52.975323 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63a8d2-7e85-4a41-b225-6f1d4f42322f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:52.975796 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63a8d2-7e85-4a41-b225-6f1d4f42322f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:52.976835 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63a8d2-7e85-4a41-b225-6f1d4f42322f None admin] RBAC: Adding query filter params (role.id=d98d81dd45ce4c4095c99ee0de89aab3, user.id=08ee117a6f8547d5b082bae9210cbec6, scope.system=all) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:52.977367 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63a8d2-7e85-4a41-b225-6f1d4f42322f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:52.979146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63a8d2-7e85-4a41-b225-6f1d4f42322f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:52.997686 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 162/334] 10.222.0.39 () {56 vars in 1308 bytes} [Thu Jul 14 15:23:52 2022] GET /identity/v3/role_assignments?user.id=08ee117a6f8547d5b082bae9210cbec6&scope.system=all&role.id=d98d81dd45ce4c4095c99ee0de89aab3 => generated 510 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:54.744486 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf18e74-f82b-4f54-b009-eb2dbd35d724 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:54.745007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf18e74-f82b-4f54-b009-eb2dbd35d724 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:54.745007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf18e74-f82b-4f54-b009-eb2dbd35d724 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:54.746718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 173/335] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:54.751777 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91251a7a-79c4-4b9a-bafd-0b155274774b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:54.752864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91251a7a-79c4-4b9a-bafd-0b155274774b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:54.753328 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91251a7a-79c4-4b9a-bafd-0b155274774b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:54.775924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-91251a7a-79c4-4b9a-bafd-0b155274774b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:54.777457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-91251a7a-79c4-4b9a-bafd-0b155274774b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:54.869877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 163/336] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:54.897495 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf18e74-f82b-4f54-b009-eb2dbd35d724 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:55.064279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf18e74-f82b-4f54-b009-eb2dbd35d724 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:55.119986 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e3ddd-5f7a-4734-a277-afe9561896fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:55.121161 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e3ddd-5f7a-4734-a277-afe9561896fc None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.121696 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e3ddd-5f7a-4734-a277-afe9561896fc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.122235 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e3ddd-5f7a-4734-a277-afe9561896fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.142664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e3ddd-5f7a-4734-a277-afe9561896fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:55.157863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-f39e3ddd-5f7a-4734-a277-afe9561896fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:55.157863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:55.157863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:55.157863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:55.157863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:55.157863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:55.157863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:55.157863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:55.157863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:55.157863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:55.157863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:55.157863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:55.157863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:55.157863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:55.157863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:55.157863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:55.163737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:55.163737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:55.163737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:55.163737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:55.163737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:55.163737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:55.163737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:55.163737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:55.163737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:55.163737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:55.163737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:55.163737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:55.163737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:55.163737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:55.163737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:55.163737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:55.165113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:55.165113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:55.165113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:55.165113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:55.165113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:55.165113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:55.165113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:55.165113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:55.165113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:55.165113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:55.165113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:55.165113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:23:55.169116 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 174/337] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:55.178634 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91251a7a-79c4-4b9a-bafd-0b155274774b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:55.222466 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:55.255497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb74c2e-7636-4765-9f13-cf1faeff1dad None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.255793 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb74c2e-7636-4765-9f13-cf1faeff1dad None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.256247 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb74c2e-7636-4765-9f13-cf1faeff1dad None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.257789 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 175/338] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:55.267642 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54c304-69c2-4eb6-814a-ed98925d3e73 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.268193 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54c304-69c2-4eb6-814a-ed98925d3e73 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.268658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54c304-69c2-4eb6-814a-ed98925d3e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.308994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6f54c304-69c2-4eb6-814a-ed98925d3e73 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:55.310491 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6f54c304-69c2-4eb6-814a-ed98925d3e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:55.349597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91251a7a-79c4-4b9a-bafd-0b155274774b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:55.409396 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:55.433252 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b570b4b-f47b-4b57-a7a4-6d5ef3379faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:55.434305 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b570b4b-f47b-4b57-a7a4-6d5ef3379faf None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.434775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b570b4b-f47b-4b57-a7a4-6d5ef3379faf None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.435235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b570b4b-f47b-4b57-a7a4-6d5ef3379faf None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.436435 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b570b4b-f47b-4b57-a7a4-6d5ef3379faf None admin] RBAC: Adding query filter params (name=member) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:55.436897 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b570b4b-f47b-4b57-a7a4-6d5ef3379faf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:55.439037 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b570b4b-f47b-4b57-a7a4-6d5ef3379faf None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:55.455139 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 164/339] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:55.456991 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6362393-aa80-4285-a223-6e65be8d6ad5 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.461022 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6362393-aa80-4285-a223-6e65be8d6ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.462749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6362393-aa80-4285-a223-6e65be8d6ad5 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.464479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 165/340] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:55.465891 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6362393-aa80-4285-a223-6e65be8d6ad5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:55.472828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 176/341] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:23:55.475997 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac6cea-7ec6-4036-9d5c-923ab5bf52d9 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.481245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac6cea-7ec6-4036-9d5c-923ab5bf52d9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.481953 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac6cea-7ec6-4036-9d5c-923ab5bf52d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.528113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5fac6cea-7ec6-4036-9d5c-923ab5bf52d9 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:55.530268 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5fac6cea-7ec6-4036-9d5c-923ab5bf52d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:55.634287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:55.639245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 177/342] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:55.640638 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac6cea-7ec6-4036-9d5c-923ab5bf52d9 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:55.665857 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6362393-aa80-4285-a223-6e65be8d6ad5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:55.713956 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f89e6-136a-4808-8c4c-2eff7e23c16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:55.715217 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f89e6-136a-4808-8c4c-2eff7e23c16c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.715672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f89e6-136a-4808-8c4c-2eff7e23c16c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.716077 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f89e6-136a-4808-8c4c-2eff7e23c16c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.813206 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f89e6-136a-4808-8c4c-2eff7e23c16c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:55.817135 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f89e6-136a-4808-8c4c-2eff7e23c16c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:55.821271 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac6cea-7ec6-4036-9d5c-923ab5bf52d9 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:55.838520 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:55.881507 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e978b3-69ed-4c8e-b88c-e33f4d7b307d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:55.882841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e978b3-69ed-4c8e-b88c-e33f4d7b307d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.883294 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e978b3-69ed-4c8e-b88c-e33f4d7b307d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.883842 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e978b3-69ed-4c8e-b88c-e33f4d7b307d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.908269 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e978b3-69ed-4c8e-b88c-e33f4d7b307d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:55.919166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-98e978b3-69ed-4c8e-b88c-e33f4d7b307d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:55.919166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:55.919166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:55.919166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:55.919166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:55.919166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:55.919166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:55.919166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:55.919166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:55.919166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:55.919166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:55.919166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:55.919166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:55.919166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:55.919166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:55.919166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:55.920330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:55.920330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:55.920330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:55.920330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:55.920330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:55.920330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:55.920330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:55.920330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:55.920330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:55.920330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:55.920330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:55.920330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:55.920330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:55.920330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:55.920330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:55.920330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:55.921330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:55.921330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:55.921330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:55.921330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:55.921330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:55.921330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:55.921330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:55.921330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:55.921330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:55.921330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:55.921330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:55.921330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:23:55.924748 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 178/343] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:55.926491 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d3b9c-12af-4fd1-a756-6ce9c2159470 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:55.926965 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d3b9c-12af-4fd1-a756-6ce9c2159470 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:55.927377 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d3b9c-12af-4fd1-a756-6ce9c2159470 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:55.928849 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 179/344] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:55.929698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d3b9c-12af-4fd1-a756-6ce9c2159470 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:55.960858 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:55.988264 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 166/345] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:55.988264 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f89e6-136a-4808-8c4c-2eff7e23c16c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:56.073974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d3b9c-12af-4fd1-a756-6ce9c2159470 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:56.125627 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db1113-0622-486b-bf21-3a124b4f7369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:56.126753 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db1113-0622-486b-bf21-3a124b4f7369 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.128263 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db1113-0622-486b-bf21-3a124b4f7369 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.128547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db1113-0622-486b-bf21-3a124b4f7369 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.136582 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f89e6-136a-4808-8c4c-2eff7e23c16c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:56.143621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db1113-0622-486b-bf21-3a124b4f7369 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:56.152013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-65db1113-0622-486b-bf21-3a124b4f7369 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:56.152013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:56.152013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:56.152013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:56.152013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:56.152013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:56.152013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:56.152013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:56.152013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:56.152013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:56.152013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:56.152013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:56.152013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:56.152013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:56.152013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:56.152013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:56.153007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:56.153007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:56.153007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:56.153007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:56.153007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:56.153007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:56.153007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:56.153007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:56.153007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:56.153007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:56.153007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:56.153007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:56.153007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:56.153007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:56.153007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:56.153007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:56.153828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:56.153828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:56.153828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:56.153828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:56.153828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:56.153828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:56.153828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:56.153828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:56.153828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:56.153828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:56.153828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:23:56.153828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:23:56.156597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 180/346] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:56.160868 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe32e3b-d8ae-49b2-aeaa-dffbbd5bfec7 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.161023 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe32e3b-d8ae-49b2-aeaa-dffbbd5bfec7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.161213 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe32e3b-d8ae-49b2-aeaa-dffbbd5bfec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.184976 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8fe32e3b-d8ae-49b2-aeaa-dffbbd5bfec7 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:56.186904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25cf84-da65-42d4-a9fa-62b9090c2fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:56.187463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8fe32e3b-d8ae-49b2-aeaa-dffbbd5bfec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:56.187742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25cf84-da65-42d4-a9fa-62b9090c2fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.187915 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25cf84-da65-42d4-a9fa-62b9090c2fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.188192 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25cf84-da65-42d4-a9fa-62b9090c2fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.189347 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25cf84-da65-42d4-a9fa-62b9090c2fa4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:56.189659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25cf84-da65-42d4-a9fa-62b9090c2fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:56.191125 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25cf84-da65-42d4-a9fa-62b9090c2fa4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:56.203981 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 167/347] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:23:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:56.205723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbc718-13fb-4e1f-8162-890b54bbd577 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.212779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbc718-13fb-4e1f-8162-890b54bbd577 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.212779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbc718-13fb-4e1f-8162-890b54bbd577 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.212779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 168/348] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:56.212779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbc718-13fb-4e1f-8162-890b54bbd577 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:56.239878 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:56.282601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:56.304343 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 181/349] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:56.305835 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe32e3b-d8ae-49b2-aeaa-dffbbd5bfec7 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:56.367106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbc718-13fb-4e1f-8162-890b54bbd577 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:56.412747 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452f361-59cb-4d10-b9f5-6ceef8e8f616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:56.413535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452f361-59cb-4d10-b9f5-6ceef8e8f616 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.413813 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452f361-59cb-4d10-b9f5-6ceef8e8f616 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.414104 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452f361-59cb-4d10-b9f5-6ceef8e8f616 None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.417152 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452f361-59cb-4d10-b9f5-6ceef8e8f616 None admin] RBAC: Authorizing `identity:get_project(project_id=4d0d3a63468d4aeba187ed301b2ea4d0)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:56.417329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452f361-59cb-4d10-b9f5-6ceef8e8f616 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:56.419015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 169/350] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:56 2022] GET /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:56.419795 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452f361-59cb-4d10-b9f5-6ceef8e8f616 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:56.457766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe32e3b-d8ae-49b2-aeaa-dffbbd5bfec7 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:56.511350 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88269e0b-6e28-421d-94bb-ddc8294c9be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:56.512467 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88269e0b-6e28-421d-94bb-ddc8294c9be0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.512761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88269e0b-6e28-421d-94bb-ddc8294c9be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.513040 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88269e0b-6e28-421d-94bb-ddc8294c9be0 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.513971 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88269e0b-6e28-421d-94bb-ddc8294c9be0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:56.514335 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88269e0b-6e28-421d-94bb-ddc8294c9be0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:56.515867 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88269e0b-6e28-421d-94bb-ddc8294c9be0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:56.531215 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 182/351] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:56.533279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b8393-03e5-49dd-8fe3-940de7836344 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.533571 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b8393-03e5-49dd-8fe3-940de7836344 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.533845 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b8393-03e5-49dd-8fe3-940de7836344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.557157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-0b5b8393-03e5-49dd-8fe3-940de7836344 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:56.558435 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0b5b8393-03e5-49dd-8fe3-940de7836344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:56.579142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452f361-59cb-4d10-b9f5-6ceef8e8f616 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:56.585008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:56.604457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:56.636942 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7f0c5-7905-4743-bf80-9509ba17605a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:56.637586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7f0c5-7905-4743-bf80-9509ba17605a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.637865 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7f0c5-7905-4743-bf80-9509ba17605a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.638172 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7f0c5-7905-4743-bf80-9509ba17605a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.660929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 183/352] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:56.662127 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b8393-03e5-49dd-8fe3-940de7836344 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:56.734749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7f0c5-7905-4743-bf80-9509ba17605a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:56.737247 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7f0c5-7905-4743-bf80-9509ba17605a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:56.797521 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b8393-03e5-49dd-8fe3-940de7836344 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:56.839252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a5afd-e96f-4367-9889-2aadf7c7b956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:56.840059 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a5afd-e96f-4367-9889-2aadf7c7b956 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:56.840347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a5afd-e96f-4367-9889-2aadf7c7b956 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:56.840626 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a5afd-e96f-4367-9889-2aadf7c7b956 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:56.854324 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a5afd-e96f-4367-9889-2aadf7c7b956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:56.864767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-533a5afd-e96f-4367-9889-2aadf7c7b956 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:56.864767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:56.864767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:56.864767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:56.864767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:56.864767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:56.864767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:56.864767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:56.864767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:56.864767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:56.864767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:56.864767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:56.864767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:56.864767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:56.864767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:56.864767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:56.865763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:56.865763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:56.865763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:56.865763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:56.865763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:56.865763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:56.865763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:56.865763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:56.865763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:56.865763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:56.865763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:56.865763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:56.865763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:56.865763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:56.865763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:56.865763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:56.866605 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:56.866605 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:56.866605 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:56.866605 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:56.866605 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:56.866605 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:56.866605 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:56.866605 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:56.866605 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:56.866605 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:56.866605 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 15:23:56.866605 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:23:56.866605 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 184/353] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:56.867286 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a5afd-e96f-4367-9889-2aadf7c7b956 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:56.870933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 170/354] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:56.872069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7f0c5-7905-4743-bf80-9509ba17605a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:56.887096 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:56.888382 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:57.012894 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a5afd-e96f-4367-9889-2aadf7c7b956 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.015938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7f0c5-7905-4743-bf80-9509ba17605a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.055324 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44866498-7ea6-4006-9521-7a9f409bb8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.056186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44866498-7ea6-4006-9521-7a9f409bb8ba None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.056474 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44866498-7ea6-4006-9521-7a9f409bb8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.056813 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44866498-7ea6-4006-9521-7a9f409bb8ba None admin] PATH_INFO: `/v3/groups/e40d85233d924615be4669e980cbaa0a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.064608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44866498-7ea6-4006-9521-7a9f409bb8ba None admin] RBAC: Authorizing `identity:get_group(group_id=e40d85233d924615be4669e980cbaa0a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:57.069527 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44866498-7ea6-4006-9521-7a9f409bb8ba None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:57.069719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f7fe9-9a73-4deb-8515-8b3c15469106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.069719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f7fe9-9a73-4deb-8515-8b3c15469106 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.069719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f7fe9-9a73-4deb-8515-8b3c15469106 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.069719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f7fe9-9a73-4deb-8515-8b3c15469106 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.070345 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 185/355] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jul 14 15:23:56 2022] GET /identity/v3/groups/e40d85233d924615be4669e980cbaa0a => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:57.072135 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef43be2-15a6-4bc0-a285-3a311d171bc4 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.072576 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef43be2-15a6-4bc0-a285-3a311d171bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.073149 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef43be2-15a6-4bc0-a285-3a311d171bc4 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.075261 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 186/356] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:23:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:23:57.079226 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef43be2-15a6-4bc0-a285-3a311d171bc4 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:57.166490 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f7fe9-9a73-4deb-8515-8b3c15469106 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:57.167948 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f7fe9-9a73-4deb-8515-8b3c15469106 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:57.188194 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:57.192002 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:57.242542 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef43be2-15a6-4bc0-a285-3a311d171bc4 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.305020 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ed75d-4bd8-4a4a-be4c-215b6027e6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.306217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ed75d-4bd8-4a4a-be4c-215b6027e6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.306550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ed75d-4bd8-4a4a-be4c-215b6027e6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.306827 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ed75d-4bd8-4a4a-be4c-215b6027e6e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.322997 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ed75d-4bd8-4a4a-be4c-215b6027e6e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:57.331770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-348ed75d-4bd8-4a4a-be4c-215b6027e6e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:57.331770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:57.331770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:57.331770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:57.331770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:57.331770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:57.331770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:57.331770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:57.331770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:57.331770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:57.331770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:57.331770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:57.331770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:57.331770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:57.331770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:57.331770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:57.333088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:57.333088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:57.333088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:57.333088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:57.333088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:57.333088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:57.333088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:57.333088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:57.333088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:57.333088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:57.333088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:57.333088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:57.333088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:57.333088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:57.333088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:57.333088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:57.335126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:57.335126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:57.335126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:57.335126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:57.335126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:57.335126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:57.335126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:57.335126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:57.335126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:57.335126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:57.335126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:23:57.335126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:23:57.335126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 187/357] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jul 14 15:23:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:57.335126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ed75d-4bd8-4a4a-be4c-215b6027e6e3 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:57.338168 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 171/358] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:57.339166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f7fe9-9a73-4deb-8515-8b3c15469106 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:57.477277 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f7fe9-9a73-4deb-8515-8b3c15469106 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.479934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ed75d-4bd8-4a4a-be4c-215b6027e6e3 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.502175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:57.532625 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df6dac-fc28-466f-b764-db171dec6b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.532625 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df6dac-fc28-466f-b764-db171dec6b3f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.532625 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df6dac-fc28-466f-b764-db171dec6b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.532625 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df6dac-fc28-466f-b764-db171dec6b3f None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.533308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df6dac-fc28-466f-b764-db171dec6b3f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:57.533308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df6dac-fc28-466f-b764-db171dec6b3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:57.534882 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df6dac-fc28-466f-b764-db171dec6b3f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:57.537889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:57.541994 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbcfe2-042e-44b9-9925-746d30fe66e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.542915 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbcfe2-042e-44b9-9925-746d30fe66e0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.543230 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbcfe2-042e-44b9-9925-746d30fe66e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.543632 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbcfe2-042e-44b9-9925-746d30fe66e0 None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.544701 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbcfe2-042e-44b9-9925-746d30fe66e0 None admin] RBAC: Authorizing `identity:get_project(project_id=4d0d3a63468d4aeba187ed301b2ea4d0)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:57.546203 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 188/359] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:23:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:57.546323 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbcfe2-042e-44b9-9925-746d30fe66e0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:57.546933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df6dac-fc28-466f-b764-db171dec6b3f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:57.548887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 172/360] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:57 2022] GET /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:57.553674 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4087a4f-775a-4a2e-b146-0ea67954e702 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.553674 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4087a4f-775a-4a2e-b146-0ea67954e702 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.553674 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4087a4f-775a-4a2e-b146-0ea67954e702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.570897 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f4087a4f-775a-4a2e-b146-0ea67954e702 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:23:57.572018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f4087a4f-775a-4a2e-b146-0ea67954e702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:23:57.670149 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 173/361] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:23:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:57.671191 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4087a4f-775a-4a2e-b146-0ea67954e702 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:57.688008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df6dac-fc28-466f-b764-db171dec6b3f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.730213 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9c17c-953d-40da-8513-e4935949bb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.730881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9c17c-953d-40da-8513-e4935949bb63 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.731168 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9c17c-953d-40da-8513-e4935949bb63 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.731449 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9c17c-953d-40da-8513-e4935949bb63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.732290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9c17c-953d-40da-8513-e4935949bb63 None admin] RBAC: Adding query filter params (group.id=e40d85233d924615be4669e980cbaa0a, role.id=d98d81dd45ce4c4095c99ee0de89aab3, scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:57.732609 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9c17c-953d-40da-8513-e4935949bb63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:57.735050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9c17c-953d-40da-8513-e4935949bb63 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:57.742907 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 189/362] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jul 14 15:23:57 2022] GET /identity/v3/role_assignments?group.id=e40d85233d924615be4669e980cbaa0a&scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0&role.id=d98d81dd45ce4c4095c99ee0de89aab3 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:57.743904 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9c17c-953d-40da-8513-e4935949bb63 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:57.838660 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4087a4f-775a-4a2e-b146-0ea67954e702 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:57.854994 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:57.860524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:57.889309 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f5c48-df91-485f-84e8-f9919ca1274b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:57.890343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f5c48-df91-485f-84e8-f9919ca1274b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:57.890585 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f5c48-df91-485f-84e8-f9919ca1274b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:57.890827 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f5c48-df91-485f-84e8-f9919ca1274b None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:57.894041 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f5c48-df91-485f-84e8-f9919ca1274b None admin] RBAC: Authorizing `identity:get_project(project_id=c02407b0147e4d3e9acde0d88630dd1c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:57.895747 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f5c48-df91-485f-84e8-f9919ca1274b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:57.897725 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 174/363] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:57 2022] GET /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:57.898566 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f5c48-df91-485f-84e8-f9919ca1274b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:57.941271 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9c17c-953d-40da-8513-e4935949bb63 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:58.002265 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a6f59-01b5-4913-9b5e-f744270a1c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:58.003346 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a6f59-01b5-4913-9b5e-f744270a1c39 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:58.003782 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a6f59-01b5-4913-9b5e-f744270a1c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:58.004236 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a6f59-01b5-4913-9b5e-f744270a1c39 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:58.005510 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a6f59-01b5-4913-9b5e-f744270a1c39 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:58.005986 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a6f59-01b5-4913-9b5e-f744270a1c39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:58.008339 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a6f59-01b5-4913-9b5e-f744270a1c39 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:58.020642 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 190/364] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:23:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:58.021791 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a6f59-01b5-4913-9b5e-f744270a1c39 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:58.071061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f5c48-df91-485f-84e8-f9919ca1274b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:58.110705 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296b154-c3c2-4d45-bd83-a9c86a0c6b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:58.111540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296b154-c3c2-4d45-bd83-a9c86a0c6b9a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:58.111987 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296b154-c3c2-4d45-bd83-a9c86a0c6b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:58.112164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296b154-c3c2-4d45-bd83-a9c86a0c6b9a None admin] PATH_INFO: `/v3/users/f26ed1bbc8d84b54bb520ed638638375` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:58.113370 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296b154-c3c2-4d45-bd83-a9c86a0c6b9a None admin] RBAC: Authorizing `identity:get_user(user_id=f26ed1bbc8d84b54bb520ed638638375)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:58.114881 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a296b154-c3c2-4d45-bd83-a9c86a0c6b9a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:58.121543 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 175/365] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:23:57 2022] GET /identity/v3/users/f26ed1bbc8d84b54bb520ed638638375 => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:58.121543 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296b154-c3c2-4d45-bd83-a9c86a0c6b9a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:58.171873 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a6f59-01b5-4913-9b5e-f744270a1c39 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:58.178427 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:58.200325 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:58.217820 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b397e8-bb53-42b4-b866-19dbd66747a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:58.218879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b397e8-bb53-42b4-b866-19dbd66747a4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:58.219136 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b397e8-bb53-42b4-b866-19dbd66747a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:58.219465 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b397e8-bb53-42b4-b866-19dbd66747a4 None admin] PATH_INFO: `/v3/groups/e40d85233d924615be4669e980cbaa0a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:58.221475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b397e8-bb53-42b4-b866-19dbd66747a4 None admin] RBAC: Authorizing `identity:get_group(group_id=e40d85233d924615be4669e980cbaa0a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:58.223932 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b397e8-bb53-42b4-b866-19dbd66747a4 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:58.231455 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 191/366] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jul 14 15:23:58 2022] GET /identity/v3/groups/e40d85233d924615be4669e980cbaa0a => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:58.231455 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b397e8-bb53-42b4-b866-19dbd66747a4 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:58.251290 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a296b154-c3c2-4d45-bd83-a9c86a0c6b9a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:58.292560 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0187a-7374-431b-8077-76e99c87c384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:58.293377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0187a-7374-431b-8077-76e99c87c384 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:58.293659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0187a-7374-431b-8077-76e99c87c384 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:58.293936 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0187a-7374-431b-8077-76e99c87c384 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:58.315533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0187a-7374-431b-8077-76e99c87c384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:23:58.323406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-edf0187a-7374-431b-8077-76e99c87c384 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:58.323406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:23:58.323406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:23:58.323406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:23:58.323406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:23:58.323406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:23:58.323406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:23:58.323406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:23:58.323406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:23:58.323406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:23:58.323406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:23:58.323406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:23:58.323406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:23:58.323406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:23:58.323406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:23:58.323406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:23:58.324378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:23:58.324378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:23:58.324378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:23:58.324378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:23:58.324378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:23:58.324378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:23:58.324378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:23:58.324378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:23:58.324378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:23:58.324378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:23:58.324378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:23:58.324378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:23:58.324378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:23:58.324378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:23:58.324378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:23:58.324378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:23:58.331480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:23:58.331480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:23:58.331480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:23:58.331480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:23:58.331480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:23:58.331480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:23:58.331480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:23:58.331480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:23:58.331480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:23:58.331480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:23:58.331480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:23:58.331480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:23:58.331480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 176/367] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:23:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:23:58.331480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0187a-7374-431b-8077-76e99c87c384 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:58.377365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b397e8-bb53-42b4-b866-19dbd66747a4 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:58.419917 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8560485-e77d-49d3-97bb-80f540789267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:58.420903 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8560485-e77d-49d3-97bb-80f540789267 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:58.421245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8560485-e77d-49d3-97bb-80f540789267 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:58.421533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8560485-e77d-49d3-97bb-80f540789267 None admin] PATH_INFO: `/v3/groups/e40d85233d924615be4669e980cbaa0a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:58.427428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8560485-e77d-49d3-97bb-80f540789267 None admin] RBAC: Authorizing `identity:get_group(group_id=e40d85233d924615be4669e980cbaa0a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:58.427428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8560485-e77d-49d3-97bb-80f540789267 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:58.427428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 192/368] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jul 14 15:23:58 2022] GET /identity/v3/groups/e40d85233d924615be4669e980cbaa0a => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:58.428118 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8560485-e77d-49d3-97bb-80f540789267 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:58.465746 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0187a-7374-431b-8077-76e99c87c384 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:58.473434 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:58.508993 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:58.511506 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f91aef-4cc2-4439-b432-fc8c4e5c7197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:58.512747 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f91aef-4cc2-4439-b432-fc8c4e5c7197 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:58.513617 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f91aef-4cc2-4439-b432-fc8c4e5c7197 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:58.513957 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f91aef-4cc2-4439-b432-fc8c4e5c7197 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:58.561935 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8560485-e77d-49d3-97bb-80f540789267 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:58.595533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f91aef-4cc2-4439-b432-fc8c4e5c7197 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:58.597181 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f91aef-4cc2-4439-b432-fc8c4e5c7197 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:58.601667 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c6791-9238-40b1-a486-78761fb5f365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:58.602374 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c6791-9238-40b1-a486-78761fb5f365 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:58.602662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c6791-9238-40b1-a486-78761fb5f365 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:58.602945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c6791-9238-40b1-a486-78761fb5f365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:58.603793 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c6791-9238-40b1-a486-78761fb5f365 None admin] RBAC: Adding query filter params (role.id=df27537eb8b1489a9c3d91773fee26b4, user.id=f26ed1bbc8d84b54bb520ed638638375, scope.system=all) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:58.604110 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c6791-9238-40b1-a486-78761fb5f365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:58.605567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c6791-9238-40b1-a486-78761fb5f365 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:58.630217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 193/369] 10.222.0.39 () {56 vars in 1308 bytes} [Thu Jul 14 15:23:58 2022] GET /identity/v3/role_assignments?user.id=f26ed1bbc8d84b54bb520ed638638375&scope.system=all&role.id=df27537eb8b1489a9c3d91773fee26b4 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:58.630217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c6791-9238-40b1-a486-78761fb5f365 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:58.760091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 177/370] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:58.760985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f91aef-4cc2-4439-b432-fc8c4e5c7197 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:58.763443 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c6791-9238-40b1-a486-78761fb5f365 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:58.781870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:58.793808 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:58.818849 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d7c2c-14ef-41d2-b570-a578cff5f629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:58.819943 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d7c2c-14ef-41d2-b570-a578cff5f629 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:58.820385 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d7c2c-14ef-41d2-b570-a578cff5f629 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:58.820925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d7c2c-14ef-41d2-b570-a578cff5f629 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:58.822016 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d7c2c-14ef-41d2-b570-a578cff5f629 None admin] RBAC: Adding query filter params (group.id=e40d85233d924615be4669e980cbaa0a, role.id=26bfea3cd8164feeb8043fd508a5268c, scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:58.822633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d7c2c-14ef-41d2-b570-a578cff5f629 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:58.824587 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d7c2c-14ef-41d2-b570-a578cff5f629 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:58.833020 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 194/371] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jul 14 15:23:58 2022] GET /identity/v3/role_assignments?group.id=e40d85233d924615be4669e980cbaa0a&scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0&role.id=26bfea3cd8164feeb8043fd508a5268c => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:58.834274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d7c2c-14ef-41d2-b570-a578cff5f629 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:58.925526 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f91aef-4cc2-4439-b432-fc8c4e5c7197 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:58.999814 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02241c2-cb0c-4a32-a898-0e0a4b0d42b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:59.001292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02241c2-cb0c-4a32-a898-0e0a4b0d42b6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:59.001756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02241c2-cb0c-4a32-a898-0e0a4b0d42b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:59.002048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02241c2-cb0c-4a32-a898-0e0a4b0d42b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:59.003313 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02241c2-cb0c-4a32-a898-0e0a4b0d42b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:59.003641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02241c2-cb0c-4a32-a898-0e0a4b0d42b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:59.005119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02241c2-cb0c-4a32-a898-0e0a4b0d42b6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:59.016038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 178/372] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:23:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:59.017853 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02241c2-cb0c-4a32-a898-0e0a4b0d42b6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:59.020902 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d7c2c-14ef-41d2-b570-a578cff5f629 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:59.069982 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef347b5-ec77-42e3-b3ae-9445e9961fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:59.071052 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef347b5-ec77-42e3-b3ae-9445e9961fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:59.071522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef347b5-ec77-42e3-b3ae-9445e9961fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:59.071987 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef347b5-ec77-42e3-b3ae-9445e9961fb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:59.073014 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef347b5-ec77-42e3-b3ae-9445e9961fb7 None admin] RBAC: Adding query filter params (group.id=e40d85233d924615be4669e980cbaa0a, role.id=d98d81dd45ce4c4095c99ee0de89aab3, scope.project.id=c02407b0147e4d3e9acde0d88630dd1c) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:59.073530 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef347b5-ec77-42e3-b3ae-9445e9961fb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:59.075214 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef347b5-ec77-42e3-b3ae-9445e9961fb7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:59.083036 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 195/373] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jul 14 15:23:58 2022] GET /identity/v3/role_assignments?group.id=e40d85233d924615be4669e980cbaa0a&scope.project.id=c02407b0147e4d3e9acde0d88630dd1c&role.id=d98d81dd45ce4c4095c99ee0de89aab3 => generated 260 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:59.084283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef347b5-ec77-42e3-b3ae-9445e9961fb7 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:59.106509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:59.142496 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:59.176018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02241c2-cb0c-4a32-a898-0e0a4b0d42b6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:59.267696 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef347b5-ec77-42e3-b3ae-9445e9961fb7 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:59.274013 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfbcbe-2107-43b9-aa0e-11ff9f24d79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:59.274941 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfbcbe-2107-43b9-aa0e-11ff9f24d79f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:59.275217 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfbcbe-2107-43b9-aa0e-11ff9f24d79f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:59.275495 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfbcbe-2107-43b9-aa0e-11ff9f24d79f None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:59.276957 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bfbcbe-2107-43b9-aa0e-11ff9f24d79f None admin] RBAC: Authorizing `identity:get_project(project_id=c02407b0147e4d3e9acde0d88630dd1c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:59.283755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bfbcbe-2107-43b9-aa0e-11ff9f24d79f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:59.286411 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 179/374] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:59 2022] GET /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:59.292786 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfbcbe-2107-43b9-aa0e-11ff9f24d79f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:59.383034 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2e018-98e3-42df-8b58-5124f526dce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:59.384076 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2e018-98e3-42df-8b58-5124f526dce5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:59.384558 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2e018-98e3-42df-8b58-5124f526dce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:59.385009 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2e018-98e3-42df-8b58-5124f526dce5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:59.456171 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfbcbe-2107-43b9-aa0e-11ff9f24d79f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:59.549423 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2e018-98e3-42df-8b58-5124f526dce5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:59.551867 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2e018-98e3-42df-8b58-5124f526dce5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:59.564192 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac13fc6-e6d6-467a-8ab8-50d4f186b99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:59.570098 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac13fc6-e6d6-467a-8ab8-50d4f186b99d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:59.570098 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac13fc6-e6d6-467a-8ab8-50d4f186b99d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:59.570098 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac13fc6-e6d6-467a-8ab8-50d4f186b99d None admin] PATH_INFO: `/v3/groups/e40d85233d924615be4669e980cbaa0a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:59.571139 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac13fc6-e6d6-467a-8ab8-50d4f186b99d None admin] RBAC: Authorizing `identity:get_group(group_id=e40d85233d924615be4669e980cbaa0a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:59.572848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac13fc6-e6d6-467a-8ab8-50d4f186b99d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:59.574755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 180/375] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jul 14 15:23:59 2022] GET /identity/v3/groups/e40d85233d924615be4669e980cbaa0a => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:23:59.583582 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac13fc6-e6d6-467a-8ab8-50d4f186b99d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:59.594177 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:59.615862 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:59.706063 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 196/376] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:23:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:59.713682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2e018-98e3-42df-8b58-5124f526dce5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:23:59.786790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac13fc6-e6d6-467a-8ab8-50d4f186b99d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:59.834658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b7f06-d637-4c0b-a887-4405ac34f0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:59.835328 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b7f06-d637-4c0b-a887-4405ac34f0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:59.835616 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b7f06-d637-4c0b-a887-4405ac34f0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:59.835938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b7f06-d637-4c0b-a887-4405ac34f0f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:59.836959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b7f06-d637-4c0b-a887-4405ac34f0f4 None admin] RBAC: Adding query filter params (group.id=e40d85233d924615be4669e980cbaa0a, role.id=26bfea3cd8164feeb8043fd508a5268c, scope.project.id=c02407b0147e4d3e9acde0d88630dd1c) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:23:59.837285 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b7f06-d637-4c0b-a887-4405ac34f0f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:59.838923 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b7f06-d637-4c0b-a887-4405ac34f0f4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:59.855475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 181/377] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jul 14 15:23:59 2022] GET /identity/v3/role_assignments?group.id=e40d85233d924615be4669e980cbaa0a&scope.project.id=c02407b0147e4d3e9acde0d88630dd1c&role.id=26bfea3cd8164feeb8043fd508a5268c => generated 260 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:59.870657 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2e018-98e3-42df-8b58-5124f526dce5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:23:59.930727 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7893e57-758d-486b-939d-292394e6f010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:23:59.931638 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7893e57-758d-486b-939d-292394e6f010 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:23:59.931933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7893e57-758d-486b-939d-292394e6f010 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:23:59.932217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7893e57-758d-486b-939d-292394e6f010 None admin] PATH_INFO: `/v3/projects/758a2be557ed4a1ab6684561497d3b7f` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:23:59.933658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7893e57-758d-486b-939d-292394e6f010 None admin] RBAC: Authorizing `identity:get_project(project_id=758a2be557ed4a1ab6684561497d3b7f)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:23:59.935199 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7893e57-758d-486b-939d-292394e6f010 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:23:59.937978 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 197/378] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:23:59 2022] GET /identity/v3/projects/758a2be557ed4a1ab6684561497d3b7f => generated 344 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:23:59.944004 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b7f06-d637-4c0b-a887-4405ac34f0f4 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:00.087956 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:00.182666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b7f06-d637-4c0b-a887-4405ac34f0f4 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:00.265097 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3d1db-acc6-48e5-a20d-e0ea6d103115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:00.265982 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3d1db-acc6-48e5-a20d-e0ea6d103115 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:00.266296 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3d1db-acc6-48e5-a20d-e0ea6d103115 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:00.266578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3d1db-acc6-48e5-a20d-e0ea6d103115 None admin] PATH_INFO: `/v3/groups/9b2dc6a4ab354140a11891f4bf39a33e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:00.281820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3d1db-acc6-48e5-a20d-e0ea6d103115 None admin] RBAC: Authorizing `identity:get_group(group_id=9b2dc6a4ab354140a11891f4bf39a33e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:00.284082 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3d1db-acc6-48e5-a20d-e0ea6d103115 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:00.286063 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 182/379] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jul 14 15:23:59 2022] GET /identity/v3/groups/9b2dc6a4ab354140a11891f4bf39a33e => generated 229 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:00.292130 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7893e57-758d-486b-939d-292394e6f010 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:00.327428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:00.515533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7893e57-758d-486b-939d-292394e6f010 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:00.573356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c4cb8-07fe-432c-9f0f-9e9b161350e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:00.574486 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c4cb8-07fe-432c-9f0f-9e9b161350e7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:00.574994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c4cb8-07fe-432c-9f0f-9e9b161350e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:00.575478 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c4cb8-07fe-432c-9f0f-9e9b161350e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:00.576685 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c4cb8-07fe-432c-9f0f-9e9b161350e7 None admin] RBAC: Adding query filter params (group.id=9b2dc6a4ab354140a11891f4bf39a33e, role.id=87f040877bfa47bda56305eb022af09e, scope.project.id=758a2be557ed4a1ab6684561497d3b7f) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:00.577237 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c4cb8-07fe-432c-9f0f-9e9b161350e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:00.579969 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c4cb8-07fe-432c-9f0f-9e9b161350e7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:00.590770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 198/380] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jul 14 15:24:00 2022] GET /identity/v3/role_assignments?group.id=9b2dc6a4ab354140a11891f4bf39a33e&scope.project.id=758a2be557ed4a1ab6684561497d3b7f&role.id=87f040877bfa47bda56305eb022af09e => generated 260 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:00.628995 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f6eef-78bc-4ea4-ad69-90f4df66f101 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:00.629352 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f6eef-78bc-4ea4-ad69-90f4df66f101 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:00.629551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f6eef-78bc-4ea4-ad69-90f4df66f101 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:00.631326 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 183/381] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:24:00.637092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0acf7b-6162-4c9e-bc76-0140719c897d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:00.637669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0acf7b-6162-4c9e-bc76-0140719c897d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:00.638192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0acf7b-6162-4c9e-bc76-0140719c897d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:00.664031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-1b0acf7b-6162-4c9e-bc76-0140719c897d None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:00.665314 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1b0acf7b-6162-4c9e-bc76-0140719c897d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:00.775604 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 199/382] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:00.805050 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f6eef-78bc-4ea4-ad69-90f4df66f101 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:00.949011 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f6eef-78bc-4ea4-ad69-90f4df66f101 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:00.996369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:01.003345 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7559d3-b20d-4df1-a54f-d6e0566f137b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:01.004160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7559d3-b20d-4df1-a54f-d6e0566f137b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:01.004502 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7559d3-b20d-4df1-a54f-d6e0566f137b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:01.004779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7559d3-b20d-4df1-a54f-d6e0566f137b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:01.026328 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7559d3-b20d-4df1-a54f-d6e0566f137b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:01.035283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-7d7559d3-b20d-4df1-a54f-d6e0566f137b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:24:01.035283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:01.035283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:01.035283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:01.035283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:01.035283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:01.035283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:01.035283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:01.035283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:01.035283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:01.035283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:01.035283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:01.035283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:01.035283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:01.035283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:01.035283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:01.036269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:01.036269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:01.036269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:01.036269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:01.036269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:01.036269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:01.036269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:01.036269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:01.036269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:01.036269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:01.036269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:01.036269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:01.036269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:01.036269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:01.036269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:01.036269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:01.037534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:01.037534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:01.037534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:01.037534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:01.037534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:01.037534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:01.037534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:01.037534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:01.037534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:01.037534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:01.037534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:24:01.037534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:01.037534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 184/383] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:24:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:01.044703 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0acf7b-6162-4c9e-bc76-0140719c897d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:01.058442 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:01.186498 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0acf7b-6162-4c9e-bc76-0140719c897d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:01.224629 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37a06e-ee71-4c5c-8f10-fca20df737bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:01.225314 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37a06e-ee71-4c5c-8f10-fca20df737bc None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:01.225600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37a06e-ee71-4c5c-8f10-fca20df737bc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:01.225882 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37a06e-ee71-4c5c-8f10-fca20df737bc None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:01.226692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37a06e-ee71-4c5c-8f10-fca20df737bc None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:01.227010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37a06e-ee71-4c5c-8f10-fca20df737bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:01.228411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37a06e-ee71-4c5c-8f10-fca20df737bc None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:01.238915 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 200/384] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:24:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:01.247232 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7559d3-b20d-4df1-a54f-d6e0566f137b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:01.450586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7559d3-b20d-4df1-a54f-d6e0566f137b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:01.504281 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b8343-b00d-4e96-80c7-d2facf11cfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:01.505164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b8343-b00d-4e96-80c7-d2facf11cfe3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:01.505451 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b8343-b00d-4e96-80c7-d2facf11cfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:01.505728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b8343-b00d-4e96-80c7-d2facf11cfe3 None admin] PATH_INFO: `/v3/groups/e40d85233d924615be4669e980cbaa0a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:01.507006 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b8343-b00d-4e96-80c7-d2facf11cfe3 None admin] RBAC: Authorizing `identity:get_group(group_id=e40d85233d924615be4669e980cbaa0a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:01.508564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b8343-b00d-4e96-80c7-d2facf11cfe3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:01.510790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 185/385] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jul 14 15:24:01 2022] GET /identity/v3/groups/e40d85233d924615be4669e980cbaa0a => generated 226 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:01.515865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37a06e-ee71-4c5c-8f10-fca20df737bc None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:01.610272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:01.660517 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37a06e-ee71-4c5c-8f10-fca20df737bc None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:01.700831 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9cab0-c932-4c4e-ba0e-8b646106e084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:01.701624 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9cab0-c932-4c4e-ba0e-8b646106e084 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:01.701907 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9cab0-c932-4c4e-ba0e-8b646106e084 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:01.702226 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9cab0-c932-4c4e-ba0e-8b646106e084 None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:01.703680 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9cab0-c932-4c4e-ba0e-8b646106e084 None admin] RBAC: Authorizing `identity:get_project(project_id=4d0d3a63468d4aeba187ed301b2ea4d0)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:01.705543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9cab0-c932-4c4e-ba0e-8b646106e084 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:01.707763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 201/386] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:24:01 2022] GET /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:01.713692 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b8343-b00d-4e96-80c7-d2facf11cfe3 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:01.785171 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:01.831391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b8343-b00d-4e96-80c7-d2facf11cfe3 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:01.859104 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b357ab7-3520-4574-aabc-77401aeece52 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:01.859988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b357ab7-3520-4574-aabc-77401aeece52 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:01.861084 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b357ab7-3520-4574-aabc-77401aeece52 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:01.864099 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 202/387] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:24:01.874351 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d1bbf-127c-4a47-bd5e-01314c731299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:01.875252 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d1bbf-127c-4a47-bd5e-01314c731299 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:01.875539 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d1bbf-127c-4a47-bd5e-01314c731299 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:01.875819 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d1bbf-127c-4a47-bd5e-01314c731299 None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0/groups/e40d85233d924615be4669e980cbaa0a/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:01.877136 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29ac6c-f332-4eda-9c7a-300ed8fa4887 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:01.877651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29ac6c-f332-4eda-9c7a-300ed8fa4887 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:01.878157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29ac6c-f332-4eda-9c7a-300ed8fa4887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:01.878415 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d1bbf-127c-4a47-bd5e-01314c731299 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d0d3a63468d4aeba187ed301b2ea4d0, group_id=e40d85233d924615be4669e980cbaa0a, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:01.879909 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d1bbf-127c-4a47-bd5e-01314c731299 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:01.900282 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 186/388] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jul 14 15:24:01 2022] PUT /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0/groups/e40d85233d924615be4669e980cbaa0a/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:01.918244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ea29ac6c-f332-4eda-9c7a-300ed8fa4887 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:01.919528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ea29ac6c-f332-4eda-9c7a-300ed8fa4887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:02.036645 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 203/389] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:02.076614 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d1bbf-127c-4a47-bd5e-01314c731299 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:02.224902 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d1bbf-127c-4a47-bd5e-01314c731299 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:02.246833 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:02.269015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1b9d1-6966-4e2c-90e1-ab5fe779941c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:02.269842 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1b9d1-6966-4e2c-90e1-ab5fe779941c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:02.270165 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1b9d1-6966-4e2c-90e1-ab5fe779941c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:02.270448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1b9d1-6966-4e2c-90e1-ab5fe779941c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:02.288395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1b9d1-6966-4e2c-90e1-ab5fe779941c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:02.301488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-79a1b9d1-6966-4e2c-90e1-ab5fe779941c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:24:02.301488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:02.301488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:02.301488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:02.301488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:02.301488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:02.301488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:02.301488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:02.301488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:02.301488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:02.301488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:02.301488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:02.301488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:02.301488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:02.301488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:02.301488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:02.302519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:02.302519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:02.302519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:02.302519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:02.302519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:02.302519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:02.302519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:02.302519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:02.302519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:02.302519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:02.302519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:02.302519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:02.302519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:02.302519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:02.302519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:02.302519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:02.303800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:02.303800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:02.303800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:02.303800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:02.303800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:02.303800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:02.303800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:02.303800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:02.303800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:02.303800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:02.303800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:24:02.303800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:02.303800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 187/390] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:02.309108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29ac6c-f332-4eda-9c7a-300ed8fa4887 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:02.328875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184cec8-0521-4173-951b-32b9bbfde0cc None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:02.329348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184cec8-0521-4173-951b-32b9bbfde0cc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:02.329551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184cec8-0521-4173-951b-32b9bbfde0cc None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:02.331279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 188/391] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:24:02.342966 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50661fa-211b-46a2-88e2-5f90edbf6e99 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:02.343489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50661fa-211b-46a2-88e2-5f90edbf6e99 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:02.344025 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50661fa-211b-46a2-88e2-5f90edbf6e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:02.366381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e50661fa-211b-46a2-88e2-5f90edbf6e99 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:02.367844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e50661fa-211b-46a2-88e2-5f90edbf6e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:02.446657 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 189/392] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:24:02.469621 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50661fa-211b-46a2-88e2-5f90edbf6e99 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:02.518637 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:02.615562 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50661fa-211b-46a2-88e2-5f90edbf6e99 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:02.620027 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29ac6c-f332-4eda-9c7a-300ed8fa4887 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:02.650458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:02.698588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f650a95-ce3d-490f-b916-7f85cdf95056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:02.700098 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f650a95-ce3d-490f-b916-7f85cdf95056 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:02.701092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f650a95-ce3d-490f-b916-7f85cdf95056 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:02.701848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f650a95-ce3d-490f-b916-7f85cdf95056 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:02.703618 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e298ec9-39af-4934-bafd-480c04f9d2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:02.705450 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e298ec9-39af-4934-bafd-480c04f9d2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:02.706280 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e298ec9-39af-4934-bafd-480c04f9d2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:02.708005 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e298ec9-39af-4934-bafd-480c04f9d2b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:02.710795 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e298ec9-39af-4934-bafd-480c04f9d2b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:02.715142 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e298ec9-39af-4934-bafd-480c04f9d2b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:02.716858 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e298ec9-39af-4934-bafd-480c04f9d2b0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:02.732320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f650a95-ce3d-490f-b916-7f85cdf95056 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:02.741929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-1f650a95-ce3d-490f-b916-7f85cdf95056 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:24:02.741929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:02.741929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:02.741929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:02.741929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:02.741929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:02.741929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:02.741929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:02.741929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:02.741929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:02.741929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:02.741929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:02.741929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:02.741929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:02.741929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:02.741929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:02.742960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:02.742960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:02.742960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:02.742960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:02.742960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:02.742960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:02.742960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:02.742960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:02.742960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:02.742960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:02.742960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:02.742960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:02.742960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:02.742960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:02.742960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:02.742960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:02.743788 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:02.743788 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:02.743788 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:02.743788 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:02.743788 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:02.743788 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:02.743788 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:02.743788 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:02.743788 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:02.743788 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:02.743788 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:24:02.743788 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:02.746811 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 190/393] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:24:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:02.752148 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 204/394] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:02.753469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f650a95-ce3d-490f-b916-7f85cdf95056 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:02.756119 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e298ec9-39af-4934-bafd-480c04f9d2b0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:02.958109 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f650a95-ce3d-490f-b916-7f85cdf95056 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:02.972940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e298ec9-39af-4934-bafd-480c04f9d2b0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:03.003897 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01faffd8-817b-4886-88c0-7371b1f4b1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:03.004731 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faffd8-817b-4886-88c0-7371b1f4b1db None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:03.005113 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faffd8-817b-4886-88c0-7371b1f4b1db None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:03.005562 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01faffd8-817b-4886-88c0-7371b1f4b1db None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:03.006643 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01faffd8-817b-4886-88c0-7371b1f4b1db None admin] RBAC: Adding query filter params (name=member) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:03.007121 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01faffd8-817b-4886-88c0-7371b1f4b1db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:03.008796 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01faffd8-817b-4886-88c0-7371b1f4b1db None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:03.018844 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:03.021137 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 191/395] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:24:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:03.024072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18874f-0e9c-4cb3-a44b-1e2fc89edede None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:03.024523 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18874f-0e9c-4cb3-a44b-1e2fc89edede None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:03.024948 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18874f-0e9c-4cb3-a44b-1e2fc89edede None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:03.025063 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614938b-f471-465f-9e31-f35fbdbdcac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:03.025859 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614938b-f471-465f-9e31-f35fbdbdcac9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:03.026343 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614938b-f471-465f-9e31-f35fbdbdcac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:03.026775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614938b-f471-465f-9e31-f35fbdbdcac9 None admin] PATH_INFO: `/v3/groups/e40d85233d924615be4669e980cbaa0a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:03.028144 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614938b-f471-465f-9e31-f35fbdbdcac9 None admin] RBAC: Authorizing `identity:get_group(group_id=e40d85233d924615be4669e980cbaa0a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:03.029793 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614938b-f471-465f-9e31-f35fbdbdcac9 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:03.030895 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 192/396] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:03.032036 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18874f-0e9c-4cb3-a44b-1e2fc89edede None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:03.032363 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 205/397] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jul 14 15:24:02 2022] GET /identity/v3/groups/e40d85233d924615be4669e980cbaa0a => generated 226 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:03.034017 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ac4c3-a58c-4095-ae7f-c5acb1f85539 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:03.034643 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ac4c3-a58c-4095-ae7f-c5acb1f85539 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:03.035098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ac4c3-a58c-4095-ae7f-c5acb1f85539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:03.053860 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4e3ac4c3-a58c-4095-ae7f-c5acb1f85539 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:03.055418 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4e3ac4c3-a58c-4095-ae7f-c5acb1f85539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:03.069708 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:03.141791 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 206/398] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:24:03.143808 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ac4c3-a58c-4095-ae7f-c5acb1f85539 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:03.213320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18874f-0e9c-4cb3-a44b-1e2fc89edede None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:03.264531 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184d14e-11a6-487c-80e6-9951b2fc2f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:03.265700 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184d14e-11a6-487c-80e6-9951b2fc2f33 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:03.266165 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184d14e-11a6-487c-80e6-9951b2fc2f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:03.267097 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184d14e-11a6-487c-80e6-9951b2fc2f33 None admin] PATH_INFO: `/v3/groups/e40d85233d924615be4669e980cbaa0a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:03.268778 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184d14e-11a6-487c-80e6-9951b2fc2f33 None admin] RBAC: Authorizing `identity:get_group(group_id=e40d85233d924615be4669e980cbaa0a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:03.270535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184d14e-11a6-487c-80e6-9951b2fc2f33 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:03.272603 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 193/399] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jul 14 15:24:03 2022] GET /identity/v3/groups/e40d85233d924615be4669e980cbaa0a => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:03.273747 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184d14e-11a6-487c-80e6-9951b2fc2f33 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:03.280250 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ac4c3-a58c-4095-ae7f-c5acb1f85539 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:03.323945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:03.333433 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da96ca-ccbc-406d-bbec-61cd73eca13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:03.334350 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da96ca-ccbc-406d-bbec-61cd73eca13b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:03.334639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da96ca-ccbc-406d-bbec-61cd73eca13b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:03.334915 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da96ca-ccbc-406d-bbec-61cd73eca13b None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:03.336354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da96ca-ccbc-406d-bbec-61cd73eca13b None admin] RBAC: Authorizing `identity:get_project(project_id=4d0d3a63468d4aeba187ed301b2ea4d0)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:03.338640 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da96ca-ccbc-406d-bbec-61cd73eca13b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:03.341819 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 207/400] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:24:03 2022] GET /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:03.343128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da96ca-ccbc-406d-bbec-61cd73eca13b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:03.389907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:03.394770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184d14e-11a6-487c-80e6-9951b2fc2f33 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:03.450190 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73b40a-529a-4bab-9f29-eac70d116067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:03.451479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73b40a-529a-4bab-9f29-eac70d116067 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:03.451983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73b40a-529a-4bab-9f29-eac70d116067 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:03.452487 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73b40a-529a-4bab-9f29-eac70d116067 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:03.461988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da96ca-ccbc-406d-bbec-61cd73eca13b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:03.471029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73b40a-529a-4bab-9f29-eac70d116067 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:03.480518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-fe73b40a-529a-4bab-9f29-eac70d116067 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:24:03.480518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:03.480518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:03.480518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:03.480518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:03.480518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:03.480518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:03.480518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:03.480518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:03.480518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:03.480518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:03.480518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:03.480518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:03.480518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:03.480518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:03.480518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:03.481528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:03.481528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:03.481528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:03.481528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:03.481528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:03.481528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:03.481528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:03.481528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:03.481528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:03.481528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:03.481528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:03.481528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:03.481528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:03.481528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:03.481528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:03.481528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:03.482477 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:03.482477 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:03.482477 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:03.482477 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:03.482477 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:03.482477 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:03.482477 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:03.482477 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:03.482477 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:03.482477 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:03.482477 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:24:03.482477 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:03.482477 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 194/401] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:03.487249 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73b40a-529a-4bab-9f29-eac70d116067 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:03.513122 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0582325-933e-445c-9b12-9f364bb3c295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:03.514423 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0582325-933e-445c-9b12-9f364bb3c295 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:03.514837 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0582325-933e-445c-9b12-9f364bb3c295 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:03.515185 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0582325-933e-445c-9b12-9f364bb3c295 None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:03.516459 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0582325-933e-445c-9b12-9f364bb3c295 None admin] RBAC: Authorizing `identity:get_project(project_id=c02407b0147e4d3e9acde0d88630dd1c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:03.519592 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0582325-933e-445c-9b12-9f364bb3c295 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:03.522060 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 208/402] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:24:03 2022] GET /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:03.523608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4cd6d-b18a-40fd-a711-6c6cfc82afd6 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:03.524204 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4cd6d-b18a-40fd-a711-6c6cfc82afd6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:03.524703 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4cd6d-b18a-40fd-a711-6c6cfc82afd6 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:03.526304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 209/403] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:03.527301 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4cd6d-b18a-40fd-a711-6c6cfc82afd6 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:03.621152 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:03.626924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73b40a-529a-4bab-9f29-eac70d116067 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:03.674194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130f768-0cb6-49c3-95dc-01a31394794d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:03.675192 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130f768-0cb6-49c3-95dc-01a31394794d None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:03.675470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130f768-0cb6-49c3-95dc-01a31394794d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:03.675745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130f768-0cb6-49c3-95dc-01a31394794d None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0/groups/e40d85233d924615be4669e980cbaa0a/roles/26bfea3cd8164feeb8043fd508a5268c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:03.676379 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4cd6d-b18a-40fd-a711-6c6cfc82afd6 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:03.678126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130f768-0cb6-49c3-95dc-01a31394794d None admin] RBAC: Authorizing `identity:create_grant(project_id=4d0d3a63468d4aeba187ed301b2ea4d0, group_id=e40d85233d924615be4669e980cbaa0a, role_id=26bfea3cd8164feeb8043fd508a5268c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:03.680025 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130f768-0cb6-49c3-95dc-01a31394794d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:03.703387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 195/404] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jul 14 15:24:03 2022] PUT /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0/groups/e40d85233d924615be4669e980cbaa0a/roles/26bfea3cd8164feeb8043fd508a5268c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:03.703387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130f768-0cb6-49c3-95dc-01a31394794d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:03.716972 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211d62f-d16f-4bfc-89a8-69b3f8115b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:03.717705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211d62f-d16f-4bfc-89a8-69b3f8115b34 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:03.718058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211d62f-d16f-4bfc-89a8-69b3f8115b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:03.718386 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211d62f-d16f-4bfc-89a8-69b3f8115b34 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:03.719276 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211d62f-d16f-4bfc-89a8-69b3f8115b34 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:03.719593 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211d62f-d16f-4bfc-89a8-69b3f8115b34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:03.721308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211d62f-d16f-4bfc-89a8-69b3f8115b34 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:03.736175 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 210/405] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:03.738384 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da31b6c-c99c-43e9-b965-17e3dc7932e1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:03.738859 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da31b6c-c99c-43e9-b965-17e3dc7932e1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:03.739347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da31b6c-c99c-43e9-b965-17e3dc7932e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:03.741280 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:03.758649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8da31b6c-c99c-43e9-b965-17e3dc7932e1 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:03.760007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8da31b6c-c99c-43e9-b965-17e3dc7932e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:03.844080 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130f768-0cb6-49c3-95dc-01a31394794d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:03.871116 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 211/406] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:03.878108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da31b6c-c99c-43e9-b965-17e3dc7932e1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:03.910652 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d359e-6cce-49ec-a46a-3ba70e5a49bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:03.911749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d359e-6cce-49ec-a46a-3ba70e5a49bf None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:03.912037 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d359e-6cce-49ec-a46a-3ba70e5a49bf None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:03.912315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d359e-6cce-49ec-a46a-3ba70e5a49bf None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c/groups/e40d85233d924615be4669e980cbaa0a/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:03.914352 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d359e-6cce-49ec-a46a-3ba70e5a49bf None admin] RBAC: Authorizing `identity:create_grant(project_id=c02407b0147e4d3e9acde0d88630dd1c, group_id=e40d85233d924615be4669e980cbaa0a, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:03.916017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d359e-6cce-49ec-a46a-3ba70e5a49bf None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:03.937793 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 196/407] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jul 14 15:24:03 2022] PUT /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c/groups/e40d85233d924615be4669e980cbaa0a/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:03.940381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d359e-6cce-49ec-a46a-3ba70e5a49bf None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:03.971494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:04.067796 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da31b6c-c99c-43e9-b965-17e3dc7932e1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:04.074485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:04.115488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d359e-6cce-49ec-a46a-3ba70e5a49bf None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:04.120019 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d08d0-736a-41e7-9c5b-64723ce25068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:04.121033 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d08d0-736a-41e7-9c5b-64723ce25068 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.121326 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d08d0-736a-41e7-9c5b-64723ce25068 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.121656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d08d0-736a-41e7-9c5b-64723ce25068 None admin] PATH_INFO: `/v3/groups/e40d85233d924615be4669e980cbaa0a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.123280 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d08d0-736a-41e7-9c5b-64723ce25068 None admin] RBAC: Authorizing `identity:get_group(group_id=e40d85233d924615be4669e980cbaa0a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:04.124785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d08d0-736a-41e7-9c5b-64723ce25068 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:04.132982 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 212/408] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jul 14 15:24:03 2022] GET /identity/v3/groups/e40d85233d924615be4669e980cbaa0a => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:04.139350 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d08d0-736a-41e7-9c5b-64723ce25068 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:04.198579 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ed972-7b24-4744-a9a6-9c0f3936a3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:04.199978 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ed972-7b24-4744-a9a6-9c0f3936a3cd None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.200484 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ed972-7b24-4744-a9a6-9c0f3936a3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.200968 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ed972-7b24-4744-a9a6-9c0f3936a3cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.215957 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ed972-7b24-4744-a9a6-9c0f3936a3cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:04.226780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-846ed972-7b24-4744-a9a6-9c0f3936a3cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:04.226780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:04.226780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:04.226780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:04.226780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:04.226780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:04.226780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:04.226780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:04.226780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:04.226780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:04.226780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:04.226780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:04.226780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:04.226780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:04.226780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:04.226780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:04.227732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:04.227732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:04.227732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:04.227732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:04.227732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:04.227732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:04.227732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:04.227732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:04.227732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:04.227732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:04.227732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:04.227732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:04.227732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:04.227732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:04.227732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:04.227732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:04.228555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:04.228555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:04.228555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:04.228555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:04.228555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:04.228555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:04.228555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:04.228555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:04.228555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:04.228555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:04.228555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:04.228555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:04.233593 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 197/409] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:24:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:04.240786 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ed972-7b24-4744-a9a6-9c0f3936a3cd None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:04.292657 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d08d0-736a-41e7-9c5b-64723ce25068 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:04.321228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:04.347034 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce8cd3-44f6-4440-8794-3ab7ca305332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:04.348043 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce8cd3-44f6-4440-8794-3ab7ca305332 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.348337 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce8cd3-44f6-4440-8794-3ab7ca305332 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.348620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce8cd3-44f6-4440-8794-3ab7ca305332 None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.353047 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce8cd3-44f6-4440-8794-3ab7ca305332 None admin] RBAC: Authorizing `identity:get_project(project_id=c02407b0147e4d3e9acde0d88630dd1c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:04.354634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce8cd3-44f6-4440-8794-3ab7ca305332 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:04.356766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 213/410] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:24:04 2022] GET /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:04.365981 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce8cd3-44f6-4440-8794-3ab7ca305332 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:04.387637 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ed972-7b24-4744-a9a6-9c0f3936a3cd None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:04.431510 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d55d9-0eb2-445f-8c53-81e105974f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:04.432494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d55d9-0eb2-445f-8c53-81e105974f77 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.432932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d55d9-0eb2-445f-8c53-81e105974f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.433348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d55d9-0eb2-445f-8c53-81e105974f77 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.434330 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d55d9-0eb2-445f-8c53-81e105974f77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:04.434788 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d55d9-0eb2-445f-8c53-81e105974f77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:04.436343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d55d9-0eb2-445f-8c53-81e105974f77 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:04.448162 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 198/411] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:24:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:04.454054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d55d9-0eb2-445f-8c53-81e105974f77 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:04.458190 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:04.531754 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce8cd3-44f6-4440-8794-3ab7ca305332 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:04.571278 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d55d9-0eb2-445f-8c53-81e105974f77 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:04.571492 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519dda7-7e63-40b3-b40e-a2eeae664836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:04.572227 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519dda7-7e63-40b3-b40e-a2eeae664836 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.572512 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519dda7-7e63-40b3-b40e-a2eeae664836 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.572791 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519dda7-7e63-40b3-b40e-a2eeae664836 None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c/groups/e40d85233d924615be4669e980cbaa0a/roles/26bfea3cd8164feeb8043fd508a5268c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.575307 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519dda7-7e63-40b3-b40e-a2eeae664836 None admin] RBAC: Authorizing `identity:create_grant(project_id=c02407b0147e4d3e9acde0d88630dd1c, group_id=e40d85233d924615be4669e980cbaa0a, role_id=26bfea3cd8164feeb8043fd508a5268c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:04.576954 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519dda7-7e63-40b3-b40e-a2eeae664836 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:04.592600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 214/412] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jul 14 15:24:04 2022] PUT /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c/groups/e40d85233d924615be4669e980cbaa0a/roles/26bfea3cd8164feeb8043fd508a5268c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:04.594501 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ef664-82a7-4154-8db9-3466da8af777 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.595657 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ef664-82a7-4154-8db9-3466da8af777 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.596355 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ef664-82a7-4154-8db9-3466da8af777 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.598239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 215/413] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:04.604892 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c7451-4aba-4ec6-aab6-3f39e74fee37 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.605831 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c7451-4aba-4ec6-aab6-3f39e74fee37 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.606398 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c7451-4aba-4ec6-aab6-3f39e74fee37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.629132 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8e3c7451-4aba-4ec6-aab6-3f39e74fee37 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:04.630811 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8e3c7451-4aba-4ec6-aab6-3f39e74fee37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:04.635810 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f8140-f6ac-4814-8576-b71c4cd23a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:04.636774 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f8140-f6ac-4814-8576-b71c4cd23a35 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.637073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f8140-f6ac-4814-8576-b71c4cd23a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.637455 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f8140-f6ac-4814-8576-b71c4cd23a35 None admin] PATH_INFO: `/v3/groups/9b2dc6a4ab354140a11891f4bf39a33e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.638821 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f8140-f6ac-4814-8576-b71c4cd23a35 None admin] RBAC: Authorizing `identity:get_group(group_id=9b2dc6a4ab354140a11891f4bf39a33e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:04.640322 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f8140-f6ac-4814-8576-b71c4cd23a35 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:04.651464 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 199/414] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jul 14 15:24:04 2022] GET /identity/v3/groups/9b2dc6a4ab354140a11891f4bf39a33e => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:04.661127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f8140-f6ac-4814-8576-b71c4cd23a35 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:04.704946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:04.738588 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 216/415] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:04.795727 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c7451-4aba-4ec6-aab6-3f39e74fee37 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:04.810452 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:04.879813 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f8140-f6ac-4814-8576-b71c4cd23a35 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:04.937689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239de03-b8e3-4cfb-bb48-aa264547b000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:04.960110 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c7451-4aba-4ec6-aab6-3f39e74fee37 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:04.963545 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239de03-b8e3-4cfb-bb48-aa264547b000 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:04.963794 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239de03-b8e3-4cfb-bb48-aa264547b000 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:04.964045 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239de03-b8e3-4cfb-bb48-aa264547b000 None admin] PATH_INFO: `/v3/projects/758a2be557ed4a1ab6684561497d3b7f` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:04.965870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239de03-b8e3-4cfb-bb48-aa264547b000 None admin] RBAC: Authorizing `identity:get_project(project_id=758a2be557ed4a1ab6684561497d3b7f)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:04.967073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239de03-b8e3-4cfb-bb48-aa264547b000 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:04.969323 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 200/416] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:24:04 2022] GET /identity/v3/projects/758a2be557ed4a1ab6684561497d3b7f => generated 344 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:04.979534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239de03-b8e3-4cfb-bb48-aa264547b000 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:05.007019 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36afb94-88d6-4e4b-8208-e5591d1ede92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:05.008215 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36afb94-88d6-4e4b-8208-e5591d1ede92 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:05.008725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36afb94-88d6-4e4b-8208-e5591d1ede92 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:05.009486 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36afb94-88d6-4e4b-8208-e5591d1ede92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:05.024855 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36afb94-88d6-4e4b-8208-e5591d1ede92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:05.035428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-c36afb94-88d6-4e4b-8208-e5591d1ede92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:24:05.035428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:05.035428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:05.035428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:05.035428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:05.035428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:05.035428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:05.035428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:05.035428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:05.035428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:05.035428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:05.035428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:05.035428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:05.035428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:05.035428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:05.035428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:05.036620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:05.036620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:05.036620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:05.036620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:05.036620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:05.036620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:05.036620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:05.036620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:05.036620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:05.036620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:05.036620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:05.036620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:05.036620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:05.036620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:05.036620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:05.036620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:05.037668 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:05.037668 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:05.037668 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:05.037668 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:05.037668 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:05.037668 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:05.037668 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:05.037668 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:05.037668 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:05.037668 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:05.037668 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:24:05.037668 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:05.040440 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 217/417] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:24:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:05.049069 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36afb94-88d6-4e4b-8208-e5591d1ede92 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:05.111017 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:05.166095 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36afb94-88d6-4e4b-8208-e5591d1ede92 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:05.206097 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3310ce-ae58-4c61-9913-55b3ec72a467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:05.207284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3310ce-ae58-4c61-9913-55b3ec72a467 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:05.207784 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3310ce-ae58-4c61-9913-55b3ec72a467 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:05.208275 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3310ce-ae58-4c61-9913-55b3ec72a467 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:05.209249 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3310ce-ae58-4c61-9913-55b3ec72a467 None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:05.209806 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3310ce-ae58-4c61-9913-55b3ec72a467 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:05.211473 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3310ce-ae58-4c61-9913-55b3ec72a467 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:05.222781 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 218/418] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:24:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:05.228717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3310ce-ae58-4c61-9913-55b3ec72a467 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:05.244092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239de03-b8e3-4cfb-bb48-aa264547b000 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:05.320530 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b93631-c595-4aa1-a120-c5ac5487fcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:05.321364 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b93631-c595-4aa1-a120-c5ac5487fcba None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:05.321654 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b93631-c595-4aa1-a120-c5ac5487fcba None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:05.321936 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b93631-c595-4aa1-a120-c5ac5487fcba None admin] PATH_INFO: `/v3/projects/758a2be557ed4a1ab6684561497d3b7f/groups/9b2dc6a4ab354140a11891f4bf39a33e/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:05.326940 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b93631-c595-4aa1-a120-c5ac5487fcba None admin] RBAC: Authorizing `identity:create_grant(project_id=758a2be557ed4a1ab6684561497d3b7f, group_id=9b2dc6a4ab354140a11891f4bf39a33e, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:05.328511 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b93631-c595-4aa1-a120-c5ac5487fcba None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:05.350035 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:05.357165 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 201/419] 10.222.0.39 () {58 vars in 1442 bytes} [Thu Jul 14 15:24:04 2022] PUT /identity/v3/projects/758a2be557ed4a1ab6684561497d3b7f/groups/9b2dc6a4ab354140a11891f4bf39a33e/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:05.418386 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3310ce-ae58-4c61-9913-55b3ec72a467 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:05.426425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:05.480064 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956dfec-e651-4774-beb1-dfd03c079acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:05.480750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956dfec-e651-4774-beb1-dfd03c079acb None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:05.481039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956dfec-e651-4774-beb1-dfd03c079acb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:05.481320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956dfec-e651-4774-beb1-dfd03c079acb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:05.583691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956dfec-e651-4774-beb1-dfd03c079acb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:05.585096 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956dfec-e651-4774-beb1-dfd03c079acb None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:05.714906 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 219/420] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:24:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:05.721395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b93631-c595-4aa1-a120-c5ac5487fcba None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:05.871707 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b93631-c595-4aa1-a120-c5ac5487fcba None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:05.924697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf5c17-c54e-4c63-a7f7-9de1720886d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:05.925579 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf5c17-c54e-4c63-a7f7-9de1720886d1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:05.925904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf5c17-c54e-4c63-a7f7-9de1720886d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:05.926215 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf5c17-c54e-4c63-a7f7-9de1720886d1 None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:05.927505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf5c17-c54e-4c63-a7f7-9de1720886d1 None admin] RBAC: Authorizing `identity:get_project(project_id=4d0d3a63468d4aeba187ed301b2ea4d0)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:05.928999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf5c17-c54e-4c63-a7f7-9de1720886d1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:05.930791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 202/421] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:24:05 2022] GET /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:05.937051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956dfec-e651-4774-beb1-dfd03c079acb None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:05.940472 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:06.084366 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956dfec-e651-4774-beb1-dfd03c079acb None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:06.130063 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f720c3-d904-4f79-9b0e-2f41d3698d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:06.131425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f720c3-d904-4f79-9b0e-2f41d3698d76 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:06.131969 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f720c3-d904-4f79-9b0e-2f41d3698d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:06.132455 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f720c3-d904-4f79-9b0e-2f41d3698d76 None admin] PATH_INFO: `/v3/groups/e40d85233d924615be4669e980cbaa0a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:06.134181 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f720c3-d904-4f79-9b0e-2f41d3698d76 None admin] RBAC: Authorizing `identity:get_group(group_id=e40d85233d924615be4669e980cbaa0a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:06.135893 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f720c3-d904-4f79-9b0e-2f41d3698d76 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:06.138376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 220/422] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jul 14 15:24:05 2022] GET /identity/v3/groups/e40d85233d924615be4669e980cbaa0a => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:06.146096 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf5c17-c54e-4c63-a7f7-9de1720886d1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:06.262215 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:06.312368 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf5c17-c54e-4c63-a7f7-9de1720886d1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:06.363432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fbdc3f-b474-4691-bc63-d62870f00a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:06.364096 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbdc3f-b474-4691-bc63-d62870f00a96 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:06.364387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbdc3f-b474-4691-bc63-d62870f00a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:06.364663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fbdc3f-b474-4691-bc63-d62870f00a96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:06.365506 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fbdc3f-b474-4691-bc63-d62870f00a96 None admin] RBAC: Adding query filter params (group.id=e40d85233d924615be4669e980cbaa0a, role.id=d98d81dd45ce4c4095c99ee0de89aab3, scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:06.365815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fbdc3f-b474-4691-bc63-d62870f00a96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:06.367286 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fbdc3f-b474-4691-bc63-d62870f00a96 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:06.379903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 203/423] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jul 14 15:24:06 2022] GET /identity/v3/role_assignments?group.id=e40d85233d924615be4669e980cbaa0a&scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0&role.id=d98d81dd45ce4c4095c99ee0de89aab3 => generated 611 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:06.612795 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf90eb8-76b6-4051-9951-f2d918a5199c None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:06.613394 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf90eb8-76b6-4051-9951-f2d918a5199c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:06.613394 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf90eb8-76b6-4051-9951-f2d918a5199c None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:06.615163 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 221/424] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:06.621757 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267da3a-a4ce-4b73-b2d9-6810205655f2 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:06.622268 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267da3a-a4ce-4b73-b2d9-6810205655f2 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:06.622708 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267da3a-a4ce-4b73-b2d9-6810205655f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:06.648640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a267da3a-a4ce-4b73-b2d9-6810205655f2 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:06.649879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a267da3a-a4ce-4b73-b2d9-6810205655f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:06.721850 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef924a-ac1a-4753-8659-83f62f164506 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:06.722180 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef924a-ac1a-4753-8659-83f62f164506 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:06.722397 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef924a-ac1a-4753-8659-83f62f164506 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:06.724027 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 222/425] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:06.729177 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a9374-6deb-4668-814f-04203ec7c4bb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:06.729454 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a9374-6deb-4668-814f-04203ec7c4bb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:06.729731 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a9374-6deb-4668-814f-04203ec7c4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:06.745251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 204/426] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:06.754839 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d45a9374-6deb-4668-814f-04203ec7c4bb None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:06.756176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d45a9374-6deb-4668-814f-04203ec7c4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:06.781001 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267da3a-a4ce-4b73-b2d9-6810205655f2 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:06.836205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 223/427] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:24:06.861906 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a9374-6deb-4668-814f-04203ec7c4bb None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:06.867430 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:06.886920 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:06.921139 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267da3a-a4ce-4b73-b2d9-6810205655f2 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:06.965861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df499e1-2143-40bb-922d-c1887967b0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:06.966549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df499e1-2143-40bb-922d-c1887967b0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:06.966837 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df499e1-2143-40bb-922d-c1887967b0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:06.967115 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df499e1-2143-40bb-922d-c1887967b0d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:06.988113 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df499e1-2143-40bb-922d-c1887967b0d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:06.996818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-1df499e1-2143-40bb-922d-c1887967b0d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:24:06.996818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:06.996818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:06.996818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:06.996818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:06.996818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:06.996818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:06.996818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:06.996818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:06.996818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:06.996818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:06.996818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:06.996818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:06.996818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:06.996818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:06.996818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:06.997848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:06.997848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:06.997848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:06.997848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:06.997848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:06.997848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:06.997848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:06.997848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:06.997848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:06.997848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:06.997848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:06.997848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:06.997848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:06.997848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:06.997848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:06.997848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:06.998689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:06.998689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:06.998689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:06.998689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:06.998689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:06.998689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:06.998689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:06.998689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:06.998689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:06.998689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:06.998689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:24:06.998689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:06.999304 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 205/428] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:07.007488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df499e1-2143-40bb-922d-c1887967b0d6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:07.040405 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a9374-6deb-4668-814f-04203ec7c4bb None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:07.100294 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b352404-ed39-4330-a7ec-73812de6d3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:07.100294 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b352404-ed39-4330-a7ec-73812de6d3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:07.100678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b352404-ed39-4330-a7ec-73812de6d3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:07.101036 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b352404-ed39-4330-a7ec-73812de6d3a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:07.116837 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b352404-ed39-4330-a7ec-73812de6d3a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:07.127889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-0b352404-ed39-4330-a7ec-73812de6d3a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:24:07.127889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:07.127889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:07.127889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:07.127889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:07.127889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:07.127889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:07.127889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:07.127889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:07.127889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:07.127889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:07.127889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:07.127889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:07.127889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:07.127889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:07.127889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:07.128871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:07.128871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:07.128871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:07.128871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:07.128871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:07.128871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:07.128871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:07.128871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:07.128871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:07.128871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:07.128871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:07.128871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:07.128871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:07.128871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:07.128871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:07.128871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:07.129705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:07.129705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:07.129705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:07.129705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:07.129705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:07.129705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:07.129705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:07.129705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:07.129705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:07.129705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:07.129705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 15:24:07.129705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:07.129705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 224/429] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:24:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:07.140722 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b352404-ed39-4330-a7ec-73812de6d3a9 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:07.184230 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df499e1-2143-40bb-922d-c1887967b0d6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:07.213518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:07.233988 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07650e5b-e0ae-4111-8160-534a38e69057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:07.235222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07650e5b-e0ae-4111-8160-534a38e69057 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:07.236077 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07650e5b-e0ae-4111-8160-534a38e69057 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:07.236292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07650e5b-e0ae-4111-8160-534a38e69057 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:07.238748 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07650e5b-e0ae-4111-8160-534a38e69057 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:07.239018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07650e5b-e0ae-4111-8160-534a38e69057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:07.240110 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:07.243186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07650e5b-e0ae-4111-8160-534a38e69057 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:07.254469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 206/430] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:07.260814 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07650e5b-e0ae-4111-8160-534a38e69057 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:07.292580 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b352404-ed39-4330-a7ec-73812de6d3a9 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:07.331964 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbb563-6f26-4071-a45a-1383bc615cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:07.332677 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbb563-6f26-4071-a45a-1383bc615cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:07.332957 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbb563-6f26-4071-a45a-1383bc615cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:07.333234 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbb563-6f26-4071-a45a-1383bc615cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:07.334130 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbb563-6f26-4071-a45a-1383bc615cb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:07.334449 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbb563-6f26-4071-a45a-1383bc615cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:07.335978 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbb563-6f26-4071-a45a-1383bc615cb1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:07.347108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 225/431] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:24:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:07.352660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbb563-6f26-4071-a45a-1383bc615cb1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:07.413317 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07650e5b-e0ae-4111-8160-534a38e69057 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:07.464087 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f6643-16f4-4150-afae-c36c2b298f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:07.464302 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f6643-16f4-4150-afae-c36c2b298f1d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:07.466503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f6643-16f4-4150-afae-c36c2b298f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:07.466503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f6643-16f4-4150-afae-c36c2b298f1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:07.501400 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbb563-6f26-4071-a45a-1383bc615cb1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:07.533576 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:07.534003 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:07.550099 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3de155-d4a2-4edc-811f-f138be734c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:07.551319 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3de155-d4a2-4edc-811f-f138be734c42 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:07.551776 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3de155-d4a2-4edc-811f-f138be734c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:07.552254 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3de155-d4a2-4edc-811f-f138be734c42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:07.555897 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f6643-16f4-4150-afae-c36c2b298f1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:07.557392 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f6643-16f4-4150-afae-c36c2b298f1d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:07.647905 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3de155-d4a2-4edc-811f-f138be734c42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:07.650407 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3de155-d4a2-4edc-811f-f138be734c42 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:07.694379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 207/432] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:24:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:07.696311 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a1b39-2767-4a4e-a595-a475b795d3cc None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:07.696814 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a1b39-2767-4a4e-a595-a475b795d3cc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:07.697316 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a1b39-2767-4a4e-a595-a475b795d3cc None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:07.698883 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 208/433] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:07.699794 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a1b39-2767-4a4e-a595-a475b795d3cc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:07.805083 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:07.835886 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 226/434] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:24:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 15:24:07.835886 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b20490-e2a3-4b91-a7b2-f886d4abfd54 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:07.835886 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b20490-e2a3-4b91-a7b2-f886d4abfd54 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:07.835886 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b20490-e2a3-4b91-a7b2-f886d4abfd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:07.837298 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a1b39-2767-4a4e-a595-a475b795d3cc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:07.854837 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-94b20490-e2a3-4b91-a7b2-f886d4abfd54 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:07.856034 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-94b20490-e2a3-4b91-a7b2-f886d4abfd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:07.887029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:07.888486 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9256f62-272a-45c4-a13d-1ca2a8fd40b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:07.889280 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9256f62-272a-45c4-a13d-1ca2a8fd40b1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:07.889540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9256f62-272a-45c4-a13d-1ca2a8fd40b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:07.889949 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9256f62-272a-45c4-a13d-1ca2a8fd40b1 None admin] PATH_INFO: `/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:07.891303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9256f62-272a-45c4-a13d-1ca2a8fd40b1 None admin] RBAC: Authorizing `identity:get_project(project_id=4d0d3a63468d4aeba187ed301b2ea4d0)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:07.893303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9256f62-272a-45c4-a13d-1ca2a8fd40b1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:07.895337 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 209/435] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:24:07 2022] GET /identity/v3/projects/4d0d3a63468d4aeba187ed301b2ea4d0 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:07.902538 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9256f62-272a-45c4-a13d-1ca2a8fd40b1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:07.966429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 227/436] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:07.967777 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b20490-e2a3-4b91-a7b2-f886d4abfd54 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:08.072477 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9256f62-272a-45c4-a13d-1ca2a8fd40b1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:08.105424 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b20490-e2a3-4b91-a7b2-f886d4abfd54 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:08.109291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bcbdd-d3e9-4806-b7f5-bac9a8ce2cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:08.110210 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bcbdd-d3e9-4806-b7f5-bac9a8ce2cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:08.111109 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bcbdd-d3e9-4806-b7f5-bac9a8ce2cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:08.111380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810bcbdd-d3e9-4806-b7f5-bac9a8ce2cb5 None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:08.112741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810bcbdd-d3e9-4806-b7f5-bac9a8ce2cb5 None admin] RBAC: Authorizing `identity:get_project(project_id=c02407b0147e4d3e9acde0d88630dd1c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:08.114211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810bcbdd-d3e9-4806-b7f5-bac9a8ce2cb5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:08.116676 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 210/437] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:24:07 2022] GET /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:08.122273 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bcbdd-d3e9-4806-b7f5-bac9a8ce2cb5 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:08.147227 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89fad9-1317-4542-a3a9-aaa26b0a189c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:08.148160 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89fad9-1317-4542-a3a9-aaa26b0a189c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:08.148437 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89fad9-1317-4542-a3a9-aaa26b0a189c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:08.148717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89fad9-1317-4542-a3a9-aaa26b0a189c None admin] PATH_INFO: `/v3/groups/e40d85233d924615be4669e980cbaa0a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:08.149960 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89fad9-1317-4542-a3a9-aaa26b0a189c None admin] RBAC: Authorizing `identity:get_group(group_id=e40d85233d924615be4669e980cbaa0a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:08.151590 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:08.153572 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89fad9-1317-4542-a3a9-aaa26b0a189c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:08.162986 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 228/438] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jul 14 15:24:07 2022] GET /identity/v3/groups/e40d85233d924615be4669e980cbaa0a => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:08.162986 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89fad9-1317-4542-a3a9-aaa26b0a189c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:08.189843 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:08.253325 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810bcbdd-d3e9-4806-b7f5-bac9a8ce2cb5 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:08.285651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89fad9-1317-4542-a3a9-aaa26b0a189c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:08.290750 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a1626-4292-4e12-af73-34c56314b76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:08.291558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a1626-4292-4e12-af73-34c56314b76e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:08.291910 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a1626-4292-4e12-af73-34c56314b76e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:08.292117 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a1626-4292-4e12-af73-34c56314b76e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:08.307107 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a1626-4292-4e12-af73-34c56314b76e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:08.315475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-3b9a1626-4292-4e12-af73-34c56314b76e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:24:08.315475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:08.315475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:08.315475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:08.315475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:08.315475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:08.315475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:08.315475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:08.315475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:08.315475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:08.315475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:08.315475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:08.315475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:08.315475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:08.315475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:08.315475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:08.316475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:08.316475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:08.316475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:08.316475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:08.316475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:08.316475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:08.316475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:08.316475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:08.316475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:08.316475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:08.316475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:08.316475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:08.316475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:08.316475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:08.316475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:08.316475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:08.317275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:08.317275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:08.317275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:08.317275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:08.317275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:08.317275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:08.317275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:08.317275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:08.317275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:08.317275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:08.317275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:24:08.317275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:08.317275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 211/439] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:08.317938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a1626-4292-4e12-af73-34c56314b76e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:08.338962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb62e7-a516-4d80-a08e-3399e3fb12e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:08.339720 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb62e7-a516-4d80-a08e-3399e3fb12e7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:08.340002 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb62e7-a516-4d80-a08e-3399e3fb12e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:08.340285 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb62e7-a516-4d80-a08e-3399e3fb12e7 None admin] PATH_INFO: `/v3/groups/e40d85233d924615be4669e980cbaa0a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:08.341537 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb62e7-a516-4d80-a08e-3399e3fb12e7 None admin] RBAC: Authorizing `identity:get_group(group_id=e40d85233d924615be4669e980cbaa0a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:08.344344 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb62e7-a516-4d80-a08e-3399e3fb12e7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:08.348227 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 229/440] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jul 14 15:24:08 2022] GET /identity/v3/groups/e40d85233d924615be4669e980cbaa0a => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:08.348227 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e50ab-917b-47b7-969f-9be8c88d46f1 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:08.348227 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e50ab-917b-47b7-969f-9be8c88d46f1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:08.348227 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e50ab-917b-47b7-969f-9be8c88d46f1 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:08.348227 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 230/441] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:08.354935 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e50ab-917b-47b7-969f-9be8c88d46f1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:08.437156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:08.461233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a1626-4292-4e12-af73-34c56314b76e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:08.464172 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:08.478275 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e50ab-917b-47b7-969f-9be8c88d46f1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:08.502429 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0936e-65d2-42f0-a0a8-fe066613e7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:08.503098 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0936e-65d2-42f0-a0a8-fe066613e7ca None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:08.503394 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0936e-65d2-42f0-a0a8-fe066613e7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:08.503674 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0936e-65d2-42f0-a0a8-fe066613e7ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:08.504526 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0936e-65d2-42f0-a0a8-fe066613e7ca None admin] RBAC: Adding query filter params (group.id=e40d85233d924615be4669e980cbaa0a, role.id=26bfea3cd8164feeb8043fd508a5268c, scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:08.504853 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0936e-65d2-42f0-a0a8-fe066613e7ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:08.506545 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0936e-65d2-42f0-a0a8-fe066613e7ca None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:08.513295 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 212/442] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jul 14 15:24:08 2022] GET /identity/v3/role_assignments?group.id=e40d85233d924615be4669e980cbaa0a&scope.project.id=4d0d3a63468d4aeba187ed301b2ea4d0&role.id=26bfea3cd8164feeb8043fd508a5268c => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:08.514443 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0936e-65d2-42f0-a0a8-fe066613e7ca None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:08.515420 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70535ba4-4615-426f-ad96-abe993b1cfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:08.516122 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70535ba4-4615-426f-ad96-abe993b1cfa3 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:08.516405 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70535ba4-4615-426f-ad96-abe993b1cfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:08.516788 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70535ba4-4615-426f-ad96-abe993b1cfa3 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:08.517990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70535ba4-4615-426f-ad96-abe993b1cfa3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:08.518477 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70535ba4-4615-426f-ad96-abe993b1cfa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:08.519965 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70535ba4-4615-426f-ad96-abe993b1cfa3 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:08.530465 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 231/443] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:08.531944 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba352fa0-0391-4ba5-87dd-b214da4ed39a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:08.532758 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba352fa0-0391-4ba5-87dd-b214da4ed39a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:08.533042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba352fa0-0391-4ba5-87dd-b214da4ed39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:08.555313 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ba352fa0-0391-4ba5-87dd-b214da4ed39a None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:08.557293 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ba352fa0-0391-4ba5-87dd-b214da4ed39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:08.655763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 232/444] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:08.658877 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba352fa0-0391-4ba5-87dd-b214da4ed39a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:08.685340 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0936e-65d2-42f0-a0a8-fe066613e7ca None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:08.751690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6871574-c76d-44c2-8f30-759ff0e55b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:08.753077 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6871574-c76d-44c2-8f30-759ff0e55b56 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:08.753796 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6871574-c76d-44c2-8f30-759ff0e55b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:08.754355 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6871574-c76d-44c2-8f30-759ff0e55b56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:08.757314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6871574-c76d-44c2-8f30-759ff0e55b56 None admin] RBAC: Adding query filter params (group.id=e40d85233d924615be4669e980cbaa0a, role.id=d98d81dd45ce4c4095c99ee0de89aab3, scope.project.id=c02407b0147e4d3e9acde0d88630dd1c) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:08.757854 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6871574-c76d-44c2-8f30-759ff0e55b56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:08.760087 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6871574-c76d-44c2-8f30-759ff0e55b56 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:08.768429 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 213/445] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jul 14 15:24:08 2022] GET /identity/v3/role_assignments?group.id=e40d85233d924615be4669e980cbaa0a&scope.project.id=c02407b0147e4d3e9acde0d88630dd1c&role.id=d98d81dd45ce4c4095c99ee0de89aab3 => generated 611 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:08.769565 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6871574-c76d-44c2-8f30-759ff0e55b56 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:08.785587 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:08.788209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:08.817145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba352fa0-0391-4ba5-87dd-b214da4ed39a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:08.871684 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d29e57-8965-40c6-bea7-85087f03ef98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:08.871684 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d29e57-8965-40c6-bea7-85087f03ef98 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:08.872015 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d29e57-8965-40c6-bea7-85087f03ef98 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:08.872086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d29e57-8965-40c6-bea7-85087f03ef98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:08.932369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6871574-c76d-44c2-8f30-759ff0e55b56 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:08.989442 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7a494-76ea-4d36-9b73-a6c37ea9b546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:08.990696 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7a494-76ea-4d36-9b73-a6c37ea9b546 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:08.991190 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7a494-76ea-4d36-9b73-a6c37ea9b546 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:08.991671 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7a494-76ea-4d36-9b73-a6c37ea9b546 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:08.997072 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d29e57-8965-40c6-bea7-85087f03ef98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:08.997805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d29e57-8965-40c6-bea7-85087f03ef98 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:09.011705 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf7a494-76ea-4d36-9b73-a6c37ea9b546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:09.024018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-bdf7a494-76ea-4d36-9b73-a6c37ea9b546 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:09.024018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:09.024018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:09.024018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:09.024018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:09.024018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:09.024018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:09.024018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:09.024018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:09.024018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:09.024018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:09.024018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:09.024018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:09.024018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:09.024018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:09.024018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:09.025012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:09.025012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:09.025012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:09.025012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:09.025012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:09.025012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:09.025012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:09.025012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:09.025012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:09.025012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:09.025012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:09.025012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:09.025012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:09.025012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:09.025012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:09.025012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:09.025815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:09.025815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:09.025815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:09.025815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:09.025815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:09.025815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:09.025815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:09.025815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:09.025815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:09.025815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:09.025815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:09.025815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:09.025815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 214/446] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:24:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:09.031985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7a494-76ea-4d36-9b73-a6c37ea9b546 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:09.116756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:09.130494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:09.142930 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 233/447] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:24:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:09.148303 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d29e57-8965-40c6-bea7-85087f03ef98 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:09.177802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7a494-76ea-4d36-9b73-a6c37ea9b546 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:09.225419 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc2f34-b8e0-4371-9d21-58dcd1b6be53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:09.226140 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc2f34-b8e0-4371-9d21-58dcd1b6be53 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:09.226425 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc2f34-b8e0-4371-9d21-58dcd1b6be53 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:09.226702 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc2f34-b8e0-4371-9d21-58dcd1b6be53 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:09.227469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc2f34-b8e0-4371-9d21-58dcd1b6be53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:09.227806 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc2f34-b8e0-4371-9d21-58dcd1b6be53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:09.229896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc2f34-b8e0-4371-9d21-58dcd1b6be53 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:09.247761 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 215/448] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:24:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:09.258037 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc2f34-b8e0-4371-9d21-58dcd1b6be53 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:09.281944 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d29e57-8965-40c6-bea7-85087f03ef98 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:09.324373 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d225b-23bc-4851-b5c6-82bed2a5b0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:09.325881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d225b-23bc-4851-b5c6-82bed2a5b0bb None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:09.326426 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d225b-23bc-4851-b5c6-82bed2a5b0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:09.326936 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d225b-23bc-4851-b5c6-82bed2a5b0bb None admin] PATH_INFO: `/v3/projects/c02407b0147e4d3e9acde0d88630dd1c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:09.329166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d225b-23bc-4851-b5c6-82bed2a5b0bb None admin] RBAC: Authorizing `identity:get_project(project_id=c02407b0147e4d3e9acde0d88630dd1c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:09.332812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d225b-23bc-4851-b5c6-82bed2a5b0bb None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:09.335213 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 234/449] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:24:09 2022] GET /identity/v3/projects/c02407b0147e4d3e9acde0d88630dd1c => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:09.340811 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d225b-23bc-4851-b5c6-82bed2a5b0bb None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:09.372117 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc2f34-b8e0-4371-9d21-58dcd1b6be53 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:09.395217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:09.404791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:09.416735 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9539d-e0d3-48a9-a29a-df940b7ada56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:09.417399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9539d-e0d3-48a9-a29a-df940b7ada56 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:09.417681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9539d-e0d3-48a9-a29a-df940b7ada56 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:09.417958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9539d-e0d3-48a9-a29a-df940b7ada56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:09.458095 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d225b-23bc-4851-b5c6-82bed2a5b0bb None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:09.496030 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595d8c6-66b6-4f46-8eb8-0f2ec74402da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:09.496890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595d8c6-66b6-4f46-8eb8-0f2ec74402da None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:09.497177 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595d8c6-66b6-4f46-8eb8-0f2ec74402da None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:09.497456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595d8c6-66b6-4f46-8eb8-0f2ec74402da None admin] PATH_INFO: `/v3/groups/e40d85233d924615be4669e980cbaa0a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:09.498716 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595d8c6-66b6-4f46-8eb8-0f2ec74402da None admin] RBAC: Authorizing `identity:get_group(group_id=e40d85233d924615be4669e980cbaa0a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:09.500174 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595d8c6-66b6-4f46-8eb8-0f2ec74402da None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:09.500643 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9539d-e0d3-48a9-a29a-df940b7ada56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:09.502494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 235/450] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jul 14 15:24:09 2022] GET /identity/v3/groups/e40d85233d924615be4669e980cbaa0a => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:09.503083 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9539d-e0d3-48a9-a29a-df940b7ada56 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:09.509411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595d8c6-66b6-4f46-8eb8-0f2ec74402da None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:09.613591 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 216/451] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:24:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:09.621510 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595d8c6-66b6-4f46-8eb8-0f2ec74402da None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:09.622362 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9539d-e0d3-48a9-a29a-df940b7ada56 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:09.646652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:09.651370 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:09.664719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140c07c-7b07-4aba-859a-0faca24d5ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:09.665390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140c07c-7b07-4aba-859a-0faca24d5ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:09.665673 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140c07c-7b07-4aba-859a-0faca24d5ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:09.665950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140c07c-7b07-4aba-859a-0faca24d5ec8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:09.666820 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140c07c-7b07-4aba-859a-0faca24d5ec8 None admin] RBAC: Adding query filter params (group.id=e40d85233d924615be4669e980cbaa0a, role.id=26bfea3cd8164feeb8043fd508a5268c, scope.project.id=c02407b0147e4d3e9acde0d88630dd1c) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:09.667134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140c07c-7b07-4aba-859a-0faca24d5ec8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:09.668598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140c07c-7b07-4aba-859a-0faca24d5ec8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:09.675799 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 236/452] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jul 14 15:24:09 2022] GET /identity/v3/role_assignments?group.id=e40d85233d924615be4669e980cbaa0a&scope.project.id=c02407b0147e4d3e9acde0d88630dd1c&role.id=26bfea3cd8164feeb8043fd508a5268c => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:09.738383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9539d-e0d3-48a9-a29a-df940b7ada56 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:09.778424 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f9eff-e836-48e4-9c47-706b4d0b857b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:09.779203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f9eff-e836-48e4-9c47-706b4d0b857b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:09.779484 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f9eff-e836-48e4-9c47-706b4d0b857b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:09.779759 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f9eff-e836-48e4-9c47-706b4d0b857b None admin] PATH_INFO: `/v3/projects/758a2be557ed4a1ab6684561497d3b7f` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:09.781061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f9eff-e836-48e4-9c47-706b4d0b857b None admin] RBAC: Authorizing `identity:get_project(project_id=758a2be557ed4a1ab6684561497d3b7f)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:09.783346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f9eff-e836-48e4-9c47-706b4d0b857b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:09.785177 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 217/453] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:24:09 2022] GET /identity/v3/projects/758a2be557ed4a1ab6684561497d3b7f => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:09.791029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140c07c-7b07-4aba-859a-0faca24d5ec8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:09.915664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140c07c-7b07-4aba-859a-0faca24d5ec8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:09.954260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2f963-1b91-46cf-a493-88f93ba1b1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:09.955133 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2f963-1b91-46cf-a493-88f93ba1b1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:09.955542 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2f963-1b91-46cf-a493-88f93ba1b1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:09.955742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2f963-1b91-46cf-a493-88f93ba1b1b7 None admin] PATH_INFO: `/v3/groups/9b2dc6a4ab354140a11891f4bf39a33e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:09.956861 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2f963-1b91-46cf-a493-88f93ba1b1b7 None admin] RBAC: Authorizing `identity:get_group(group_id=9b2dc6a4ab354140a11891f4bf39a33e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:09.958355 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2f963-1b91-46cf-a493-88f93ba1b1b7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:09.959994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 237/454] 10.222.0.39 () {56 vars in 1180 bytes} [Thu Jul 14 15:24:09 2022] GET /identity/v3/groups/9b2dc6a4ab354140a11891f4bf39a33e => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:09.966003 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f9eff-e836-48e4-9c47-706b4d0b857b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:10.089310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:10.098315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f9eff-e836-48e4-9c47-706b4d0b857b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:10.133801 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee85095-9c5a-43d7-805e-a5f38b8554a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:10.134484 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee85095-9c5a-43d7-805e-a5f38b8554a6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:10.134770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee85095-9c5a-43d7-805e-a5f38b8554a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:10.135046 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee85095-9c5a-43d7-805e-a5f38b8554a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:10.135882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee85095-9c5a-43d7-805e-a5f38b8554a6 None admin] RBAC: Adding query filter params (group.id=9b2dc6a4ab354140a11891f4bf39a33e, role.id=87f040877bfa47bda56305eb022af09e, scope.project.id=758a2be557ed4a1ab6684561497d3b7f) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:10.136194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee85095-9c5a-43d7-805e-a5f38b8554a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:10.137650 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee85095-9c5a-43d7-805e-a5f38b8554a6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:10.143860 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 218/455] 10.222.0.39 () {56 vars in 1376 bytes} [Thu Jul 14 15:24:09 2022] GET /identity/v3/role_assignments?group.id=9b2dc6a4ab354140a11891f4bf39a33e&scope.project.id=758a2be557ed4a1ab6684561497d3b7f&role.id=87f040877bfa47bda56305eb022af09e => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:12.832226 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75472aa-badf-4266-9612-c810fdcd80f7 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:12.833141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75472aa-badf-4266-9612-c810fdcd80f7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:12.833570 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75472aa-badf-4266-9612-c810fdcd80f7 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:12.836514 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 238/456] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:12.842266 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fde290-9545-49b8-abe8-442632ac36fc None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:12.843137 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fde290-9545-49b8-abe8-442632ac36fc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:12.843612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fde290-9545-49b8-abe8-442632ac36fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:12.878328 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-20fde290-9545-49b8-abe8-442632ac36fc None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:12.879785 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-20fde290-9545-49b8-abe8-442632ac36fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:12.980377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 219/457] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:13.014749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75472aa-badf-4266-9612-c810fdcd80f7 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:13.106951 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:13.190150 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75472aa-badf-4266-9612-c810fdcd80f7 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:13.253149 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7be459-355c-42d3-9748-3f3a6d1a4f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:13.253979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7be459-355c-42d3-9748-3f3a6d1a4f6a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.254302 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7be459-355c-42d3-9748-3f3a6d1a4f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.254590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7be459-355c-42d3-9748-3f3a6d1a4f6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.274231 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7be459-355c-42d3-9748-3f3a6d1a4f6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:13.277004 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7be459-355c-42d3-9748-3f3a6d1a4f6a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:13.296622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-cd7be459-355c-42d3-9748-3f3a6d1a4f6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:13.296622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:13.296622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:13.296622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:13.296622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:13.296622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:13.296622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:13.296622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:13.296622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:13.296622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:13.296622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:13.296622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:13.296622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:13.296622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:13.296622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:13.297567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:13.297567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:13.297567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:13.297567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:13.297567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:13.297567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:13.297567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:13.297567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:13.297567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:13.297567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:13.297567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:13.297567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:13.297567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:13.297567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:13.297567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:13.297567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:13.297567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:13.299571 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:13.299571 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:13.299571 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:13.299571 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:13.299571 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 239/458] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:13.305231 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fde290-9545-49b8-abe8-442632ac36fc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:13.316557 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e7a03-0961-4351-bbff-77c2bdfb41a1 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.317066 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e7a03-0961-4351-bbff-77c2bdfb41a1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.317565 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e7a03-0961-4351-bbff-77c2bdfb41a1 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.320295 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 240/459] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:13.326990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8d3fe-307b-4922-bfb6-f1d583e81939 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.327319 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8d3fe-307b-4922-bfb6-f1d583e81939 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.327571 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8d3fe-307b-4922-bfb6-f1d583e81939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.357975 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5bf8d3fe-307b-4922-bfb6-f1d583e81939 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:13.360859 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5bf8d3fe-307b-4922-bfb6-f1d583e81939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:13.482527 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 241/460] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:24:13.484434 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae53a8-0cbd-49ac-95c6-cee7a5e000a3 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.484942 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae53a8-0cbd-49ac-95c6-cee7a5e000a3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.485954 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae53a8-0cbd-49ac-95c6-cee7a5e000a3 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.487928 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 242/461] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:13.493400 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23481a5c-ea06-4359-9ef4-c581724af887 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.493946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23481a5c-ea06-4359-9ef4-c581724af887 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.494388 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23481a5c-ea06-4359-9ef4-c581724af887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.513068 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-23481a5c-ea06-4359-9ef4-c581724af887 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:13.514571 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-23481a5c-ea06-4359-9ef4-c581724af887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:13.527785 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:13.547698 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fde290-9545-49b8-abe8-442632ac36fc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:13.562791 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:13.611192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 243/462] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:13.612288 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23481a5c-ea06-4359-9ef4-c581724af887 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:13.623822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8d1a6-8ea3-4d70-8e79-51e9b50339c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:13.624518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8d1a6-8ea3-4d70-8e79-51e9b50339c1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.624804 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8d1a6-8ea3-4d70-8e79-51e9b50339c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.625082 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8d1a6-8ea3-4d70-8e79-51e9b50339c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.627808 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8d1a6-8ea3-4d70-8e79-51e9b50339c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:13.628177 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8d1a6-8ea3-4d70-8e79-51e9b50339c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:13.629622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8d1a6-8ea3-4d70-8e79-51e9b50339c1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:13.643956 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 220/463] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:13.650303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8d1a6-8ea3-4d70-8e79-51e9b50339c1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:13.783122 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23481a5c-ea06-4359-9ef4-c581724af887 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:13.807592 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8d1a6-8ea3-4d70-8e79-51e9b50339c1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:13.827598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e60ed-da60-40d2-af50-2c39bd2a8727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:13.828296 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e60ed-da60-40d2-af50-2c39bd2a8727 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.828579 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e60ed-da60-40d2-af50-2c39bd2a8727 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.828863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e60ed-da60-40d2-af50-2c39bd2a8727 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.848084 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e60ed-da60-40d2-af50-2c39bd2a8727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:13.849854 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05e60ed-da60-40d2-af50-2c39bd2a8727 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:13.858293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754e3e1-731d-44c2-8a2b-0ed5868d9049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:13.859246 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754e3e1-731d-44c2-8a2b-0ed5868d9049 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:13.860590 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754e3e1-731d-44c2-8a2b-0ed5868d9049 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:13.861176 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754e3e1-731d-44c2-8a2b-0ed5868d9049 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:13.863367 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754e3e1-731d-44c2-8a2b-0ed5868d9049 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:13.866476 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b754e3e1-731d-44c2-8a2b-0ed5868d9049 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:13.873718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-d05e60ed-da60-40d2-af50-2c39bd2a8727 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:13.873718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:13.873718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:13.873718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:13.873718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:13.873718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:13.873718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:13.873718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:13.873718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:13.873718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:13.873718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:13.873718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:13.873718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:13.873718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:13.873718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:13.874815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:13.874815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:13.874815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:13.874815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:13.874815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:13.874815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:13.874815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:13.874815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:13.874815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:13.874815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:13.874815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:13.874815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:13.874815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:13.874815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:13.874815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:13.874815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:13.874815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:13.875667 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:13.875667 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:13.875667 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:13.875667 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:13.878369 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 244/464] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:13.879635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e60ed-da60-40d2-af50-2c39bd2a8727 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:13.902191 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 221/465] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jul 14 15:24:13 2022] POST /identity/v3/users => generated 246 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:13.904338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754e3e1-731d-44c2-8a2b-0ed5868d9049 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:13.914707 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:13.930103 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:14.059630 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e60ed-da60-40d2-af50-2c39bd2a8727 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:14.078975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754e3e1-731d-44c2-8a2b-0ed5868d9049 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:14.117334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04159ba9-0e9e-4c60-bf29-53cbf6759b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:14.118646 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04159ba9-0e9e-4c60-bf29-53cbf6759b12 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:14.119149 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04159ba9-0e9e-4c60-bf29-53cbf6759b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:14.119748 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04159ba9-0e9e-4c60-bf29-53cbf6759b12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:14.121336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f82f9-a49d-4858-bb30-c69395e8b6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:14.122021 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f82f9-a49d-4858-bb30-c69395e8b6ba None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:14.122358 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f82f9-a49d-4858-bb30-c69395e8b6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:14.122640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f82f9-a49d-4858-bb30-c69395e8b6ba None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:14.123386 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f82f9-a49d-4858-bb30-c69395e8b6ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:14.123701 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f82f9-a49d-4858-bb30-c69395e8b6ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:14.125111 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f82f9-a49d-4858-bb30-c69395e8b6ba None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:14.135181 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04159ba9-0e9e-4c60-bf29-53cbf6759b12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:14.137073 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04159ba9-0e9e-4c60-bf29-53cbf6759b12 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:14.146977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 222/466] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:14.148284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57c0de-8e69-481d-9f41-6b5e23dc3652 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:14.148575 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57c0de-8e69-481d-9f41-6b5e23dc3652 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:14.148853 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57c0de-8e69-481d-9f41-6b5e23dc3652 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:14.150481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 223/467] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:14.157048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b924233-6585-4d06-83cd-f48609111882 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:14.157785 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b924233-6585-4d06-83cd-f48609111882 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:14.158262 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b924233-6585-4d06-83cd-f48609111882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:14.158479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-04159ba9-0e9e-4c60-bf29-53cbf6759b12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:14.158479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:14.158479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:14.158479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:14.158479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:14.158479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:14.158479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:14.158479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:14.158479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:14.158479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:14.158479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:14.158479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:14.158479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:14.158479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:14.158479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:14.159308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:14.159308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:14.159308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:14.159308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:14.159308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:14.159308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:14.159308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:14.159308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:14.159308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:14.159308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:14.159308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:14.159308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:14.159308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:14.159308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:14.159308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:14.159308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:14.159308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:14.160157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:14.160157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:14.160157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:14.160157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:14.160388 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 245/468] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:14.165586 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04159ba9-0e9e-4c60-bf29-53cbf6759b12 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:14.181811 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-5b924233-6585-4d06-83cd-f48609111882 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:14.183244 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5b924233-6585-4d06-83cd-f48609111882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:14.255911 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:14.293078 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:14.303061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 224/469] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:14.304000 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b924233-6585-4d06-83cd-f48609111882 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:14.310375 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04159ba9-0e9e-4c60-bf29-53cbf6759b12 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:14.356931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae4131-a613-4699-bc54-008d22c36102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:14.358576 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae4131-a613-4699-bc54-008d22c36102 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:14.359318 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae4131-a613-4699-bc54-008d22c36102 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:14.360099 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae4131-a613-4699-bc54-008d22c36102 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:14.361902 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae4131-a613-4699-bc54-008d22c36102 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:14.364914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae4131-a613-4699-bc54-008d22c36102 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:14.395785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 246/470] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jul 14 15:24:14 2022] POST /identity/v3/users => generated 248 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:14.397267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae4131-a613-4699-bc54-008d22c36102 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:14.551443 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae4131-a613-4699-bc54-008d22c36102 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:14.581201 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:14.584770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b924233-6585-4d06-83cd-f48609111882 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:14.599172 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce6b0f-f454-404a-b37d-8f06c0a73bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:14.600502 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce6b0f-f454-404a-b37d-8f06c0a73bfd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:14.600986 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce6b0f-f454-404a-b37d-8f06c0a73bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:14.601459 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce6b0f-f454-404a-b37d-8f06c0a73bfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:14.614686 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce6b0f-f454-404a-b37d-8f06c0a73bfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:14.616635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce6b0f-f454-404a-b37d-8f06c0a73bfd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:14.636648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-e7ce6b0f-f454-404a-b37d-8f06c0a73bfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:14.636648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:14.636648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:14.636648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:14.636648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:14.636648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:14.636648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:14.636648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:14.636648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:14.636648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:14.636648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:14.636648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:14.636648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:14.636648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:14.636648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:14.637585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:14.637585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:14.637585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:14.637585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:14.637585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:14.637585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:14.637585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:14.637585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:14.637585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:14.637585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:14.637585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:14.637585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:14.637585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:14.637585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:14.637585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:14.637585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:14.637585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:14.638479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:14.638479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:14.638479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:14.638479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:14.640801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 247/471] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:14.651165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce6b0f-f454-404a-b37d-8f06c0a73bfd None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:14.666213 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfddfe2-e5c3-4691-8b64-d83e44a313be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:14.667259 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfddfe2-e5c3-4691-8b64-d83e44a313be None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:14.667743 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfddfe2-e5c3-4691-8b64-d83e44a313be None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:14.668241 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfddfe2-e5c3-4691-8b64-d83e44a313be None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:14.669836 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfddfe2-e5c3-4691-8b64-d83e44a313be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:14.670397 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfddfe2-e5c3-4691-8b64-d83e44a313be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:14.672014 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfddfe2-e5c3-4691-8b64-d83e44a313be None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:14.694198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 225/472] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:14.694457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233041d-2d93-4a37-bb0d-9fe4964d2c2a None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:14.694626 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233041d-2d93-4a37-bb0d-9fe4964d2c2a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:14.694954 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233041d-2d93-4a37-bb0d-9fe4964d2c2a None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:14.696864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 226/473] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:14.699184 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233041d-2d93-4a37-bb0d-9fe4964d2c2a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:14.791023 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:14.813615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce6b0f-f454-404a-b37d-8f06c0a73bfd None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:14.870569 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6d0cc-088f-4fb6-ab08-dab8977f6f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:14.871663 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6d0cc-088f-4fb6-ab08-dab8977f6f87 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:14.872132 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6d0cc-088f-4fb6-ab08-dab8977f6f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:14.872909 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6d0cc-088f-4fb6-ab08-dab8977f6f87 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:14.874532 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6d0cc-088f-4fb6-ab08-dab8977f6f87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:14.874839 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6d0cc-088f-4fb6-ab08-dab8977f6f87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:14.876461 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6d0cc-088f-4fb6-ab08-dab8977f6f87 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:14.885599 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233041d-2d93-4a37-bb0d-9fe4964d2c2a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:14.898933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 248/474] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:14.898933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af532adb-d25a-438e-b4ad-6db2a471c975 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:14.898933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af532adb-d25a-438e-b4ad-6db2a471c975 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:14.898933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af532adb-d25a-438e-b4ad-6db2a471c975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:14.921744 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-af532adb-d25a-438e-b4ad-6db2a471c975 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:14.925510 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-af532adb-d25a-438e-b4ad-6db2a471c975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:14.936587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4b5f5-b358-444f-b577-3e0600941122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:14.937250 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4b5f5-b358-444f-b577-3e0600941122 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:14.937532 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4b5f5-b358-444f-b577-3e0600941122 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:14.937800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4b5f5-b358-444f-b577-3e0600941122 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:14.938689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4b5f5-b358-444f-b577-3e0600941122 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:14.940141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4b5f5-b358-444f-b577-3e0600941122 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:14.969488 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:14.974108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 227/475] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jul 14 15:24:14 2022] POST /identity/v3/users => generated 248 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:24:14.974108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4b5f5-b358-444f-b577-3e0600941122 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:15.079557 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 249/476] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:15.132728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af532adb-d25a-438e-b4ad-6db2a471c975 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:15.163451 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4b5f5-b358-444f-b577-3e0600941122 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:15.181021 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:15.225436 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365956e5-5a64-4ab0-91da-488917307e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:15.226325 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365956e5-5a64-4ab0-91da-488917307e52 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:15.227123 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365956e5-5a64-4ab0-91da-488917307e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:15.227406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365956e5-5a64-4ab0-91da-488917307e52 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:15.228141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365956e5-5a64-4ab0-91da-488917307e52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:15.230530 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365956e5-5a64-4ab0-91da-488917307e52 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:15.272690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 228/477] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jul 14 15:24:14 2022] POST /identity/v3/users => generated 249 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:15.340271 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af532adb-d25a-438e-b4ad-6db2a471c975 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:15.383789 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95757ea-3e3c-48f7-af03-b6c1f7ad5d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:15.384485 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95757ea-3e3c-48f7-af03-b6c1f7ad5d2d None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:15.384769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95757ea-3e3c-48f7-af03-b6c1f7ad5d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:15.385048 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95757ea-3e3c-48f7-af03-b6c1f7ad5d2d None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:15.385828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95757ea-3e3c-48f7-af03-b6c1f7ad5d2d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:15.387300 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95757ea-3e3c-48f7-af03-b6c1f7ad5d2d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:15.396110 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.sql.core [None req-e95757ea-3e3c-48f7-af03-b6c1f7ad5d2d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 15:24:15.396110 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 15:24:15.396110 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [parameters: {'id': '18fc463cb8114d45a7bd86ecd05d247b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 15:24:15.396110 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80191) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 15:24:15.420652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-e95757ea-3e3c-48f7-af03-b6c1f7ad5d2d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 15:24:15.420652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:15.420652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 15:24:15.420652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 15:24:15.420652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 15:24:15.420652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 15:24:15.420652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 15:24:15.420652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 15:24:15.420652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 15:24:15.420652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application conn.query(q) Jul 14 15:24:15.420652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 15:24:15.420652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 15:24:15.420652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 15:24:15.420652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application result.read() Jul 14 15:24:15.420652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 15:24:15.421598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 15:24:15.421598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 15:24:15.421598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 15:24:15.421598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 15:24:15.421598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 15:24:15.421598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 15:24:15.421598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 15:24:15.421598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 15:24:15.421598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:15.421598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 15:24:15.421598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:15.421598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:15.421598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 15:24:15.421598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 15:24:15.421598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 14 15:24:15.421598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return ref.to_dict() Jul 14 15:24:15.421598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:24:15.421598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:24:15.422547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 15:24:15.422547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application yield resource Jul 14 15:24:15.422547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:24:15.422547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:24:15.422547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 15:24:15.422547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 15:24:15.422547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 15:24:15.422547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 15:24:15.422547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 15:24:15.422547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise self.value Jul 14 15:24:15.422547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 15:24:15.422547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 15:24:15.422547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 15:24:15.422547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application session.commit() Jul 14 15:24:15.422547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 15:24:15.422547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 15:24:15.422547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 15:24:15.425108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 15:24:15.425108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 15:24:15.425108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.session.flush() Jul 14 15:24:15.425108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 15:24:15.425108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 15:24:15.425108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 15:24:15.425108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 15:24:15.425108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 15:24:15.425108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application compat.raise_( Jul 14 15:24:15.425108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 15:24:15.425108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception Jul 14 15:24:15.425108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 15:24:15.425108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 15:24:15.425108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 15:24:15.425108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 15:24:15.425108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 15:24:15.425108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 15:24:15.427256 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 15:24:15.427256 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 15:24:15.427256 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 15:24:15.427256 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 15:24:15.427256 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 15:24:15.427256 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 15:24:15.427256 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 15:24:15.427256 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 15:24:15.427256 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 15:24:15.427256 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 15:24:15.427256 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 15:24:15.427256 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 15:24:15.427256 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 15:24:15.427256 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 15:24:15.427256 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 15:24:15.427256 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception Jul 14 15:24:15.429574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 15:24:15.429574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 15:24:15.429574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 15:24:15.429574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 15:24:15.429574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 15:24:15.429574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 15:24:15.429574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 15:24:15.429574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application conn.query(q) Jul 14 15:24:15.429574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 15:24:15.429574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 15:24:15.429574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 15:24:15.429574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application result.read() Jul 14 15:24:15.429574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 15:24:15.429574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 15:24:15.429574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 15:24:15.429574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 15:24:15.436370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 15:24:15.436370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 15:24:15.436370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 15:24:15.436370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 15:24:15.436370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 14 15:24:15.436370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 14 15:24:15.436370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [parameters: {'id': '18fc463cb8114d45a7bd86ecd05d247b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 14 15:24:15.436370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 15:24:15.436370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:15.436370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:15.436370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:15.436370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:15.436370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:15.436370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:15.436370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:15.436370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:15.437910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:15.437910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:15.437910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:15.437910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:15.437910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:15.437910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:15.437910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 14 15:24:15.437910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 14 15:24:15.437910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:15.437910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:15.437910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 14 15:24:15.437910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 14 15:24:15.437910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 15:24:15.437910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 15:24:15.437910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 14 15:24:15.437910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:15.439011 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 250/478] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jul 14 15:24:15 2022] POST /identity/v3/roles => generated 144 bytes in 290 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:15.439078 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365956e5-5a64-4ab0-91da-488917307e52 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:15.585168 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365956e5-5a64-4ab0-91da-488917307e52 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:15.632515 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c259d75-8e91-40ef-9461-03ff599c7ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:15.633599 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c259d75-8e91-40ef-9461-03ff599c7ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:15.634037 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c259d75-8e91-40ef-9461-03ff599c7ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:15.634493 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c259d75-8e91-40ef-9461-03ff599c7ae1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:15.650220 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c259d75-8e91-40ef-9461-03ff599c7ae1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:15.660017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-9c259d75-8e91-40ef-9461-03ff599c7ae1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:24:15.660017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:15.660017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:15.660017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:15.660017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:15.660017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:15.660017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:15.660017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:15.660017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:15.660017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:15.660017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:15.660017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:15.660017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:15.660017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:15.660017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:15.660017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:15.661119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:15.661119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:15.661119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:15.661119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:15.661119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:15.661119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:15.661119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:15.661119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:15.661119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:15.661119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:15.661119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:15.661119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:15.661119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:15.661119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:15.661119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:15.661119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:15.662029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:15.662029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:15.662029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:15.662029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:15.662029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:15.662029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:15.662029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:15.662029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:15.662029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:15.662029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:15.662029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 15:24:15.662029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:15.664043 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 229/479] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:15.670310 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95757ea-3e3c-48f7-af03-b6c1f7ad5d2d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:15.706865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:15.791637 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95757ea-3e3c-48f7-af03-b6c1f7ad5d2d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:15.831062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735e240-e386-43e4-8119-b1f1c3d3a478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:15.832616 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735e240-e386-43e4-8119-b1f1c3d3a478 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:15.833069 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735e240-e386-43e4-8119-b1f1c3d3a478 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:15.833504 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735e240-e386-43e4-8119-b1f1c3d3a478 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:15.834530 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735e240-e386-43e4-8119-b1f1c3d3a478 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:15.834996 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735e240-e386-43e4-8119-b1f1c3d3a478 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:15.836543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735e240-e386-43e4-8119-b1f1c3d3a478 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:15.848000 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 251/480] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:16.631699 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc891442-ef7a-41f2-9ff0-aefc7703497e None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:16.633029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc891442-ef7a-41f2-9ff0-aefc7703497e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:16.633695 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc891442-ef7a-41f2-9ff0-aefc7703497e None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:16.636689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 230/481] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:16.643005 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e083342-721c-4ac4-9236-c8979bdba931 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:16.644244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e083342-721c-4ac4-9236-c8979bdba931 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:16.644942 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e083342-721c-4ac4-9236-c8979bdba931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:16.675264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3e083342-721c-4ac4-9236-c8979bdba931 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:16.676907 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3e083342-721c-4ac4-9236-c8979bdba931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:16.787519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 252/482] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:16.835772 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc891442-ef7a-41f2-9ff0-aefc7703497e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:16.884128 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:17.001607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc891442-ef7a-41f2-9ff0-aefc7703497e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:17.053671 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68418f27-3db9-4f76-88ca-e6adf21c09db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:17.055746 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68418f27-3db9-4f76-88ca-e6adf21c09db None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:17.056215 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68418f27-3db9-4f76-88ca-e6adf21c09db None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:17.056663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68418f27-3db9-4f76-88ca-e6adf21c09db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:17.080934 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68418f27-3db9-4f76-88ca-e6adf21c09db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:17.089048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-68418f27-3db9-4f76-88ca-e6adf21c09db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:17.089048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:17.089048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:17.089048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:17.089048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:17.089048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:17.089048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:17.089048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:17.089048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:17.089048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:17.089048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:17.089048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:17.089048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:17.089048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:17.089048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:17.089048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:17.094341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:17.094341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:17.094341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:17.094341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:17.094341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:17.094341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:17.094341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:17.094341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:17.094341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:17.094341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:17.094341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:17.094341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:17.094341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:17.094341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:17.094341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:17.094341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:17.095607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:17.095607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:17.095607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:17.095607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:17.095607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:17.095607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:17.095607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:17.095607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:17.095607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:17.095607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:17.095607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:17.095607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:17.098255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 231/483] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:24:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:17.107251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e083342-721c-4ac4-9236-c8979bdba931 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:17.150491 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:17.298265 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b14a09-f1c4-4b64-abdf-39f36f3bc4d4 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:17.298978 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b14a09-f1c4-4b64-abdf-39f36f3bc4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:17.299395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b14a09-f1c4-4b64-abdf-39f36f3bc4d4 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:17.306314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 232/484] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:24:17.310613 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df390727-d958-4c84-b231-e5c059fde6b8 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:17.311077 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df390727-d958-4c84-b231-e5c059fde6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:17.311535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df390727-d958-4c84-b231-e5c059fde6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:17.317441 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e083342-721c-4ac4-9236-c8979bdba931 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:17.352214 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-df390727-d958-4c84-b231-e5c059fde6b8 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:17.353600 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-df390727-d958-4c84-b231-e5c059fde6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:17.396200 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bb2b0-8915-4a01-a687-88478a3b548a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:17.396879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bb2b0-8915-4a01-a687-88478a3b548a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:17.397160 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bb2b0-8915-4a01-a687-88478a3b548a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:17.397435 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bb2b0-8915-4a01-a687-88478a3b548a None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:17.398228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09bb2b0-8915-4a01-a687-88478a3b548a None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:17.398540 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09bb2b0-8915-4a01-a687-88478a3b548a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:17.399953 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09bb2b0-8915-4a01-a687-88478a3b548a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:17.413848 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 253/485] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jul 14 15:24:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:17.419771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bb2b0-8915-4a01-a687-88478a3b548a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:17.537930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 233/486] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:24:17.575259 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df390727-d958-4c84-b231-e5c059fde6b8 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:17.603420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:17.643250 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:17.682548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bb2b0-8915-4a01-a687-88478a3b548a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:17.755168 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963f7b8-013d-4d30-8683-3a4bbc57ebdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:17.756236 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963f7b8-013d-4d30-8683-3a4bbc57ebdf None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:17.756676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963f7b8-013d-4d30-8683-3a4bbc57ebdf None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:17.757104 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963f7b8-013d-4d30-8683-3a4bbc57ebdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:17.770034 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df390727-d958-4c84-b231-e5c059fde6b8 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:17.784680 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963f7b8-013d-4d30-8683-3a4bbc57ebdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:17.786454 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963f7b8-013d-4d30-8683-3a4bbc57ebdf None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:17.817742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-8963f7b8-013d-4d30-8683-3a4bbc57ebdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:17.817742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:17.817742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:17.817742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:17.817742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:17.817742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:17.817742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:17.817742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:17.817742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:17.817742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:17.817742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:17.817742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:17.817742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:17.817742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:17.817742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:17.818802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:17.818802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:17.818802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:17.818802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:17.818802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:17.818802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:17.818802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:17.818802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:17.818802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:17.818802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:17.818802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:17.818802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:17.818802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:17.818802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:17.818802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:17.818802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:17.818802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:17.819779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:17.819779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:17.819779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:17.819779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:17.824940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 254/487] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:17.831441 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963f7b8-013d-4d30-8683-3a4bbc57ebdf None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:17.849073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430ef0e-2b4f-46ce-a6d7-f5691ebdd231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:17.850243 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430ef0e-2b4f-46ce-a6d7-f5691ebdd231 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:17.850758 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430ef0e-2b4f-46ce-a6d7-f5691ebdd231 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:17.851198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430ef0e-2b4f-46ce-a6d7-f5691ebdd231 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:17.874689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f430ef0e-2b4f-46ce-a6d7-f5691ebdd231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:17.883611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f430ef0e-2b4f-46ce-a6d7-f5691ebdd231 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:17.883611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:17.883611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:17.883611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:17.883611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:17.883611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:17.883611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:17.883611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:17.883611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:17.883611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:17.883611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:17.883611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:17.883611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:17.883611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:17.883611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:17.883611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:17.884741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:17.884741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:17.884741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:17.884741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:17.884741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:17.884741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:17.884741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:17.884741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:17.884741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:17.884741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:17.884741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:17.884741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:17.884741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:17.884741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:17.884741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:17.884741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:17.885612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:17.885612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:17.885612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:17.885612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:17.885612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:17.885612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:17.885612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:17.885612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:17.885612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:17.885612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:17.885612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:17.885612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:17.888011 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 234/488] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:24:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:17.895029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430ef0e-2b4f-46ce-a6d7-f5691ebdd231 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:18.020761 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:18.037349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963f7b8-013d-4d30-8683-3a4bbc57ebdf None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:18.055397 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430ef0e-2b4f-46ce-a6d7-f5691ebdd231 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:18.100174 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f4366-9e56-4f98-9dc0-aff0a32fb781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:18.100949 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f4366-9e56-4f98-9dc0-aff0a32fb781 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.101805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f4366-9e56-4f98-9dc0-aff0a32fb781 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.102239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f4366-9e56-4f98-9dc0-aff0a32fb781 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.103381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f4366-9e56-4f98-9dc0-aff0a32fb781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:18.103874 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f4366-9e56-4f98-9dc0-aff0a32fb781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:18.106289 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f4366-9e56-4f98-9dc0-aff0a32fb781 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:18.108239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:18.111775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be2b54-7d8d-418e-958a-e90b33cbc3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:18.113203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be2b54-7d8d-418e-958a-e90b33cbc3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.113679 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be2b54-7d8d-418e-958a-e90b33cbc3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.114195 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be2b54-7d8d-418e-958a-e90b33cbc3c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.115167 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be2b54-7d8d-418e-958a-e90b33cbc3c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:18.115673 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be2b54-7d8d-418e-958a-e90b33cbc3c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:18.117278 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be2b54-7d8d-418e-958a-e90b33cbc3c4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:18.129965 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 255/489] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:18.131995 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bed87-4cb1-442a-a86f-f04b441fec74 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.132355 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bed87-4cb1-442a-a86f-f04b441fec74 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.132712 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bed87-4cb1-442a-a86f-f04b441fec74 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.134999 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 256/490] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:18.135957 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bed87-4cb1-442a-a86f-f04b441fec74 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:18.138047 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 235/491] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jul 14 15:24:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:18.146122 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03341822-28e6-43d6-a242-c815491f0a3c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.146122 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03341822-28e6-43d6-a242-c815491f0a3c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.146122 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03341822-28e6-43d6-a242-c815491f0a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.169186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-03341822-28e6-43d6-a242-c815491f0a3c None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:18.171148 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-03341822-28e6-43d6-a242-c815491f0a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:18.261532 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 236/492] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:18.262937 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03341822-28e6-43d6-a242-c815491f0a3c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:18.278862 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bed87-4cb1-442a-a86f-f04b441fec74 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:18.338750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2545f1f-48ed-43f3-a16d-f634e8fbab91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:18.341156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2545f1f-48ed-43f3-a16d-f634e8fbab91 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.342527 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2545f1f-48ed-43f3-a16d-f634e8fbab91 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.343634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2545f1f-48ed-43f3-a16d-f634e8fbab91 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.361842 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2545f1f-48ed-43f3-a16d-f634e8fbab91 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:18.362022 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:18.364994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2545f1f-48ed-43f3-a16d-f634e8fbab91 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:18.386880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-d2545f1f-48ed-43f3-a16d-f634e8fbab91 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:18.386880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:18.386880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:18.386880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:18.386880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:18.386880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:18.386880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:18.386880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:18.386880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:18.386880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:18.386880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:18.386880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:18.386880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:18.386880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:18.386880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:18.386880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:18.387872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:18.387872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:18.387872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:18.387872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:18.387872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:18.387872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:18.387872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:18.387872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:18.387872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:18.387872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:18.387872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:18.387872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:18.387872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:18.387872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:18.387872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:18.387872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:18.387872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:18.387872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:18.389159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:18.389159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:18.389159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:18.389159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:18.389159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:18.389159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:18.389159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:18.389159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:18.389159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:18.389159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:18.389159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 257/493] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jul 14 15:24:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:18.390470 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2545f1f-48ed-43f3-a16d-f634e8fbab91 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:18.411367 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03341822-28e6-43d6-a242-c815491f0a3c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:18.460566 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ffe82-cea8-4533-a19f-d30bbda8ddd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:18.462117 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ffe82-cea8-4533-a19f-d30bbda8ddd5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.462791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ffe82-cea8-4533-a19f-d30bbda8ddd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.463390 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ffe82-cea8-4533-a19f-d30bbda8ddd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.473042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:18.480843 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ffe82-cea8-4533-a19f-d30bbda8ddd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:18.483293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ffe82-cea8-4533-a19f-d30bbda8ddd5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:18.506851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-9c4ffe82-cea8-4533-a19f-d30bbda8ddd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:18.506851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:18.506851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:18.506851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:18.506851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:18.506851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:18.506851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:18.506851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:18.506851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:18.506851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:18.506851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:18.506851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:18.506851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:18.506851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:18.506851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:18.507781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:18.507781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:18.507781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:18.507781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:18.507781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:18.507781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:18.507781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:18.507781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:18.507781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:18.507781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:18.507781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:18.507781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:18.507781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:18.507781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:18.507781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:18.507781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:18.507781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:18.508612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:18.508612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:18.508612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:18.508612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:18.508612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 237/494] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:18.508866 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ffe82-cea8-4533-a19f-d30bbda8ddd5 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:18.544482 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2545f1f-48ed-43f3-a16d-f634e8fbab91 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:18.584625 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedbd0c-3f9e-4c26-a2e3-6fb78c5e8501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:18.585749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedbd0c-3f9e-4c26-a2e3-6fb78c5e8501 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.586231 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedbd0c-3f9e-4c26-a2e3-6fb78c5e8501 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.586515 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedbd0c-3f9e-4c26-a2e3-6fb78c5e8501 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.599732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedbd0c-3f9e-4c26-a2e3-6fb78c5e8501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:18.607597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-7cedbd0c-3f9e-4c26-a2e3-6fb78c5e8501 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:18.607597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:18.607597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:18.607597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:18.607597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:18.607597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:18.607597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:18.607597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:18.607597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:18.607597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:18.607597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:18.607597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:18.607597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:18.607597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:18.607597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:18.607597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:18.608536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:18.608536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:18.608536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:18.608536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:18.608536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:18.608536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:18.608536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:18.608536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:18.608536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:18.608536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:18.608536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:18.608536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:18.608536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:18.608536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:18.608536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:18.608536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:18.609719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:18.609719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:18.609719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:18.609719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:18.609719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:18.609719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:18.609719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:18.609719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:18.609719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:18.609719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:18.609719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:18.609719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:18.609719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 258/495] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:24:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:18.610900 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c6bf6-9c25-47c7-a694-d905266114e8 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.610900 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c6bf6-9c25-47c7-a694-d905266114e8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.611212 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c6bf6-9c25-47c7-a694-d905266114e8 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.617273 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 259/496] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:18.618145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c6bf6-9c25-47c7-a694-d905266114e8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:18.653883 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ffe82-cea8-4533-a19f-d30bbda8ddd5 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:18.693566 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:18.720021 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4bfad-b27d-4bc7-bff2-966fcf133213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:18.720839 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4bfad-b27d-4bc7-bff2-966fcf133213 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.721189 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4bfad-b27d-4bc7-bff2-966fcf133213 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.721502 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4bfad-b27d-4bc7-bff2-966fcf133213 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.722693 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4bfad-b27d-4bc7-bff2-966fcf133213 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:18.723061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4bfad-b27d-4bc7-bff2-966fcf133213 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:18.724534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4bfad-b27d-4bc7-bff2-966fcf133213 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:18.760787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c6bf6-9c25-47c7-a694-d905266114e8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:18.770881 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 238/497] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jul 14 15:24:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:18.770881 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4bfad-b27d-4bc7-bff2-966fcf133213 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:18.781062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:18.806401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747856e-96cb-4b81-a9f2-dcf7ad774cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:18.807389 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747856e-96cb-4b81-a9f2-dcf7ad774cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.807873 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747856e-96cb-4b81-a9f2-dcf7ad774cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.808312 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747856e-96cb-4b81-a9f2-dcf7ad774cf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.809554 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747856e-96cb-4b81-a9f2-dcf7ad774cf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:18.810099 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747856e-96cb-4b81-a9f2-dcf7ad774cf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:18.812518 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747856e-96cb-4b81-a9f2-dcf7ad774cf7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:18.830105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 260/498] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:18.831623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d5c03-5827-49ca-b471-32f51c4ef386 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.831780 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d5c03-5827-49ca-b471-32f51c4ef386 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.832027 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d5c03-5827-49ca-b471-32f51c4ef386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.852493 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-545d5c03-5827-49ca-b471-32f51c4ef386 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:18.853719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-545d5c03-5827-49ca-b471-32f51c4ef386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:18.889793 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4bfad-b27d-4bc7-bff2-966fcf133213 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:18.932861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6632f6-1fcb-4c5c-a3ed-317bf41fe8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:18.933519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6632f6-1fcb-4c5c-a3ed-317bf41fe8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.933807 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6632f6-1fcb-4c5c-a3ed-317bf41fe8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.934094 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6632f6-1fcb-4c5c-a3ed-317bf41fe8e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.934852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6632f6-1fcb-4c5c-a3ed-317bf41fe8e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:18.935161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6632f6-1fcb-4c5c-a3ed-317bf41fe8e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:18.935792 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 261/499] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:18.936461 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d5c03-5827-49ca-b471-32f51c4ef386 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:18.936647 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6632f6-1fcb-4c5c-a3ed-317bf41fe8e2 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:18.958547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 239/500] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jul 14 15:24:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:18.958547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9525a-2bb8-4c94-af21-1f2e0f9d9ac1 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:18.958547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9525a-2bb8-4c94-af21-1f2e0f9d9ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:18.958547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9525a-2bb8-4c94-af21-1f2e0f9d9ac1 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:18.958547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 240/501] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:18.959816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9525a-2bb8-4c94-af21-1f2e0f9d9ac1 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:19.011198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:19.069771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d5c03-5827-49ca-b471-32f51c4ef386 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:19.075475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:19.096629 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9525a-2bb8-4c94-af21-1f2e0f9d9ac1 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:19.118390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b14ba-0f3c-43fe-a3c8-df66fe7ef179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:19.119050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b14ba-0f3c-43fe-a3c8-df66fe7ef179 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:19.119337 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b14ba-0f3c-43fe-a3c8-df66fe7ef179 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:19.119620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b14ba-0f3c-43fe-a3c8-df66fe7ef179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:19.134916 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a75fe6-52f1-4d3e-a0b3-f96cb2c8834d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:19.135744 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a75fe6-52f1-4d3e-a0b3-f96cb2c8834d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:19.136027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a75fe6-52f1-4d3e-a0b3-f96cb2c8834d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:19.136373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a75fe6-52f1-4d3e-a0b3-f96cb2c8834d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:19.146041 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a75fe6-52f1-4d3e-a0b3-f96cb2c8834d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:19.147514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a75fe6-52f1-4d3e-a0b3-f96cb2c8834d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:19.164307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-63a75fe6-52f1-4d3e-a0b3-f96cb2c8834d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 15:24:19.164307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:19.164307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:19.164307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:19.164307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:19.164307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:19.164307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:19.164307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:19.164307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:19.164307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:19.164307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:19.164307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:19.164307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:19.164307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:19.164307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:19.164307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:19.165306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:19.165306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:19.165306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:19.165306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:19.165306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:19.165306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:19.165306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:19.165306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:19.165306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:19.165306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:19.165306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:19.165306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:19.165306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:19.165306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:19.165306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:19.165306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:19.165306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:19.165306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:19.166518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:19.166518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:19.166518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:19.166518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:19.166518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:19.166518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:19.166518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:19.166518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:19.166518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 15:24:19.166518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:19.166518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 241/502] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:24:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:19.166518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a75fe6-52f1-4d3e-a0b3-f96cb2c8834d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:19.199188 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b14ba-0f3c-43fe-a3c8-df66fe7ef179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:19.200683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b14ba-0f3c-43fe-a3c8-df66fe7ef179 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:19.278516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a75fe6-52f1-4d3e-a0b3-f96cb2c8834d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:19.280406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:19.317021 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 262/503] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:24:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:19.318358 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea0d69-2447-4b1e-9817-6a1b878d60d2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:19.318650 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea0d69-2447-4b1e-9817-6a1b878d60d2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:19.318924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea0d69-2447-4b1e-9817-6a1b878d60d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:19.325157 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e87e6-bb94-49aa-9688-7f3f8f519c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:19.325948 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e87e6-bb94-49aa-9688-7f3f8f519c7b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:19.326258 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e87e6-bb94-49aa-9688-7f3f8f519c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:19.327279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e87e6-bb94-49aa-9688-7f3f8f519c7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:19.327404 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:19.338723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e87e6-bb94-49aa-9688-7f3f8f519c7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:19.339034 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4eea0d69-2447-4b1e-9817-6a1b878d60d2 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:19.340223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e87e6-bb94-49aa-9688-7f3f8f519c7b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:19.340642 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4eea0d69-2447-4b1e-9817-6a1b878d60d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:19.359040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-bc0e87e6-bb94-49aa-9688-7f3f8f519c7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:19.359040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:19.359040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:19.359040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:19.359040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:19.359040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:19.359040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:19.359040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:19.359040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:19.359040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:19.359040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:19.359040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:19.359040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:19.359040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:19.359040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:19.360058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:19.360058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:19.360058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:19.360058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:19.360058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:19.360058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:19.360058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:19.360058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:19.360058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:19.360058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:19.360058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:19.360058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:19.360058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:19.360058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:19.360058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:19.360058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:19.360058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:19.362062 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:19.362062 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:19.362062 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:19.362062 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:19.362062 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 242/504] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:19.362062 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e87e6-bb94-49aa-9688-7f3f8f519c7b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:19.430585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 263/505] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:19.431483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea0d69-2447-4b1e-9817-6a1b878d60d2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:19.500006 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e87e6-bb94-49aa-9688-7f3f8f519c7b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:19.541933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb06b2e-cc6b-40a6-b567-1a3a0a3785ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:19.542766 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb06b2e-cc6b-40a6-b567-1a3a0a3785ce None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:19.543072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb06b2e-cc6b-40a6-b567-1a3a0a3785ce None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:19.543331 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb06b2e-cc6b-40a6-b567-1a3a0a3785ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:19.557022 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb06b2e-cc6b-40a6-b567-1a3a0a3785ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:19.560183 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea0d69-2447-4b1e-9817-6a1b878d60d2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:19.565505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-3cb06b2e-cc6b-40a6-b567-1a3a0a3785ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:19.565505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:19.565505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:19.565505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:19.565505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:19.565505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:19.565505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:19.565505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:19.565505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:19.565505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:19.565505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:19.565505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:19.565505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:19.565505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:19.565505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:19.565505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:19.566751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:19.566751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:19.566751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:19.566751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:19.566751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:19.566751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:19.566751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:19.566751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:19.566751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:19.566751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:19.566751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:19.566751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:19.566751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:19.566751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:19.566751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:19.566751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:19.567825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:19.567825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:19.567825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:19.567825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:19.567825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:19.567825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:19.567825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:19.567825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:19.567825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:19.567825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:19.567825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:19.567825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:19.567825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 243/506] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:24:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:19.569031 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb06b2e-cc6b-40a6-b567-1a3a0a3785ce None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:19.586025 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:19.608444 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734222d4-7553-486e-8f16-bf7bf444c925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:19.609122 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734222d4-7553-486e-8f16-bf7bf444c925 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:19.609410 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734222d4-7553-486e-8f16-bf7bf444c925 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:19.609691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734222d4-7553-486e-8f16-bf7bf444c925 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:19.611073 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734222d4-7553-486e-8f16-bf7bf444c925 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:19.611447 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734222d4-7553-486e-8f16-bf7bf444c925 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:19.612930 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734222d4-7553-486e-8f16-bf7bf444c925 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:19.615172 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:19.674906 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 264/507] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jul 14 15:24:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:19.674906 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734222d4-7553-486e-8f16-bf7bf444c925 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:19.676467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb06b2e-cc6b-40a6-b567-1a3a0a3785ce None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:19.712770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfb204-b5e1-418b-a76e-84131ee67ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:19.713456 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfb204-b5e1-418b-a76e-84131ee67ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:19.713741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfb204-b5e1-418b-a76e-84131ee67ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:19.714017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfb204-b5e1-418b-a76e-84131ee67ec4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:19.726302 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfb204-b5e1-418b-a76e-84131ee67ec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:19.727791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfb204-b5e1-418b-a76e-84131ee67ec4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:19.746314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-cfcfb204-b5e1-418b-a76e-84131ee67ec4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:19.746314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:19.746314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:19.746314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:19.746314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:19.746314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:19.746314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:19.746314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:19.746314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:19.746314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:19.746314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:19.746314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:19.746314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:19.746314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:19.746314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:19.747291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:19.747291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:19.747291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:19.747291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:19.747291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:19.747291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:19.747291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:19.747291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:19.747291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:19.747291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:19.747291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:19.747291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:19.747291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:19.747291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:19.747291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:19.747291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:19.747291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:19.748149 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:19.748149 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:19.748149 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:19.748149 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:19.748149 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 244/508] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:19.748449 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfb204-b5e1-418b-a76e-84131ee67ec4 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:19.790205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734222d4-7553-486e-8f16-bf7bf444c925 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:19.831714 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:19.848815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98021ab-c476-4b3a-9474-3c364fd8d8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:19.849476 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98021ab-c476-4b3a-9474-3c364fd8d8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:19.849754 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98021ab-c476-4b3a-9474-3c364fd8d8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:19.850030 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98021ab-c476-4b3a-9474-3c364fd8d8d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:19.850821 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98021ab-c476-4b3a-9474-3c364fd8d8d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:19.851130 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98021ab-c476-4b3a-9474-3c364fd8d8d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:19.852529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98021ab-c476-4b3a-9474-3c364fd8d8d7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:19.871882 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 265/509] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:19.871882 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98021ab-c476-4b3a-9474-3c364fd8d8d7 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:19.883910 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfb204-b5e1-418b-a76e-84131ee67ec4 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:19.927739 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271eef02-de8c-4ede-b50b-9795955f546b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:19.928006 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:19.928533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271eef02-de8c-4ede-b50b-9795955f546b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:19.928873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271eef02-de8c-4ede-b50b-9795955f546b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:19.929153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271eef02-de8c-4ede-b50b-9795955f546b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:19.940693 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271eef02-de8c-4ede-b50b-9795955f546b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:19.942212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271eef02-de8c-4ede-b50b-9795955f546b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:19.961841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-271eef02-de8c-4ede-b50b-9795955f546b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:19.961841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:19.961841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:19.961841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:19.961841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:19.961841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:19.961841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:19.961841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:19.961841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:19.961841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:19.961841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:19.961841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:19.961841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:19.961841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:19.961841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:19.963069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:19.963069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:19.963069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:19.963069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:19.963069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:19.963069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:19.963069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:19.963069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:19.963069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:19.963069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:19.963069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:19.963069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:19.963069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:19.963069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:19.963069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:19.963069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:19.963069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:19.964160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:19.964160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:19.964160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:19.964160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:19.964160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 245/510] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:19.964160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271eef02-de8c-4ede-b50b-9795955f546b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:19.993836 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98021ab-c476-4b3a-9474-3c364fd8d8d7 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:20.031256 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56165ca8-ca86-4881-b488-0c803b5976e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:20.031922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56165ca8-ca86-4881-b488-0c803b5976e8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:20.032903 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56165ca8-ca86-4881-b488-0c803b5976e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:20.033022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56165ca8-ca86-4881-b488-0c803b5976e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:20.033920 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56165ca8-ca86-4881-b488-0c803b5976e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:20.034264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56165ca8-ca86-4881-b488-0c803b5976e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:20.035688 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56165ca8-ca86-4881-b488-0c803b5976e8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:20.044521 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 266/511] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jul 14 15:24:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:20.045452 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56165ca8-ca86-4881-b488-0c803b5976e8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:20.069813 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271eef02-de8c-4ede-b50b-9795955f546b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:20.088177 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:20.107241 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445bbd1-946c-4a31-80d9-a31f796fa502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:20.107891 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445bbd1-946c-4a31-80d9-a31f796fa502 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:20.108174 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445bbd1-946c-4a31-80d9-a31f796fa502 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:20.108905 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445bbd1-946c-4a31-80d9-a31f796fa502 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:20.167270 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56165ca8-ca86-4881-b488-0c803b5976e8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:20.182452 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445bbd1-946c-4a31-80d9-a31f796fa502 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:20.183426 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:20.183923 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445bbd1-946c-4a31-80d9-a31f796fa502 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:20.205659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedbb75-52cd-43de-bc4b-671792bcb1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:20.206364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedbb75-52cd-43de-bc4b-671792bcb1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:20.206652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedbb75-52cd-43de-bc4b-671792bcb1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:20.206931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedbb75-52cd-43de-bc4b-671792bcb1a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:20.207662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedbb75-52cd-43de-bc4b-671792bcb1a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:20.207973 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedbb75-52cd-43de-bc4b-671792bcb1a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:20.209368 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedbb75-52cd-43de-bc4b-671792bcb1a8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:20.225040 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 267/512] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:20.225816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedbb75-52cd-43de-bc4b-671792bcb1a8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:20.304719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 246/513] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:24:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:20.305589 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445bbd1-946c-4a31-80d9-a31f796fa502 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:20.324458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:20.344470 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedbb75-52cd-43de-bc4b-671792bcb1a8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:20.382959 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492083b7-23cb-463b-b82b-d27746e792ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:20.383759 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492083b7-23cb-463b-b82b-d27746e792ea None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:20.384039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492083b7-23cb-463b-b82b-d27746e792ea None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:20.384313 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492083b7-23cb-463b-b82b-d27746e792ea None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:20.392144 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492083b7-23cb-463b-b82b-d27746e792ea None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:20.393713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492083b7-23cb-463b-b82b-d27746e792ea None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:20.409805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-492083b7-23cb-463b-b82b-d27746e792ea None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:24:20.409805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:20.409805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:20.409805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:20.409805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:20.409805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:20.409805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:20.409805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:20.409805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:20.409805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:20.409805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:20.409805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:20.409805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:20.409805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:20.409805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:20.409805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:20.410956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:20.410956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:20.410956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:20.410956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:20.410956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:20.410956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:20.410956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:20.410956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:20.410956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:20.410956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:20.410956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:20.410956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:20.410956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:20.410956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:20.410956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:20.410956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:20.410956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:20.410956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:20.411858 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:20.411858 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:20.411858 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:20.411858 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:20.411858 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:20.411858 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:20.411858 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:20.411858 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:20.411858 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:24:20.411858 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:20.411858 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 268/514] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:24:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:20.412435 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492083b7-23cb-463b-b82b-d27746e792ea None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:20.420022 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445bbd1-946c-4a31-80d9-a31f796fa502 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:20.451332 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:20.459387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed67a6-e626-4e80-a2c5-16481e1bcd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:20.460060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed67a6-e626-4e80-a2c5-16481e1bcd3d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:20.460355 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed67a6-e626-4e80-a2c5-16481e1bcd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:20.460634 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed67a6-e626-4e80-a2c5-16481e1bcd3d None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:20.461368 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed67a6-e626-4e80-a2c5-16481e1bcd3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:20.461684 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed67a6-e626-4e80-a2c5-16481e1bcd3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:20.463132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed67a6-e626-4e80-a2c5-16481e1bcd3d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:20.476140 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 247/515] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:20.476908 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed67a6-e626-4e80-a2c5-16481e1bcd3d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:20.525856 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492083b7-23cb-463b-b82b-d27746e792ea None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:20.560682 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:20.562850 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731c3f3-2d6e-48fe-8b6d-5f05dbb57637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:20.563729 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731c3f3-2d6e-48fe-8b6d-5f05dbb57637 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:20.564205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731c3f3-2d6e-48fe-8b6d-5f05dbb57637 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:20.564705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731c3f3-2d6e-48fe-8b6d-5f05dbb57637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:20.576798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731c3f3-2d6e-48fe-8b6d-5f05dbb57637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:20.578352 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731c3f3-2d6e-48fe-8b6d-5f05dbb57637 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:20.584603 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed67a6-e626-4e80-a2c5-16481e1bcd3d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:20.597611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-a731c3f3-2d6e-48fe-8b6d-5f05dbb57637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:20.597611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:20.597611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:20.597611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:20.597611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:20.597611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:20.597611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:20.597611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:20.597611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:20.597611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:20.597611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:20.597611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:20.597611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:20.597611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:20.597611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:20.598701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:20.598701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:20.598701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:20.598701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:20.598701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:20.598701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:20.598701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:20.598701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:20.598701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:20.598701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:20.598701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:20.598701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:20.598701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:20.598701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:20.598701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:20.598701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:20.598701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:20.599556 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:20.599556 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:20.599556 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:20.599556 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:20.599556 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 269/516] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:20.599826 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731c3f3-2d6e-48fe-8b6d-5f05dbb57637 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:20.625915 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714181a-85e8-46fe-aedf-be328cb39eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:20.626959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714181a-85e8-46fe-aedf-be328cb39eba None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:20.627246 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714181a-85e8-46fe-aedf-be328cb39eba None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:20.627521 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714181a-85e8-46fe-aedf-be328cb39eba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:20.635007 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714181a-85e8-46fe-aedf-be328cb39eba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:20.636478 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714181a-85e8-46fe-aedf-be328cb39eba None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:20.652132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-4714181a-85e8-46fe-aedf-be328cb39eba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:20.652132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:20.652132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:20.652132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:20.652132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:20.652132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:20.652132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:20.652132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:20.652132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:20.652132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:20.652132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:20.652132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:20.652132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:20.652132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:20.652132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:20.653092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:20.653092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:20.653092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:20.653092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:20.653092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:20.653092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:20.653092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:20.653092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:20.653092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:20.653092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:20.653092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:20.653092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:20.653092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:20.653092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:20.653092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:20.653092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:20.653092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:20.659533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:20.659533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:20.659533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:20.659533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:20.659533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:20.659533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:20.659533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:20.659533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:20.659533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 248/517] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:20.659533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714181a-85e8-46fe-aedf-be328cb39eba None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:20.718168 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:20.738093 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731c3f3-2d6e-48fe-8b6d-5f05dbb57637 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:20.789443 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707329f-98e0-448b-8d9c-8d2d75c60a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:20.790281 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707329f-98e0-448b-8d9c-8d2d75c60a22 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:20.791156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707329f-98e0-448b-8d9c-8d2d75c60a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:20.791156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707329f-98e0-448b-8d9c-8d2d75c60a22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:20.794718 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714181a-85e8-46fe-aedf-be328cb39eba None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:20.801983 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707329f-98e0-448b-8d9c-8d2d75c60a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:20.803903 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707329f-98e0-448b-8d9c-8d2d75c60a22 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:20.825528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-e707329f-98e0-448b-8d9c-8d2d75c60a22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:20.825528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:20.825528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:20.825528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:20.825528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:20.825528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:20.825528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:20.825528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:20.825528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:20.825528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:20.825528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:20.825528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:20.825528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:20.825528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:20.825528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:20.826694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:20.826694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:20.826694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:20.826694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:20.826694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:20.826694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:20.826694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:20.826694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:20.826694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:20.826694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:20.826694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:20.826694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:20.826694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:20.826694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:20.826694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:20.826694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:20.826694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:20.827734 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:20.827734 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:20.827734 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:20.827734 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:20.827734 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 270/518] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:20.828033 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707329f-98e0-448b-8d9c-8d2d75c60a22 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:20.843620 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50548da5-b68f-4095-b58d-d834cf37800d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:20.844301 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50548da5-b68f-4095-b58d-d834cf37800d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:20.844592 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50548da5-b68f-4095-b58d-d834cf37800d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:20.845482 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50548da5-b68f-4095-b58d-d834cf37800d None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:20.846568 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50548da5-b68f-4095-b58d-d834cf37800d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:20.846893 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50548da5-b68f-4095-b58d-d834cf37800d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:20.848431 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50548da5-b68f-4095-b58d-d834cf37800d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:20.857436 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:20.869991 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 249/519] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jul 14 15:24:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:20.870877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50548da5-b68f-4095-b58d-d834cf37800d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:20.943428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707329f-98e0-448b-8d9c-8d2d75c60a22 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:20.980893 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b80dd-b94e-47bc-adf4-6cca4017b251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:20.981595 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b80dd-b94e-47bc-adf4-6cca4017b251 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:20.981875 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b80dd-b94e-47bc-adf4-6cca4017b251 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:20.982198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b80dd-b94e-47bc-adf4-6cca4017b251 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:20.982915 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b80dd-b94e-47bc-adf4-6cca4017b251 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:20.984369 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b80dd-b94e-47bc-adf4-6cca4017b251 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:20.993271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50548da5-b68f-4095-b58d-d834cf37800d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:20.993466 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:21.008000 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 271/520] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jul 14 15:24:20 2022] POST /identity/v3/users => generated 247 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:21.008846 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b80dd-b94e-47bc-adf4-6cca4017b251 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:21.040863 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28675f4-c389-4232-b30f-68168ecc3738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:21.041698 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28675f4-c389-4232-b30f-68168ecc3738 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:21.042000 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28675f4-c389-4232-b30f-68168ecc3738 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:21.042387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28675f4-c389-4232-b30f-68168ecc3738 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:21.043154 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28675f4-c389-4232-b30f-68168ecc3738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:21.043452 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28675f4-c389-4232-b30f-68168ecc3738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:21.044940 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28675f4-c389-4232-b30f-68168ecc3738 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:21.058712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 250/521] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:21.059349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28675f4-c389-4232-b30f-68168ecc3738 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:21.132440 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:21.165527 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b80dd-b94e-47bc-adf4-6cca4017b251 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:21.189655 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28675f4-c389-4232-b30f-68168ecc3738 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:21.213990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c30f6f-3591-42c8-b28e-94eec094d9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:21.214775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c30f6f-3591-42c8-b28e-94eec094d9db None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:21.215061 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c30f6f-3591-42c8-b28e-94eec094d9db None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:21.215337 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c30f6f-3591-42c8-b28e-94eec094d9db None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:21.216860 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c30f6f-3591-42c8-b28e-94eec094d9db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:21.216860 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c30f6f-3591-42c8-b28e-94eec094d9db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:21.218818 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c30f6f-3591-42c8-b28e-94eec094d9db None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:21.239553 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e6a5c-c571-4233-9bb4-8cad69ff94d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:21.240724 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e6a5c-c571-4233-9bb4-8cad69ff94d9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:21.241237 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e6a5c-c571-4233-9bb4-8cad69ff94d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:21.241746 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e6a5c-c571-4233-9bb4-8cad69ff94d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:21.246163 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e6a5c-c571-4233-9bb4-8cad69ff94d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:21.246163 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e6a5c-c571-4233-9bb4-8cad69ff94d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:21.246163 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e6a5c-c571-4233-9bb4-8cad69ff94d9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:21.246461 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 272/522] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:24:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:21.247138 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c30f6f-3591-42c8-b28e-94eec094d9db None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:21.263555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 251/523] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:21.264432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e6a5c-c571-4233-9bb4-8cad69ff94d9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:21.317008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:21.383149 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c30f6f-3591-42c8-b28e-94eec094d9db None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:21.396050 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e6a5c-c571-4233-9bb4-8cad69ff94d9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:21.414926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:21.438799 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98f9b-36de-47b0-9cb9-53549d1b88f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:21.439528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98f9b-36de-47b0-9cb9-53549d1b88f6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:21.439902 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98f9b-36de-47b0-9cb9-53549d1b88f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:21.440172 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98f9b-36de-47b0-9cb9-53549d1b88f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:21.445905 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a3b41-e69d-4311-b914-44e8ab1102d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:21.446765 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a3b41-e69d-4311-b914-44e8ab1102d5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:21.447051 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a3b41-e69d-4311-b914-44e8ab1102d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:21.447328 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a3b41-e69d-4311-b914-44e8ab1102d5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:21.457197 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a3b41-e69d-4311-b914-44e8ab1102d5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:21.458672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a3b41-e69d-4311-b914-44e8ab1102d5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:21.474723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-9e5a3b41-e69d-4311-b914-44e8ab1102d5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 15:24:21.474723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:21.474723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:21.474723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:21.474723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:21.474723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:21.474723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:21.474723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:21.474723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:21.474723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:21.474723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:21.474723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:21.474723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:21.474723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:21.474723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:21.474723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:21.475919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:21.475919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:21.475919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:21.475919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:21.475919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:21.475919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:21.475919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:21.475919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:21.475919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:21.475919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:21.475919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:21.475919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:21.475919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:21.475919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:21.475919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:21.475919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:21.475919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:21.475919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:21.476861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:21.476861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:21.476861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:21.476861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:21.476861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:21.476861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:21.476861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:21.476861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:21.476861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 15:24:21.476861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:21.476861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 252/524] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:24:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:21.477536 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a3b41-e69d-4311-b914-44e8ab1102d5 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:21.534133 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b98f9b-36de-47b0-9cb9-53549d1b88f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:21.535628 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b98f9b-36de-47b0-9cb9-53549d1b88f6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:21.600177 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:21.616513 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a3b41-e69d-4311-b914-44e8ab1102d5 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:21.660510 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 273/525] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:24:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:21.661371 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98f9b-36de-47b0-9cb9-53549d1b88f6 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:21.670164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a84ff-247f-4678-93c3-c9b1487e4b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:21.671886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a84ff-247f-4678-93c3-c9b1487e4b1b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:21.672848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a84ff-247f-4678-93c3-c9b1487e4b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:21.673344 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a84ff-247f-4678-93c3-c9b1487e4b1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:21.675114 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a84ff-247f-4678-93c3-c9b1487e4b1b None admin] RBAC: Adding query filter params (role.id=1d73a20858554285862ec7d933eb6149, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=64f6b597a47c4a0eb08d1eabc4c0305c) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:21.675953 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a84ff-247f-4678-93c3-c9b1487e4b1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:21.677909 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a84ff-247f-4678-93c3-c9b1487e4b1b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:21.686116 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 253/526] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:24:21 2022] GET /identity/v3/role_assignments?user.id=64f6b597a47c4a0eb08d1eabc4c0305c&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=1d73a20858554285862ec7d933eb6149 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:21.687471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a84ff-247f-4678-93c3-c9b1487e4b1b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:21.774958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:21.802189 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98f9b-36de-47b0-9cb9-53549d1b88f6 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:21.846271 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8c5f3-44b6-48af-b8ae-e8338268c822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:21.847117 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8c5f3-44b6-48af-b8ae-e8338268c822 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:21.847404 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8c5f3-44b6-48af-b8ae-e8338268c822 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:21.847686 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8c5f3-44b6-48af-b8ae-e8338268c822 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:21.856530 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8c5f3-44b6-48af-b8ae-e8338268c822 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:21.858044 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8c5f3-44b6-48af-b8ae-e8338268c822 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:21.871364 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a84ff-247f-4678-93c3-c9b1487e4b1b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:21.875531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-2ec8c5f3-44b6-48af-b8ae-e8338268c822 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:21.875531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:21.875531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:21.875531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:21.875531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:21.875531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:21.875531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:21.875531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:21.875531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:21.875531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:21.875531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:21.875531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:21.875531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:21.875531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:21.875531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:21.876783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:21.876783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:21.876783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:21.876783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:21.876783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:21.876783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:21.876783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:21.876783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:21.876783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:21.876783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:21.876783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:21.876783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:21.876783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:21.876783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:21.876783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:21.876783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:21.876783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:21.877943 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:21.877943 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:21.877943 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:21.877943 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:21.877943 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:21.877943 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:21.877943 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:21.877943 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:21.877943 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 274/527] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:21.878458 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8c5f3-44b6-48af-b8ae-e8338268c822 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:21.901846 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:21.922683 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d1ac0-670a-422a-97c6-ee6c2c16b4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:21.923908 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d1ac0-670a-422a-97c6-ee6c2c16b4da None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:21.924449 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d1ac0-670a-422a-97c6-ee6c2c16b4da None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:21.924905 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d1ac0-670a-422a-97c6-ee6c2c16b4da None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:21.926110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d1ac0-670a-422a-97c6-ee6c2c16b4da None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:21.926701 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d1ac0-670a-422a-97c6-ee6c2c16b4da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:21.928447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d1ac0-670a-422a-97c6-ee6c2c16b4da None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:21.957065 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 254/528] 10.222.0.39 () {56 vars in 1139 bytes} [Thu Jul 14 15:24:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:21.958575 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d1ac0-670a-422a-97c6-ee6c2c16b4da None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:22.018426 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8c5f3-44b6-48af-b8ae-e8338268c822 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:22.072810 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b2a56-1033-4fa6-a356-c66fa201b44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:22.073978 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b2a56-1033-4fa6-a356-c66fa201b44a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:22.074554 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b2a56-1033-4fa6-a356-c66fa201b44a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:22.075069 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b2a56-1033-4fa6-a356-c66fa201b44a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:22.085132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:22.089455 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d1ac0-670a-422a-97c6-ee6c2c16b4da None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:22.091529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b2a56-1033-4fa6-a356-c66fa201b44a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:22.093866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b2a56-1033-4fa6-a356-c66fa201b44a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:22.113475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-440b2a56-1033-4fa6-a356-c66fa201b44a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:22.113475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:22.113475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:22.113475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:22.113475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:22.113475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:22.113475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:22.113475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:22.113475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:22.113475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:22.113475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:22.113475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:22.113475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:22.113475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:22.113475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:22.114672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:22.114672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:22.114672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:22.114672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:22.114672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:22.114672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:22.114672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:22.114672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:22.114672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:22.114672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:22.114672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:22.114672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:22.114672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:22.114672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:22.114672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:22.114672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:22.114672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:22.115632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:22.115632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:22.115632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:22.115632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:22.117500 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 275/529] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:22.118734 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b2a56-1033-4fa6-a356-c66fa201b44a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:22.138838 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17bd13-063e-47fc-80c7-499c69959e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:22.139925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17bd13-063e-47fc-80c7-499c69959e6a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:22.140392 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17bd13-063e-47fc-80c7-499c69959e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:22.140876 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17bd13-063e-47fc-80c7-499c69959e6a None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:22.142280 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17bd13-063e-47fc-80c7-499c69959e6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:22.143027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17bd13-063e-47fc-80c7-499c69959e6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:22.144799 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17bd13-063e-47fc-80c7-499c69959e6a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:22.166834 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 255/530] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:24:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:22.168222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17bd13-063e-47fc-80c7-499c69959e6a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:22.213795 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:22.263263 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b2a56-1033-4fa6-a356-c66fa201b44a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:22.295059 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17bd13-063e-47fc-80c7-499c69959e6a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:22.314023 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf8b69-d785-43b3-9c47-96cb283d1dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:22.314863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf8b69-d785-43b3-9c47-96cb283d1dab None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:22.315347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf8b69-d785-43b3-9c47-96cb283d1dab None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:22.315641 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf8b69-d785-43b3-9c47-96cb283d1dab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:22.339393 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cde2f-db33-43e0-b2af-1fa4b8a58868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:22.340141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cde2f-db33-43e0-b2af-1fa4b8a58868 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:22.340527 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cde2f-db33-43e0-b2af-1fa4b8a58868 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:22.340919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cde2f-db33-43e0-b2af-1fa4b8a58868 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:22.341833 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cde2f-db33-43e0-b2af-1fa4b8a58868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:22.342321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cde2f-db33-43e0-b2af-1fa4b8a58868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:22.343876 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cde2f-db33-43e0-b2af-1fa4b8a58868 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:22.358262 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 256/531] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:22.359257 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cde2f-db33-43e0-b2af-1fa4b8a58868 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:22.388308 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:22.409434 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf8b69-d785-43b3-9c47-96cb283d1dab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:22.411159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf8b69-d785-43b3-9c47-96cb283d1dab None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:22.494592 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:22.514584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cde2f-db33-43e0-b2af-1fa4b8a58868 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:22.544876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 276/532] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:24:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:22.545748 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf8b69-d785-43b3-9c47-96cb283d1dab None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:22.562648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e840f-15e6-49c0-b023-a80b1d9fc251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:22.565161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e840f-15e6-49c0-b023-a80b1d9fc251 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:22.565808 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e840f-15e6-49c0-b023-a80b1d9fc251 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:22.566432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e840f-15e6-49c0-b023-a80b1d9fc251 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:22.567512 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e840f-15e6-49c0-b023-a80b1d9fc251 None admin] RBAC: Adding query filter params (role.id=1d73a20858554285862ec7d933eb6149, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=14c582c1127142f8a4ebf64bb7b34516) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:22.568129 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e840f-15e6-49c0-b023-a80b1d9fc251 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:22.570052 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e840f-15e6-49c0-b023-a80b1d9fc251 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:22.577858 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 257/533] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:24:22 2022] GET /identity/v3/role_assignments?user.id=14c582c1127142f8a4ebf64bb7b34516&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=1d73a20858554285862ec7d933eb6149 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:22.580146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e840f-15e6-49c0-b023-a80b1d9fc251 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:22.691482 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf8b69-d785-43b3-9c47-96cb283d1dab None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:22.751311 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:22.758269 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eee787-a395-4356-955a-8b2448ceba2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:22.759088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eee787-a395-4356-955a-8b2448ceba2a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:22.759368 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eee787-a395-4356-955a-8b2448ceba2a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:22.759639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eee787-a395-4356-955a-8b2448ceba2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:22.781802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eee787-a395-4356-955a-8b2448ceba2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:22.788895 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e840f-15e6-49c0-b023-a80b1d9fc251 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:22.792612 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eee787-a395-4356-955a-8b2448ceba2a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:22.810105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-45eee787-a395-4356-955a-8b2448ceba2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:22.810105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:22.810105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:22.810105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:22.810105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:22.810105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:22.810105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:22.810105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:22.810105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:22.810105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:22.810105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:22.810105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:22.810105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:22.810105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:22.810105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:22.812220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:22.812220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:22.812220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:22.812220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:22.812220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:22.812220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:22.812220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:22.812220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:22.812220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:22.812220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:22.812220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:22.812220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:22.812220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:22.812220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:22.812220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:22.812220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:22.812220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:22.815412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:22.815412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:22.815412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:22.815412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:22.815412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:22.815412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:22.815412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:22.815412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:22.815412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 277/534] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:22.817928 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eee787-a395-4356-955a-8b2448ceba2a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:22.851935 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:22.866011 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f9fbf-8935-48c9-9e58-3e43ced13f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:22.870152 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f9fbf-8935-48c9-9e58-3e43ced13f44 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:22.872677 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f9fbf-8935-48c9-9e58-3e43ced13f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:22.874052 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f9fbf-8935-48c9-9e58-3e43ced13f44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:22.912636 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f9fbf-8935-48c9-9e58-3e43ced13f44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:22.915677 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f9fbf-8935-48c9-9e58-3e43ced13f44 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:22.959056 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eee787-a395-4356-955a-8b2448ceba2a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:22.964251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-9d8f9fbf-8935-48c9-9e58-3e43ced13f44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:22.964251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:22.964251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:22.964251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:22.964251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:22.964251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:22.964251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:22.964251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:22.964251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:22.964251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:22.964251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:22.964251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:22.964251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:22.964251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:22.964251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:22.965802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:22.965802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:22.965802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:22.965802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:22.965802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:22.965802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:22.965802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:22.965802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:22.965802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:22.965802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:22.965802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:22.965802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:22.965802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:22.965802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:22.965802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:22.965802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:22.965802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:22.967403 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:22.967403 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:22.967403 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:22.967403 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:22.973054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 258/535] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:22.974020 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f9fbf-8935-48c9-9e58-3e43ced13f44 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:23.031138 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f97f54-6a6f-4025-8451-4b75c863e25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:23.032000 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f97f54-6a6f-4025-8451-4b75c863e25c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:23.032493 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f97f54-6a6f-4025-8451-4b75c863e25c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:23.033159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f97f54-6a6f-4025-8451-4b75c863e25c None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:23.033760 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f97f54-6a6f-4025-8451-4b75c863e25c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:23.034106 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f97f54-6a6f-4025-8451-4b75c863e25c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:23.039126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f97f54-6a6f-4025-8451-4b75c863e25c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:23.071455 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 278/536] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:24:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:23.077912 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f97f54-6a6f-4025-8451-4b75c863e25c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:23.207277 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f9fbf-8935-48c9-9e58-3e43ced13f44 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:23.222580 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:23.244006 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f97f54-6a6f-4025-8451-4b75c863e25c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:23.273713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa9d4f-1de4-4808-adc9-ec4fdfe73db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:23.274421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa9d4f-1de4-4808-adc9-ec4fdfe73db1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:23.274711 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa9d4f-1de4-4808-adc9-ec4fdfe73db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:23.274992 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa9d4f-1de4-4808-adc9-ec4fdfe73db1 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:23.275777 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa9d4f-1de4-4808-adc9-ec4fdfe73db1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:23.276090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa9d4f-1de4-4808-adc9-ec4fdfe73db1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:23.277491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa9d4f-1de4-4808-adc9-ec4fdfe73db1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:23.279242 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:23.293084 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d32cde-aa1a-48e3-8e4c-cf89297ca42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:23.294731 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d32cde-aa1a-48e3-8e4c-cf89297ca42e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:23.295426 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d32cde-aa1a-48e3-8e4c-cf89297ca42e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:23.296097 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d32cde-aa1a-48e3-8e4c-cf89297ca42e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:23.297890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d32cde-aa1a-48e3-8e4c-cf89297ca42e None admin] RBAC: Adding query filter params (role.id=1d73a20858554285862ec7d933eb6149, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=78d5b8b2802a44eead863280df22b027) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:23.298977 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d32cde-aa1a-48e3-8e4c-cf89297ca42e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:23.301790 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d32cde-aa1a-48e3-8e4c-cf89297ca42e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:23.308233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 279/537] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:24:23 2022] GET /identity/v3/role_assignments?user.id=78d5b8b2802a44eead863280df22b027&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=1d73a20858554285862ec7d933eb6149 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:23.312769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 259/538] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:23.319232 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d32cde-aa1a-48e3-8e4c-cf89297ca42e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:23.493473 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d32cde-aa1a-48e3-8e4c-cf89297ca42e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:23.509091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d58e26-cf24-495d-bf97-d329931573a5 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:23.509389 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d58e26-cf24-495d-bf97-d329931573a5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:23.509672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d58e26-cf24-495d-bf97-d329931573a5 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:23.512286 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 260/539] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:23.522038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22aff8e-7b68-4565-a757-b7f146a56a5b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:23.522361 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22aff8e-7b68-4565-a757-b7f146a56a5b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:23.522642 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22aff8e-7b68-4565-a757-b7f146a56a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:23.544243 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bf31e-2a48-4fed-9f87-33e370b5b22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:23.545439 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bf31e-2a48-4fed-9f87-33e370b5b22b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:23.545928 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bf31e-2a48-4fed-9f87-33e370b5b22b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:23.546423 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bf31e-2a48-4fed-9f87-33e370b5b22b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:23.555400 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bf31e-2a48-4fed-9f87-33e370b5b22b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:23.557279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bf31e-2a48-4fed-9f87-33e370b5b22b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:23.563851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d22aff8e-7b68-4565-a757-b7f146a56a5b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:23.565402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d22aff8e-7b68-4565-a757-b7f146a56a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:23.577619 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-ee4bf31e-2a48-4fed-9f87-33e370b5b22b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:23.577619 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:23.577619 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:23.577619 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:23.577619 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:23.577619 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:23.577619 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:23.577619 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:23.577619 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:23.577619 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:23.577619 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:23.577619 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:23.577619 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:23.577619 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:23.577619 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:23.578635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:23.578635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:23.578635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:23.578635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:23.578635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:23.578635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:23.578635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:23.578635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:23.578635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:23.578635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:23.578635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:23.578635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:23.578635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:23.578635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:23.578635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:23.578635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:23.578635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:23.579626 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:23.579626 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:23.579626 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:23.579626 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:23.579626 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:23.579626 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:23.579626 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:23.579626 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:23.581748 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 280/540] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:23.603091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bf31e-2a48-4fed-9f87-33e370b5b22b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:23.623396 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:23.714989 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 261/541] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:23.761172 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22aff8e-7b68-4565-a757-b7f146a56a5b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:23.811418 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bf31e-2a48-4fed-9f87-33e370b5b22b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:23.870928 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b97b9-0b18-454d-86bc-9263596a87fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:23.871609 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b97b9-0b18-454d-86bc-9263596a87fb None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:23.871894 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b97b9-0b18-454d-86bc-9263596a87fb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:23.872168 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b97b9-0b18-454d-86bc-9263596a87fb None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:23.872962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b97b9-0b18-454d-86bc-9263596a87fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:23.873283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b97b9-0b18-454d-86bc-9263596a87fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:23.874769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b97b9-0b18-454d-86bc-9263596a87fb None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:23.906761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 281/542] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:24:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:23.926639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b97b9-0b18-454d-86bc-9263596a87fb None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:23.949850 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22aff8e-7b68-4565-a757-b7f146a56a5b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:23.979424 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:23.998253 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c2696-bf2a-44eb-ab64-07099e666853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:23.999103 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c2696-bf2a-44eb-ab64-07099e666853 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:23.999385 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c2696-bf2a-44eb-ab64-07099e666853 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:23.999655 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c2696-bf2a-44eb-ab64-07099e666853 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:24.022764 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:24.027218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c2696-bf2a-44eb-ab64-07099e666853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:24.043672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-735c2696-bf2a-44eb-ab64-07099e666853 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:24.043672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:24.043672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:24.043672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:24.043672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:24.043672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:24.043672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:24.043672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:24.043672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:24.043672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:24.043672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:24.043672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:24.043672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:24.043672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:24.043672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:24.043672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:24.044670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:24.044670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:24.044670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:24.044670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:24.044670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:24.044670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:24.044670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:24.044670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:24.044670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:24.044670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:24.044670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:24.044670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:24.044670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:24.044670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:24.044670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:24.044670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:24.045459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:24.045459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:24.045459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:24.045459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:24.045459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:24.045459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:24.045459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:24.045459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:24.045459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:24.045459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:24.045459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:24.045459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:24.045459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 262/543] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:24:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:24.053084 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c2696-bf2a-44eb-ab64-07099e666853 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:24.066910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b97b9-0b18-454d-86bc-9263596a87fb None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:24.106259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40605d-82fc-4eb8-9190-e04c53209599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:24.106907 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40605d-82fc-4eb8-9190-e04c53209599 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:24.107195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40605d-82fc-4eb8-9190-e04c53209599 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:24.107476 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40605d-82fc-4eb8-9190-e04c53209599 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:24.108319 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40605d-82fc-4eb8-9190-e04c53209599 None admin] RBAC: Adding query filter params (role.id=1d73a20858554285862ec7d933eb6149, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=7b82de4816a244c0b62b5f9f894ccaf4) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:24.108638 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40605d-82fc-4eb8-9190-e04c53209599 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:24.110173 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40605d-82fc-4eb8-9190-e04c53209599 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:24.117657 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 282/544] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:24:23 2022] GET /identity/v3/role_assignments?user.id=7b82de4816a244c0b62b5f9f894ccaf4&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=1d73a20858554285862ec7d933eb6149 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:24.194585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f58cc-8774-4689-b8f5-7bed5c6eabf3 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:24.197358 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f58cc-8774-4689-b8f5-7bed5c6eabf3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:24.197649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f58cc-8774-4689-b8f5-7bed5c6eabf3 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:24.200784 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 283/545] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:24:24.208916 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6989850-d83f-489e-8936-e5c677441425 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:24.209255 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6989850-d83f-489e-8936-e5c677441425 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:24.209487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6989850-d83f-489e-8936-e5c677441425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:24.251793 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c6989850-d83f-489e-8936-e5c677441425 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:24.253701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c6989850-d83f-489e-8936-e5c677441425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:24.261622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c2696-bf2a-44eb-ab64-07099e666853 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:24.322543 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a9071-8249-4e88-b76c-30fc0a765c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:24.324438 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a9071-8249-4e88-b76c-30fc0a765c0c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:24.325460 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a9071-8249-4e88-b76c-30fc0a765c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:24.327310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a9071-8249-4e88-b76c-30fc0a765c0c None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:24.328320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a9071-8249-4e88-b76c-30fc0a765c0c None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:24.329813 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a9071-8249-4e88-b76c-30fc0a765c0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:24.331473 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a9071-8249-4e88-b76c-30fc0a765c0c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:24.349916 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 263/546] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jul 14 15:24:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:24.357858 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a9071-8249-4e88-b76c-30fc0a765c0c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:24.414105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 284/547] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:24.422925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:24.476582 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6989850-d83f-489e-8936-e5c677441425 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:24.504319 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a9071-8249-4e88-b76c-30fc0a765c0c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:24.542924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f321b-b9ef-4efd-806f-08e333facbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:24.543967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f321b-b9ef-4efd-806f-08e333facbc5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:24.544308 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f321b-b9ef-4efd-806f-08e333facbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:24.544671 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f321b-b9ef-4efd-806f-08e333facbc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:24.559475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f321b-b9ef-4efd-806f-08e333facbc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:24.561595 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f321b-b9ef-4efd-806f-08e333facbc5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:24.592203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-831f321b-b9ef-4efd-806f-08e333facbc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:24.592203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:24.592203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:24.592203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:24.592203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:24.592203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:24.592203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:24.592203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:24.592203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:24.592203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:24.592203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:24.592203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:24.592203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:24.592203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:24.592203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:24.593272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:24.593272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:24.593272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:24.593272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:24.593272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:24.593272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:24.593272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:24.593272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:24.593272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:24.593272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:24.593272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:24.593272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:24.593272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:24.593272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:24.593272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:24.593272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:24.593272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:24.594719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:24.594719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:24.594719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:24.594719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:24.594719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 264/548] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:24.600132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f321b-b9ef-4efd-806f-08e333facbc5 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:24.634582 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:24.712868 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6989850-d83f-489e-8936-e5c677441425 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:24.722476 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:24.726721 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f321b-b9ef-4efd-806f-08e333facbc5 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:24.776068 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd2a39-3440-4833-9d1f-d4f3941cc116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:24.776783 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd2a39-3440-4833-9d1f-d4f3941cc116 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:24.777066 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd2a39-3440-4833-9d1f-d4f3941cc116 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:24.777342 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd2a39-3440-4833-9d1f-d4f3941cc116 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:24.778095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd2a39-3440-4833-9d1f-d4f3941cc116 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:24.778408 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd2a39-3440-4833-9d1f-d4f3941cc116 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:24.779825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd2a39-3440-4833-9d1f-d4f3941cc116 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:24.793994 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 265/549] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:24.800715 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd2a39-3440-4833-9d1f-d4f3941cc116 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:24.826372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68448ef-0f33-4023-b8a2-2352a842480e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:24.827234 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68448ef-0f33-4023-b8a2-2352a842480e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:24.827520 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68448ef-0f33-4023-b8a2-2352a842480e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:24.827797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68448ef-0f33-4023-b8a2-2352a842480e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:24.861375 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68448ef-0f33-4023-b8a2-2352a842480e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:24.874963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-d68448ef-0f33-4023-b8a2-2352a842480e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:24.874963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:24.874963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:24.874963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:24.874963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:24.874963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:24.874963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:24.874963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:24.874963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:24.874963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:24.874963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:24.874963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:24.874963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:24.874963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:24.874963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:24.874963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:24.877622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:24.877622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:24.877622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:24.877622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:24.877622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:24.877622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:24.877622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:24.877622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:24.877622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:24.877622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:24.877622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:24.877622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:24.877622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:24.877622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:24.877622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:24.877622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:24.878567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:24.878567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:24.878567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:24.878567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:24.878567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:24.878567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:24.878567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:24.878567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:24.878567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:24.878567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:24.878567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:24.878567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:24.881113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 285/550] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:24:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:24.892459 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68448ef-0f33-4023-b8a2-2352a842480e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:25.036710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd2a39-3440-4833-9d1f-d4f3941cc116 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:25.102937 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68448ef-0f33-4023-b8a2-2352a842480e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:25.120103 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b14b4a-8e61-4a80-a286-0c5467c0b12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:25.120870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b14b4a-8e61-4a80-a286-0c5467c0b12a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:25.121166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b14b4a-8e61-4a80-a286-0c5467c0b12a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:25.121365 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b14b4a-8e61-4a80-a286-0c5467c0b12a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:25.135449 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b14b4a-8e61-4a80-a286-0c5467c0b12a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:25.137743 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b14b4a-8e61-4a80-a286-0c5467c0b12a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:25.159343 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:25.169432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-b2b14b4a-8e61-4a80-a286-0c5467c0b12a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:24:25.169432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:25.169432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:25.169432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:25.169432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:25.169432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:25.169432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:25.169432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:25.169432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:25.169432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:25.169432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:25.169432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:25.169432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:25.169432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:25.169432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:25.169432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:25.170481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:25.170481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:25.170481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:25.170481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:25.170481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:25.170481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:25.170481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:25.170481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:25.170481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:25.170481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:25.170481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:25.170481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:25.170481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:25.170481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:25.170481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:25.170481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:25.170481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:25.170481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:25.172279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:25.172279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:25.172279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:25.172279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:25.172279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:25.172279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:25.172279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:25.172279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:25.172279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:24:25.172279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:25.172279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 266/551] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:24:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:25.177290 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b14b4a-8e61-4a80-a286-0c5467c0b12a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:25.190427 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c135f56-2937-4a6d-863e-65ca58cd61f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:25.191119 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c135f56-2937-4a6d-863e-65ca58cd61f4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:25.191398 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c135f56-2937-4a6d-863e-65ca58cd61f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:25.191765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c135f56-2937-4a6d-863e-65ca58cd61f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:25.192530 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c135f56-2937-4a6d-863e-65ca58cd61f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:25.192836 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c135f56-2937-4a6d-863e-65ca58cd61f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:25.194256 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c135f56-2937-4a6d-863e-65ca58cd61f4 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:25.216215 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 286/552] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jul 14 15:24:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:25.220920 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:25.225656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c135f56-2937-4a6d-863e-65ca58cd61f4 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:25.374443 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b14b4a-8e61-4a80-a286-0c5467c0b12a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:25.420504 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e786bf-4dd0-4189-8c94-920170783817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:25.421241 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e786bf-4dd0-4189-8c94-920170783817 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:25.421528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e786bf-4dd0-4189-8c94-920170783817 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:25.421804 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e786bf-4dd0-4189-8c94-920170783817 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:25.422745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e786bf-4dd0-4189-8c94-920170783817 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:25.423065 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e786bf-4dd0-4189-8c94-920170783817 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:25.427355 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e786bf-4dd0-4189-8c94-920170783817 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:25.437266 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c135f56-2937-4a6d-863e-65ca58cd61f4 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:25.453593 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 267/553] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jul 14 15:24:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:25.455822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cacbd-4518-4d6b-bea7-166778afce8e None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:25.456284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cacbd-4518-4d6b-bea7-166778afce8e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:25.456566 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cacbd-4518-4d6b-bea7-166778afce8e None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:25.462753 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 268/554] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:25.463765 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cacbd-4518-4d6b-bea7-166778afce8e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:25.487542 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055740d-b230-44b6-ba5a-eddd9a65aba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:25.489012 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055740d-b230-44b6-ba5a-eddd9a65aba6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:25.489953 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055740d-b230-44b6-ba5a-eddd9a65aba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:25.490492 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055740d-b230-44b6-ba5a-eddd9a65aba6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:25.507109 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055740d-b230-44b6-ba5a-eddd9a65aba6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:25.508952 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055740d-b230-44b6-ba5a-eddd9a65aba6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:25.540107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-c055740d-b230-44b6-ba5a-eddd9a65aba6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:25.540107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:25.540107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:25.540107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:25.540107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:25.540107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:25.540107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:25.540107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:25.540107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:25.540107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:25.540107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:25.540107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:25.540107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:25.540107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:25.540107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:25.541058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:25.541058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:25.541058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:25.541058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:25.541058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:25.541058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:25.541058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:25.541058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:25.541058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:25.541058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:25.541058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:25.541058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:25.541058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:25.541058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:25.541058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:25.541058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:25.541058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:25.541931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:25.541931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:25.541931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:25.541931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:25.544301 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 287/555] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:25.545890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68c57f-617e-4afb-962e-56ee383d62c3 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:25.546429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68c57f-617e-4afb-962e-56ee383d62c3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:25.546948 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68c57f-617e-4afb-962e-56ee383d62c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:25.566795 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-af68c57f-617e-4afb-962e-56ee383d62c3 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:25.568491 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-af68c57f-617e-4afb-962e-56ee383d62c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:25.569301 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:25.605028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cacbd-4518-4d6b-bea7-166778afce8e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:25.624321 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:25.648133 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f64280-a5b0-4e47-b04a-61fcc61dc7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:25.648703 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f64280-a5b0-4e47-b04a-61fcc61dc7ba None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:25.648988 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f64280-a5b0-4e47-b04a-61fcc61dc7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:25.649266 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f64280-a5b0-4e47-b04a-61fcc61dc7ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:25.666624 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 288/556] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:25.667958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68c57f-617e-4afb-962e-56ee383d62c3 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:25.763736 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f64280-a5b0-4e47-b04a-61fcc61dc7ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:25.765365 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f64280-a5b0-4e47-b04a-61fcc61dc7ba None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:25.804393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68c57f-617e-4afb-962e-56ee383d62c3 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:25.856477 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:25.869088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece51668-cfed-44bc-b437-6870937a5922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:25.869868 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece51668-cfed-44bc-b437-6870937a5922 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:25.870045 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece51668-cfed-44bc-b437-6870937a5922 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:25.870444 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece51668-cfed-44bc-b437-6870937a5922 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:25.871572 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece51668-cfed-44bc-b437-6870937a5922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:25.871889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece51668-cfed-44bc-b437-6870937a5922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:25.873796 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece51668-cfed-44bc-b437-6870937a5922 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:25.889209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 269/557] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:24:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:25.889209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f64280-a5b0-4e47-b04a-61fcc61dc7ba None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:25.899092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 289/558] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:25.903812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344966b5-9549-4c12-b691-b8eb3ec47b05 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:25.903812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344966b5-9549-4c12-b691-b8eb3ec47b05 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:25.903812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344966b5-9549-4c12-b691-b8eb3ec47b05 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:25.905111 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 290/559] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:25.906158 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344966b5-9549-4c12-b691-b8eb3ec47b05 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:25.942393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:26.008844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f64280-a5b0-4e47-b04a-61fcc61dc7ba None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:26.041352 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344966b5-9549-4c12-b691-b8eb3ec47b05 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:26.052506 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a738c-0f06-451e-89ad-5096be627d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:26.054023 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a738c-0f06-451e-89ad-5096be627d71 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:26.054988 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a738c-0f06-451e-89ad-5096be627d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:26.055351 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a738c-0f06-451e-89ad-5096be627d71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:26.067429 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a738c-0f06-451e-89ad-5096be627d71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:26.075384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-b89a738c-0f06-451e-89ad-5096be627d71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:26.075384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:26.075384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:26.075384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:26.075384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:26.075384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:26.075384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:26.075384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:26.075384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:26.075384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:26.075384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:26.075384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:26.075384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:26.075384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:26.075384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:26.075384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:26.076559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:26.076559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:26.076559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:26.076559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:26.076559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:26.076559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:26.076559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:26.076559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:26.076559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:26.076559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:26.076559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:26.076559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:26.076559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:26.076559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:26.076559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:26.076559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:26.077516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:26.077516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:26.077516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:26.077516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:26.077516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:26.077516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:26.077516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:26.077516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:26.077516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:26.077516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:26.077516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:26.077516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:26.077516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 270/560] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:24:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:26.083393 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a738c-0f06-451e-89ad-5096be627d71 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:26.086281 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28929a81-ae39-400a-81c1-07623148754e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:26.087965 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28929a81-ae39-400a-81c1-07623148754e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:26.088255 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28929a81-ae39-400a-81c1-07623148754e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:26.088531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28929a81-ae39-400a-81c1-07623148754e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:26.102609 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28929a81-ae39-400a-81c1-07623148754e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:26.105129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28929a81-ae39-400a-81c1-07623148754e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:26.124825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:26.129393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-28929a81-ae39-400a-81c1-07623148754e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:26.129393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:26.129393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:26.129393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:26.129393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:26.129393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:26.129393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:26.129393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:26.129393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:26.129393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:26.129393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:26.129393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:26.129393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:26.129393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:26.129393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:26.130481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:26.130481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:26.130481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:26.130481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:26.130481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:26.130481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:26.130481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:26.130481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:26.130481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:26.130481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:26.130481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:26.130481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:26.130481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:26.130481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:26.130481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:26.130481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:26.130481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:26.131391 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:26.131391 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:26.131391 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:26.131391 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:26.135267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 291/561] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:26.136535 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52277623-1632-44f2-b89f-6bbff71e9de8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:26.136820 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52277623-1632-44f2-b89f-6bbff71e9de8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:26.137098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52277623-1632-44f2-b89f-6bbff71e9de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:26.154780 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-52277623-1632-44f2-b89f-6bbff71e9de8 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:26.155883 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-52277623-1632-44f2-b89f-6bbff71e9de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:26.215857 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a738c-0f06-451e-89ad-5096be627d71 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:26.258128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 292/562] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:26.258128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52277623-1632-44f2-b89f-6bbff71e9de8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:26.284517 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:26.293251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbd752-6f8a-4059-8338-572b9217bd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:26.294337 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbd752-6f8a-4059-8338-572b9217bd8f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:26.294758 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbd752-6f8a-4059-8338-572b9217bd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:26.295172 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbd752-6f8a-4059-8338-572b9217bd8f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:26.306721 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbd752-6f8a-4059-8338-572b9217bd8f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:26.309132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbd752-6f8a-4059-8338-572b9217bd8f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:26.330143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-86dbd752-6f8a-4059-8338-572b9217bd8f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:26.330143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:26.330143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:26.330143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:26.330143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:26.330143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:26.330143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:26.330143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:26.330143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:26.330143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:26.330143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:26.330143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:26.330143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:26.330143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:26.330143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:26.330143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:26.331343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:26.331343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:26.331343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:26.331343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:26.331343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:26.331343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:26.331343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:26.331343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:26.331343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:26.331343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:26.331343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:26.331343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:26.331343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:26.331343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:26.331343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:26.331343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:26.331343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:26.331343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:26.332520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:26.332520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:26.332520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:26.332520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:26.332520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:26.332520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:26.332520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:26.332520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:26.332520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:26.332520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:26.332520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 271/563] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jul 14 15:24:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:26.332520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbd752-6f8a-4059-8338-572b9217bd8f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:26.410591 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52277623-1632-44f2-b89f-6bbff71e9de8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:26.459773 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01992ab7-1e73-4c07-804a-e4a60412c2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:26.460453 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01992ab7-1e73-4c07-804a-e4a60412c2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:26.460737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01992ab7-1e73-4c07-804a-e4a60412c2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:26.461012 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01992ab7-1e73-4c07-804a-e4a60412c2b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:26.461765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01992ab7-1e73-4c07-804a-e4a60412c2b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:26.462098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01992ab7-1e73-4c07-804a-e4a60412c2b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:26.463506 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01992ab7-1e73-4c07-804a-e4a60412c2b4 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:26.465990 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:26.473446 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbd752-6f8a-4059-8338-572b9217bd8f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:26.474505 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 293/564] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jul 14 15:24:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:26.475648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01992ab7-1e73-4c07-804a-e4a60412c2b4 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:26.534562 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df847a-ad71-44d9-a0b9-3a2c3f62d81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:26.535240 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df847a-ad71-44d9-a0b9-3a2c3f62d81d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:26.535531 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df847a-ad71-44d9-a0b9-3a2c3f62d81d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:26.535811 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df847a-ad71-44d9-a0b9-3a2c3f62d81d None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:26.536543 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df847a-ad71-44d9-a0b9-3a2c3f62d81d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:26.537219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df847a-ad71-44d9-a0b9-3a2c3f62d81d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:26.538301 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df847a-ad71-44d9-a0b9-3a2c3f62d81d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:26.556175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 272/565] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:26.558554 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df847a-ad71-44d9-a0b9-3a2c3f62d81d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:26.597154 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:26.636032 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01992ab7-1e73-4c07-804a-e4a60412c2b4 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:26.681189 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b261c-8cd9-4c7a-9a14-cf3a0eb2eb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:26.681903 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b261c-8cd9-4c7a-9a14-cf3a0eb2eb56 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:26.682295 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b261c-8cd9-4c7a-9a14-cf3a0eb2eb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:26.682571 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b261c-8cd9-4c7a-9a14-cf3a0eb2eb56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:26.684178 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df847a-ad71-44d9-a0b9-3a2c3f62d81d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:26.696071 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b261c-8cd9-4c7a-9a14-cf3a0eb2eb56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:26.704613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-f66b261c-8cd9-4c7a-9a14-cf3a0eb2eb56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:26.704613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:26.704613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:26.704613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:26.704613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:26.704613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:26.704613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:26.704613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:26.704613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:26.704613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:26.704613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:26.704613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:26.704613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:26.704613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:26.704613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:26.704613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:26.706098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:26.706098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:26.706098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:26.706098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:26.706098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:26.706098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:26.706098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:26.706098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:26.706098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:26.706098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:26.706098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:26.706098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:26.706098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:26.706098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:26.706098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:26.706098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:26.707732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:26.707732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:26.707732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:26.707732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:26.707732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:26.707732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:26.707732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:26.707732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:26.707732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:26.707732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:26.707732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:26.707732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:26.710858 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 294/566] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:24:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:26.712069 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b261c-8cd9-4c7a-9a14-cf3a0eb2eb56 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:26.732121 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599e85f-067c-4b83-b3b5-2b62803244e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:26.732800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599e85f-067c-4b83-b3b5-2b62803244e9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:26.733077 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599e85f-067c-4b83-b3b5-2b62803244e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:26.733350 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599e85f-067c-4b83-b3b5-2b62803244e9 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:26.734227 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599e85f-067c-4b83-b3b5-2b62803244e9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:26.734547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599e85f-067c-4b83-b3b5-2b62803244e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:26.736632 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3599e85f-067c-4b83-b3b5-2b62803244e9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:26.755487 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 273/567] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jul 14 15:24:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:26.756340 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599e85f-067c-4b83-b3b5-2b62803244e9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:26.777446 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:26.829134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b261c-8cd9-4c7a-9a14-cf3a0eb2eb56 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:26.863932 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:26.870085 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6a278-31ef-4dbf-b930-789702053e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:26.870890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6a278-31ef-4dbf-b930-789702053e21 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:26.871174 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6a278-31ef-4dbf-b930-789702053e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:26.871451 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6a278-31ef-4dbf-b930-789702053e21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:26.876557 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599e85f-067c-4b83-b3b5-2b62803244e9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:26.883222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6a278-31ef-4dbf-b930-789702053e21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:26.884743 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6a278-31ef-4dbf-b930-789702053e21 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:26.902876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-23b6a278-31ef-4dbf-b930-789702053e21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:26.902876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:26.902876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:26.902876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:26.902876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:26.902876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:26.902876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:26.902876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:26.902876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:26.902876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:26.902876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:26.902876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:26.902876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:26.902876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:26.902876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:26.904075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:26.904075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:26.904075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:26.904075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:26.904075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:26.904075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:26.904075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:26.904075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:26.904075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:26.904075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:26.904075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:26.904075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:26.904075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:26.904075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:26.904075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:26.904075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:26.904075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:26.905015 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:26.905015 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:26.905015 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:26.905015 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:26.905015 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 295/568] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:26.905425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37744a34-9f4d-4835-b2d8-eddc5fc78331 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:26.905711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37744a34-9f4d-4835-b2d8-eddc5fc78331 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:26.905986 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37744a34-9f4d-4835-b2d8-eddc5fc78331 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:26.908046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 296/569] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:26.909550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37744a34-9f4d-4835-b2d8-eddc5fc78331 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:26.919112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14412961-8aa4-443e-8aaa-cdd52f480e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:26.919911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14412961-8aa4-443e-8aaa-cdd52f480e3d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:26.920191 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14412961-8aa4-443e-8aaa-cdd52f480e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:26.920462 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14412961-8aa4-443e-8aaa-cdd52f480e3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:26.928980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14412961-8aa4-443e-8aaa-cdd52f480e3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:26.930473 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14412961-8aa4-443e-8aaa-cdd52f480e3d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:26.945402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-14412961-8aa4-443e-8aaa-cdd52f480e3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:26.945402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:26.945402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:26.945402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:26.945402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:26.945402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:26.945402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:26.945402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:26.945402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:26.945402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:26.945402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:26.945402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:26.945402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:26.945402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:26.945402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:26.946439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:26.946439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:26.946439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:26.946439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:26.946439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:26.946439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:26.946439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:26.946439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:26.946439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:26.946439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:26.946439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:26.946439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:26.946439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:26.946439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:26.946439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:26.946439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:26.946439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:26.947350 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:26.947350 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:26.947350 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:26.947350 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:26.947350 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:26.947350 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:26.947350 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:26.947350 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:26.947350 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 274/570] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:26.947350 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14412961-8aa4-443e-8aaa-cdd52f480e3d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:27.033720 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:27.034354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37744a34-9f4d-4835-b2d8-eddc5fc78331 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:27.062718 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14412961-8aa4-443e-8aaa-cdd52f480e3d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:27.078322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9048fab-aa1b-4cef-86df-5c501086f974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:27.079502 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9048fab-aa1b-4cef-86df-5c501086f974 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:27.079785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9048fab-aa1b-4cef-86df-5c501086f974 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:27.080063 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9048fab-aa1b-4cef-86df-5c501086f974 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:27.080819 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9048fab-aa1b-4cef-86df-5c501086f974 None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:27.081127 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9048fab-aa1b-4cef-86df-5c501086f974 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:27.082558 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9048fab-aa1b-4cef-86df-5c501086f974 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:27.091030 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 297/571] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jul 14 15:24:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:27.091865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9048fab-aa1b-4cef-86df-5c501086f974 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:27.104109 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00691bc9-e6c9-4e88-af58-0c4a38a70124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:27.104911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00691bc9-e6c9-4e88-af58-0c4a38a70124 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:27.105201 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00691bc9-e6c9-4e88-af58-0c4a38a70124 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:27.105472 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00691bc9-e6c9-4e88-af58-0c4a38a70124 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:27.117400 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00691bc9-e6c9-4e88-af58-0c4a38a70124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:27.118933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00691bc9-e6c9-4e88-af58-0c4a38a70124 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:27.137984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-00691bc9-e6c9-4e88-af58-0c4a38a70124 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:27.137984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:27.137984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:27.137984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:27.137984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:27.137984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:27.137984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:27.137984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:27.137984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:27.137984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:27.137984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:27.137984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:27.137984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:27.137984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:27.137984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:27.139156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:27.139156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:27.139156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:27.139156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:27.139156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:27.139156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:27.139156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:27.139156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:27.139156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:27.139156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:27.139156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:27.139156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:27.139156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:27.139156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:27.139156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:27.139156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:27.139156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:27.140054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:27.140054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:27.140054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:27.140054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:27.140054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 275/572] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:27.140834 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c61f3-33c9-4678-af34-fede14ea048b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:27.140943 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c61f3-33c9-4678-af34-fede14ea048b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:27.141171 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c61f3-33c9-4678-af34-fede14ea048b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:27.148661 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:27.163211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b06c61f3-33c9-4678-af34-fede14ea048b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:27.164437 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b06c61f3-33c9-4678-af34-fede14ea048b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:27.217780 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9048fab-aa1b-4cef-86df-5c501086f974 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:27.242703 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 276/573] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:27.243566 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c61f3-33c9-4678-af34-fede14ea048b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:27.269677 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e89b0-4c19-4545-a818-04022d3226ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:27.270507 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e89b0-4c19-4545-a818-04022d3226ee None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:27.270791 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e89b0-4c19-4545-a818-04022d3226ee None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:27.271072 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e89b0-4c19-4545-a818-04022d3226ee None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:27.271806 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e89b0-4c19-4545-a818-04022d3226ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:27.272120 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e89b0-4c19-4545-a818-04022d3226ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:27.273502 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e89b0-4c19-4545-a818-04022d3226ee None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:27.287070 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 298/574] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:27.287933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e89b0-4c19-4545-a818-04022d3226ee None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:27.305136 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:27.364550 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c61f3-33c9-4678-af34-fede14ea048b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:27.401119 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e89b0-4c19-4545-a818-04022d3226ee None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:27.402777 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f594e5-607c-4046-bc74-c3246900ec5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:27.403510 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f594e5-607c-4046-bc74-c3246900ec5c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:27.403792 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f594e5-607c-4046-bc74-c3246900ec5c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:27.404070 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f594e5-607c-4046-bc74-c3246900ec5c None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:27.404880 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f594e5-607c-4046-bc74-c3246900ec5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:27.405184 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f594e5-607c-4046-bc74-c3246900ec5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:27.406707 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f594e5-607c-4046-bc74-c3246900ec5c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:27.410503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:27.423446 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 277/575] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:24:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:27.424773 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f594e5-607c-4046-bc74-c3246900ec5c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:27.452897 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ef7f1-6cf7-44f9-b406-b1da7b89e9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:27.454776 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ef7f1-6cf7-44f9-b406-b1da7b89e9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:27.455300 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ef7f1-6cf7-44f9-b406-b1da7b89e9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:27.455743 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ef7f1-6cf7-44f9-b406-b1da7b89e9d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:27.473471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ef7f1-6cf7-44f9-b406-b1da7b89e9d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:27.476025 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ef7f1-6cf7-44f9-b406-b1da7b89e9d0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:27.501972 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-d02ef7f1-6cf7-44f9-b406-b1da7b89e9d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:27.501972 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:27.501972 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:27.501972 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:27.501972 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:27.501972 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:27.501972 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:27.501972 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:27.501972 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:27.501972 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:27.501972 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:27.501972 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:27.501972 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:27.501972 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:27.501972 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:27.502979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:27.502979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:27.502979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:27.502979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:27.502979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:27.502979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:27.502979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:27.502979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:27.502979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:27.502979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:27.502979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:27.502979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:27.502979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:27.502979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:27.502979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:27.502979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:27.502979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:27.503914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:27.503914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:27.503914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:27.503914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:27.503914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 299/576] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:27.506006 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ef7f1-6cf7-44f9-b406-b1da7b89e9d0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:27.539921 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f594e5-607c-4046-bc74-c3246900ec5c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:27.556944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:27.581387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1aa1c7-47b0-4ecc-a6a9-442c0404a40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:27.582058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1aa1c7-47b0-4ecc-a6a9-442c0404a40c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:27.582459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1aa1c7-47b0-4ecc-a6a9-442c0404a40c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:27.582741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1aa1c7-47b0-4ecc-a6a9-442c0404a40c None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:27.583480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1aa1c7-47b0-4ecc-a6a9-442c0404a40c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:27.583794 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1aa1c7-47b0-4ecc-a6a9-442c0404a40c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:27.585187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1aa1c7-47b0-4ecc-a6a9-442c0404a40c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:27.608437 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 278/577] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:27.608437 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1aa1c7-47b0-4ecc-a6a9-442c0404a40c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:27.611499 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ef7f1-6cf7-44f9-b406-b1da7b89e9d0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:27.659674 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee3bdb-e78d-4d7f-b833-633084fa2055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:27.660473 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee3bdb-e78d-4d7f-b833-633084fa2055 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:27.660813 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee3bdb-e78d-4d7f-b833-633084fa2055 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:27.661096 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee3bdb-e78d-4d7f-b833-633084fa2055 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:27.674783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee3bdb-e78d-4d7f-b833-633084fa2055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:27.684560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-21ee3bdb-e78d-4d7f-b833-633084fa2055 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:27.684560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:27.684560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:27.684560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:27.684560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:27.684560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:27.684560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:27.684560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:27.684560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:27.684560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:27.684560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:27.684560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:27.684560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:27.684560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:27.684560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:27.684560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:27.685620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:27.685620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:27.685620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:27.685620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:27.685620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:27.685620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:27.685620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:27.685620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:27.685620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:27.685620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:27.685620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:27.685620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:27.685620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:27.685620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:27.685620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:27.685620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:27.686730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:27.686730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:27.686730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:27.686730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:27.686730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:27.686730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:27.686730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:27.686730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:27.686730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:27.686730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:27.686730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:27.686730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:27.686730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 300/578] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:24:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:27.686730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee3bdb-e78d-4d7f-b833-633084fa2055 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:27.710713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:27.715287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1aa1c7-47b0-4ecc-a6a9-442c0404a40c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:27.753643 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d9ae8-a7ec-4ff3-a89a-d85dbb8fa14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:27.754471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d9ae8-a7ec-4ff3-a89a-d85dbb8fa14f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:27.754753 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d9ae8-a7ec-4ff3-a89a-d85dbb8fa14f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:27.755025 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d9ae8-a7ec-4ff3-a89a-d85dbb8fa14f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:27.762230 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d9ae8-a7ec-4ff3-a89a-d85dbb8fa14f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:27.763678 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d9ae8-a7ec-4ff3-a89a-d85dbb8fa14f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:27.780112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-878d9ae8-a7ec-4ff3-a89a-d85dbb8fa14f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 15:24:27.780112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:27.780112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:27.780112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:27.780112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:27.780112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:27.780112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:27.780112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:27.780112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:27.780112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:27.780112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:27.780112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:27.780112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:27.780112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:27.780112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:27.780112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:27.781164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:27.781164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:27.781164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:27.781164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:27.781164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:27.781164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:27.781164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:27.781164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:27.781164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:27.781164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:27.781164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:27.781164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:27.781164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:27.781164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:27.781164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:27.781164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:27.781164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:27.781164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:27.782292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:27.782292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:27.782292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:27.782292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:27.782292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:27.782292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:27.782292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:27.782292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:27.782292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 15:24:27.782292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:27.782292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 279/579] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:24:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:27.782292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d9ae8-a7ec-4ff3-a89a-d85dbb8fa14f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:27.803500 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee3bdb-e78d-4d7f-b833-633084fa2055 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:27.828278 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:27.843816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34c912-cac8-4eb8-9025-458b5be0aa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:27.844993 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34c912-cac8-4eb8-9025-458b5be0aa80 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:27.845424 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34c912-cac8-4eb8-9025-458b5be0aa80 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:27.845836 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34c912-cac8-4eb8-9025-458b5be0aa80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:27.847250 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34c912-cac8-4eb8-9025-458b5be0aa80 None admin] RBAC: Adding query filter params (role.id=1d73a20858554285862ec7d933eb6149, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=edbbc94ca71c42c0aac562c8c2ec83db) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:27.847668 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34c912-cac8-4eb8-9025-458b5be0aa80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:27.850358 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34c912-cac8-4eb8-9025-458b5be0aa80 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:27.857415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 301/580] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:24:27 2022] GET /identity/v3/role_assignments?user.id=edbbc94ca71c42c0aac562c8c2ec83db&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=1d73a20858554285862ec7d933eb6149 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:27.858276 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34c912-cac8-4eb8-9025-458b5be0aa80 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:27.914291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d9ae8-a7ec-4ff3-a89a-d85dbb8fa14f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:27.957387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72c8e1-5a42-4180-8720-fbf6bff5245a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:27.958487 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72c8e1-5a42-4180-8720-fbf6bff5245a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:27.958953 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72c8e1-5a42-4180-8720-fbf6bff5245a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:27.959389 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72c8e1-5a42-4180-8720-fbf6bff5245a None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:27.960508 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72c8e1-5a42-4180-8720-fbf6bff5245a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:27.961019 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72c8e1-5a42-4180-8720-fbf6bff5245a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:27.962772 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72c8e1-5a42-4180-8720-fbf6bff5245a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:27.978638 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 280/581] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:27.979529 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72c8e1-5a42-4180-8720-fbf6bff5245a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:27.990217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:28.023525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34c912-cac8-4eb8-9025-458b5be0aa80 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:28.068892 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db2273-5e27-4c0b-990d-b9f72eb75aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:28.069743 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db2273-5e27-4c0b-990d-b9f72eb75aae None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:28.070035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db2273-5e27-4c0b-990d-b9f72eb75aae None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:28.070978 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db2273-5e27-4c0b-990d-b9f72eb75aae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:28.080578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db2273-5e27-4c0b-990d-b9f72eb75aae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:28.083032 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db2273-5e27-4c0b-990d-b9f72eb75aae None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:28.098658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-b9db2273-5e27-4c0b-990d-b9f72eb75aae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:28.098658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:28.098658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:28.098658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:28.098658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:28.098658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:28.098658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:28.098658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:28.098658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:28.098658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:28.098658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:28.098658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:28.098658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:28.098658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:28.098658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:28.099662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:28.099662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:28.099662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:28.099662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:28.099662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:28.099662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:28.099662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:28.099662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:28.099662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:28.099662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:28.099662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:28.099662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:28.099662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:28.099662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:28.099662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:28.099662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:28.099662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:28.100576 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:28.100576 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:28.100576 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:28.100576 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:28.100576 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:28.100576 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:28.100576 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:28.100576 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:28.100576 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 302/582] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:28.101630 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db2273-5e27-4c0b-990d-b9f72eb75aae None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:28.116179 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:28.123879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72c8e1-5a42-4180-8720-fbf6bff5245a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:28.173513 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24f741-0434-49f7-b3b2-a313cd4f113e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:28.174917 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24f741-0434-49f7-b3b2-a313cd4f113e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:28.175404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24f741-0434-49f7-b3b2-a313cd4f113e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:28.175886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24f741-0434-49f7-b3b2-a313cd4f113e None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:28.177239 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24f741-0434-49f7-b3b2-a313cd4f113e None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:28.177793 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24f741-0434-49f7-b3b2-a313cd4f113e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:28.180268 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24f741-0434-49f7-b3b2-a313cd4f113e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:28.192158 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 281/583] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jul 14 15:24:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:28.193020 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24f741-0434-49f7-b3b2-a313cd4f113e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:28.224732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db2273-5e27-4c0b-990d-b9f72eb75aae None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:28.274217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1ce65-1a16-4bd0-9e2b-c8bfea807de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:28.275311 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1ce65-1a16-4bd0-9e2b-c8bfea807de5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:28.275850 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1ce65-1a16-4bd0-9e2b-c8bfea807de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:28.276352 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1ce65-1a16-4bd0-9e2b-c8bfea807de5 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:28.277408 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1ce65-1a16-4bd0-9e2b-c8bfea807de5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:28.277988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1ce65-1a16-4bd0-9e2b-c8bfea807de5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:28.279838 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1ce65-1a16-4bd0-9e2b-c8bfea807de5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:28.296479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:28.306254 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 303/584] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jul 14 15:24:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:28.307172 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1ce65-1a16-4bd0-9e2b-c8bfea807de5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:28.323218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24f741-0434-49f7-b3b2-a313cd4f113e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:28.363159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca622e2-eb58-4bf2-9f0f-8cdaac1aa06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:28.364231 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca622e2-eb58-4bf2-9f0f-8cdaac1aa06e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:28.364707 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca622e2-eb58-4bf2-9f0f-8cdaac1aa06e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:28.365135 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca622e2-eb58-4bf2-9f0f-8cdaac1aa06e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:28.373987 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca622e2-eb58-4bf2-9f0f-8cdaac1aa06e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:28.375920 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca622e2-eb58-4bf2-9f0f-8cdaac1aa06e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:28.392524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-bca622e2-eb58-4bf2-9f0f-8cdaac1aa06e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:24:28.392524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:28.392524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:28.392524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:28.392524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:28.392524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:28.392524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:28.392524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:28.392524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:28.392524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:28.392524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:28.392524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:28.392524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:28.392524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:28.392524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:28.392524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:28.394605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:28.394605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:28.394605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:28.394605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:28.394605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:28.394605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:28.394605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:28.394605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:28.394605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:28.394605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:28.394605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:28.394605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:28.394605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:28.394605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:28.394605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:28.394605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:28.394605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:28.394605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:28.396349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:28.396349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:28.396349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:28.396349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:28.396349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:28.396349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:28.396349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:28.396349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:28.396349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:24:28.396349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:28.403619 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 282/585] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:24:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:28.403619 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca622e2-eb58-4bf2-9f0f-8cdaac1aa06e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:28.430458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:28.447579 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1ce65-1a16-4bd0-9e2b-c8bfea807de5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:28.489108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b21898-6a6a-4b67-b179-a7b90a127b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:28.489788 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b21898-6a6a-4b67-b179-a7b90a127b33 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:28.490099 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b21898-6a6a-4b67-b179-a7b90a127b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:28.490383 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b21898-6a6a-4b67-b179-a7b90a127b33 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:28.491177 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b21898-6a6a-4b67-b179-a7b90a127b33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:28.491491 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b21898-6a6a-4b67-b179-a7b90a127b33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:28.492951 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b21898-6a6a-4b67-b179-a7b90a127b33 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:28.511453 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 304/586] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:24:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:28.511453 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b21898-6a6a-4b67-b179-a7b90a127b33 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:28.539248 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca622e2-eb58-4bf2-9f0f-8cdaac1aa06e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:28.575694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658e617-853f-462f-8728-94e65669a711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:28.576698 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658e617-853f-462f-8728-94e65669a711 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:28.576986 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658e617-853f-462f-8728-94e65669a711 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:28.577331 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658e617-853f-462f-8728-94e65669a711 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:28.583273 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:28.590047 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658e617-853f-462f-8728-94e65669a711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:28.591587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658e617-853f-462f-8728-94e65669a711 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:28.612525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f658e617-853f-462f-8728-94e65669a711 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:28.612525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:28.612525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:28.612525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:28.612525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:28.612525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:28.612525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:28.612525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:28.612525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:28.612525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:28.612525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:28.612525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:28.612525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:28.612525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:28.612525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:28.613666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:28.613666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:28.613666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:28.613666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:28.613666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:28.613666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:28.613666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:28.613666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:28.613666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:28.613666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:28.613666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:28.613666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:28.613666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:28.613666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:28.613666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:28.613666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:28.613666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:28.614733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:28.614733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:28.614733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:28.614733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:28.614733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 283/587] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:28.619104 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658e617-853f-462f-8728-94e65669a711 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:28.636847 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b21898-6a6a-4b67-b179-a7b90a127b33 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:28.676979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4e4f5-f4b6-40c7-8bb7-26ee5935b40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:28.677886 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4e4f5-f4b6-40c7-8bb7-26ee5935b40e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:28.678279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4e4f5-f4b6-40c7-8bb7-26ee5935b40e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:28.678630 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4e4f5-f4b6-40c7-8bb7-26ee5935b40e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:28.690498 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4e4f5-f4b6-40c7-8bb7-26ee5935b40e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:28.692416 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4e4f5-f4b6-40c7-8bb7-26ee5935b40e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:28.707198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:28.711240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-3ae4e4f5-f4b6-40c7-8bb7-26ee5935b40e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:28.711240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:28.711240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:28.711240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:28.711240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:28.711240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:28.711240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:28.711240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:28.711240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:28.711240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:28.711240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:28.711240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:28.711240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:28.711240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:28.711240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:28.712356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:28.712356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:28.712356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:28.712356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:28.712356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:28.712356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:28.712356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:28.712356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:28.712356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:28.712356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:28.712356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:28.712356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:28.712356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:28.712356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:28.712356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:28.712356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:28.712356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:28.718160 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:28.718160 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:28.718160 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:28.718160 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:28.718160 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 305/588] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:28.718160 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4e4f5-f4b6-40c7-8bb7-26ee5935b40e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:28.749972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658e617-853f-462f-8728-94e65669a711 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:28.795229 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe9d52-1506-4a36-b800-3b83951d9913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:28.795933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe9d52-1506-4a36-b800-3b83951d9913 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:28.796290 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe9d52-1506-4a36-b800-3b83951d9913 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:28.796640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe9d52-1506-4a36-b800-3b83951d9913 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:28.797580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe9d52-1506-4a36-b800-3b83951d9913 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:28.798087 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe9d52-1506-4a36-b800-3b83951d9913 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:28.799908 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe9d52-1506-4a36-b800-3b83951d9913 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:28.826512 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 284/589] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jul 14 15:24:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:28.826512 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe9d52-1506-4a36-b800-3b83951d9913 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:28.843563 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4e4f5-f4b6-40c7-8bb7-26ee5935b40e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:28.866374 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:28.898237 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2882b-ccec-4837-8a94-c85158e0c3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:28.898237 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2882b-ccec-4837-8a94-c85158e0c3db None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:28.898237 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2882b-ccec-4837-8a94-c85158e0c3db None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:28.898237 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2882b-ccec-4837-8a94-c85158e0c3db None admin] PATH_INFO: `/v3/projects/ba19b660ef1442289fb322231ce26f07/users/64f6b597a47c4a0eb08d1eabc4c0305c/roles/1d73a20858554285862ec7d933eb6149` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:28.916628 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2882b-ccec-4837-8a94-c85158e0c3db None admin] RBAC: Authorizing `identity:create_grant(project_id=ba19b660ef1442289fb322231ce26f07, user_id=64f6b597a47c4a0eb08d1eabc4c0305c, role_id=1d73a20858554285862ec7d933eb6149)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:28.918109 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2882b-ccec-4837-8a94-c85158e0c3db None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:28.937420 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 306/590] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:24:28 2022] PUT /identity/v3/projects/ba19b660ef1442289fb322231ce26f07/users/64f6b597a47c4a0eb08d1eabc4c0305c/roles/1d73a20858554285862ec7d933eb6149 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:28.938409 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2882b-ccec-4837-8a94-c85158e0c3db None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:28.963260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe9d52-1506-4a36-b800-3b83951d9913 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:29.008430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:29.019552 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f4aaf-4074-41b2-8418-501b21c3a50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:29.020374 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f4aaf-4074-41b2-8418-501b21c3a50c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:29.020740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f4aaf-4074-41b2-8418-501b21c3a50c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:29.021094 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f4aaf-4074-41b2-8418-501b21c3a50c None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:29.021957 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f4aaf-4074-41b2-8418-501b21c3a50c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:29.022380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f4aaf-4074-41b2-8418-501b21c3a50c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:29.023984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f4aaf-4074-41b2-8418-501b21c3a50c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:29.038096 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 285/591] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:29.039496 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f4aaf-4074-41b2-8418-501b21c3a50c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:29.099009 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2882b-ccec-4837-8a94-c85158e0c3db None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:29.150102 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7955b12-3e53-40c5-9ea6-411df4a689af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:29.151024 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7955b12-3e53-40c5-9ea6-411df4a689af None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:29.151440 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7955b12-3e53-40c5-9ea6-411df4a689af None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:29.151844 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7955b12-3e53-40c5-9ea6-411df4a689af None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:29.152734 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7955b12-3e53-40c5-9ea6-411df4a689af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:29.153193 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7955b12-3e53-40c5-9ea6-411df4a689af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:29.155675 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7955b12-3e53-40c5-9ea6-411df4a689af None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:29.163868 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f4aaf-4074-41b2-8418-501b21c3a50c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:29.172011 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 307/592] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:29.173297 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7955b12-3e53-40c5-9ea6-411df4a689af None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:29.200923 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:29.217096 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6155c-b3e3-4cfc-b6fe-919407042abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:29.217905 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6155c-b3e3-4cfc-b6fe-919407042abf None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:29.218227 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6155c-b3e3-4cfc-b6fe-919407042abf None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:29.218507 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6155c-b3e3-4cfc-b6fe-919407042abf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:29.235714 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6155c-b3e3-4cfc-b6fe-919407042abf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:29.238274 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6155c-b3e3-4cfc-b6fe-919407042abf None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:29.270738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-5ad6155c-b3e3-4cfc-b6fe-919407042abf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:29.270738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:29.270738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:29.270738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:29.270738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:29.270738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:29.270738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:29.270738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:29.270738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:29.270738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:29.270738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:29.270738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:29.270738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:29.270738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:29.270738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:29.272127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:29.272127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:29.272127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:29.272127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:29.272127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:29.272127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:29.272127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:29.272127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:29.272127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:29.272127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:29.272127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:29.272127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:29.272127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:29.272127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:29.272127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:29.272127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:29.272127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:29.273569 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:29.273569 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:29.273569 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:29.273569 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:29.278282 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 286/593] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:29.279692 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6155c-b3e3-4cfc-b6fe-919407042abf None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:29.311986 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7955b12-3e53-40c5-9ea6-411df4a689af None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:29.335549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:29.353776 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfa7fc-9cc4-4373-b9cc-ce34da2c675e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:29.354885 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfa7fc-9cc4-4373-b9cc-ce34da2c675e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:29.355317 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfa7fc-9cc4-4373-b9cc-ce34da2c675e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:29.355740 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfa7fc-9cc4-4373-b9cc-ce34da2c675e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:29.365879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfa7fc-9cc4-4373-b9cc-ce34da2c675e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:29.367634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfa7fc-9cc4-4373-b9cc-ce34da2c675e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:29.384223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-4dbfa7fc-9cc4-4373-b9cc-ce34da2c675e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 15:24:29.384223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:29.384223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:29.384223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:29.384223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:29.384223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:29.384223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:29.384223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:29.384223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:29.384223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:29.384223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:29.384223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:29.384223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:29.384223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:29.384223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:29.384223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:29.385419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:29.385419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:29.385419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:29.385419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:29.385419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:29.385419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:29.385419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:29.385419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:29.385419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:29.385419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:29.385419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:29.385419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:29.385419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:29.385419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:29.385419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:29.385419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:29.385419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:29.385419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:29.386617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:29.386617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:29.386617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:29.386617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:29.386617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:29.386617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:29.386617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:29.386617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:29.386617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 15:24:29.386617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:29.388910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 308/594] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:24:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:29.389842 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfa7fc-9cc4-4373-b9cc-ce34da2c675e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:29.411097 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6155c-b3e3-4cfc-b6fe-919407042abf None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:29.462723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cb598-c078-4662-bd84-30254ea06490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:29.463879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cb598-c078-4662-bd84-30254ea06490 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:29.464269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cb598-c078-4662-bd84-30254ea06490 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:29.464990 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cb598-c078-4662-bd84-30254ea06490 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:29.477741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8cb598-c078-4662-bd84-30254ea06490 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:29.480353 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8cb598-c078-4662-bd84-30254ea06490 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:29.492935 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:29.500072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-0d8cb598-c078-4662-bd84-30254ea06490 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:29.500072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:29.500072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:29.500072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:29.500072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:29.500072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:29.500072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:29.500072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:29.500072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:29.500072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:29.500072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:29.500072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:29.500072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:29.500072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:29.500072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:29.501479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:29.501479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:29.501479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:29.501479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:29.501479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:29.501479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:29.501479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:29.501479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:29.501479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:29.501479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:29.501479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:29.501479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:29.501479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:29.501479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:29.501479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:29.501479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:29.501479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:29.502681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:29.502681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:29.502681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:29.502681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:29.502681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:29.502681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:29.502681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:29.502681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:29.506180 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 287/595] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:29.507262 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cb598-c078-4662-bd84-30254ea06490 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:29.530686 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfa7fc-9cc4-4373-b9cc-ce34da2c675e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:29.592767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8506b7-dfac-4fec-b6ba-81c34fe9d2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:29.593968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8506b7-dfac-4fec-b6ba-81c34fe9d2aa None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:29.594642 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8506b7-dfac-4fec-b6ba-81c34fe9d2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:29.595181 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8506b7-dfac-4fec-b6ba-81c34fe9d2aa None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:29.596525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8506b7-dfac-4fec-b6ba-81c34fe9d2aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:29.597051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8506b7-dfac-4fec-b6ba-81c34fe9d2aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:29.599423 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8506b7-dfac-4fec-b6ba-81c34fe9d2aa None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:29.623184 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 309/596] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:29.625818 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8506b7-dfac-4fec-b6ba-81c34fe9d2aa None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:29.637730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:29.640852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cb598-c078-4662-bd84-30254ea06490 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:29.699910 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9562ed-9503-4b74-b0c7-37e8ce2cc28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:29.701210 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9562ed-9503-4b74-b0c7-37e8ce2cc28a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:29.701807 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9562ed-9503-4b74-b0c7-37e8ce2cc28a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:29.703183 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9562ed-9503-4b74-b0c7-37e8ce2cc28a None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:29.705440 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9562ed-9503-4b74-b0c7-37e8ce2cc28a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:29.706511 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9562ed-9503-4b74-b0c7-37e8ce2cc28a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:29.711934 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9562ed-9503-4b74-b0c7-37e8ce2cc28a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:29.746866 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 288/597] 10.222.0.39 () {56 vars in 1139 bytes} [Thu Jul 14 15:24:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:29.747964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9562ed-9503-4b74-b0c7-37e8ce2cc28a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:29.772680 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8506b7-dfac-4fec-b6ba-81c34fe9d2aa None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:29.824269 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e169c33-ece5-491b-880a-3fcf99804719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:29.825120 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e169c33-ece5-491b-880a-3fcf99804719 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:29.825506 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e169c33-ece5-491b-880a-3fcf99804719 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:29.825888 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e169c33-ece5-491b-880a-3fcf99804719 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:29.827101 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e169c33-ece5-491b-880a-3fcf99804719 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:29.827530 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e169c33-ece5-491b-880a-3fcf99804719 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:29.829670 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e169c33-ece5-491b-880a-3fcf99804719 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:29.854292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 310/598] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:24:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:29.855569 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e169c33-ece5-491b-880a-3fcf99804719 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:29.860001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:29.913969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9562ed-9503-4b74-b0c7-37e8ce2cc28a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:29.954770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5ab9d-3740-4205-9121-c9ae7433976f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:29.956092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5ab9d-3740-4205-9121-c9ae7433976f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:29.956653 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5ab9d-3740-4205-9121-c9ae7433976f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:29.957276 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5ab9d-3740-4205-9121-c9ae7433976f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:29.967325 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5ab9d-3740-4205-9121-c9ae7433976f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:29.969383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b5ab9d-3740-4205-9121-c9ae7433976f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:29.988158 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e169c33-ece5-491b-880a-3fcf99804719 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:29.989518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-20b5ab9d-3740-4205-9121-c9ae7433976f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:29.989518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:29.989518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:29.989518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:29.989518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:29.989518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:29.989518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:29.989518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:29.989518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:29.989518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:29.989518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:29.989518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:29.989518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:29.989518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:29.989518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:29.990470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:29.990470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:29.990470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:29.990470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:29.990470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:29.990470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:29.990470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:29.990470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:29.990470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:29.990470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:29.990470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:29.990470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:29.990470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:29.990470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:29.990470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:29.990470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:29.990470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:29.991379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:29.991379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:29.991379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:29.991379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:29.991379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:29.991379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:29.991379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:29.991379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:29.991379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 289/599] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:29.998594 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5ab9d-3740-4205-9121-c9ae7433976f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:30.026275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:30.044803 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5fdfb-a986-4775-8d25-c13b5deae9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:30.045610 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5fdfb-a986-4775-8d25-c13b5deae9af None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:30.045895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5fdfb-a986-4775-8d25-c13b5deae9af None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:30.046219 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5fdfb-a986-4775-8d25-c13b5deae9af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:30.061050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5fdfb-a986-4775-8d25-c13b5deae9af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:30.062894 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5fdfb-a986-4775-8d25-c13b5deae9af None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:30.087659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-12e5fdfb-a986-4775-8d25-c13b5deae9af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:30.087659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:30.087659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:30.087659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:30.087659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:30.087659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:30.087659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:30.087659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:30.087659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:30.087659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:30.087659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:30.087659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:30.087659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:30.087659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:30.087659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:30.088651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:30.088651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:30.088651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:30.088651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:30.088651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:30.088651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:30.088651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:30.088651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:30.088651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:30.088651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:30.088651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:30.088651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:30.088651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:30.088651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:30.088651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:30.088651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:30.088651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:30.089567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:30.089567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:30.089567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:30.089567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:30.089567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 311/600] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:30.090325 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5fdfb-a986-4775-8d25-c13b5deae9af None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:30.139592 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5ab9d-3740-4205-9121-c9ae7433976f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:30.169197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:30.192701 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cbe26-4de1-4a22-a964-d27dc60c1f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:30.193612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cbe26-4de1-4a22-a964-d27dc60c1f94 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:30.193897 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cbe26-4de1-4a22-a964-d27dc60c1f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:30.194209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cbe26-4de1-4a22-a964-d27dc60c1f94 None admin] PATH_INFO: `/v3/projects/ba19b660ef1442289fb322231ce26f07/users/14c582c1127142f8a4ebf64bb7b34516/roles/1d73a20858554285862ec7d933eb6149` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:30.212060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cbe26-4de1-4a22-a964-d27dc60c1f94 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba19b660ef1442289fb322231ce26f07, user_id=14c582c1127142f8a4ebf64bb7b34516, role_id=1d73a20858554285862ec7d933eb6149)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:30.213579 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cbe26-4de1-4a22-a964-d27dc60c1f94 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:30.230679 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 290/601] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:24:29 2022] PUT /identity/v3/projects/ba19b660ef1442289fb322231ce26f07/users/14c582c1127142f8a4ebf64bb7b34516/roles/1d73a20858554285862ec7d933eb6149 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:30.231522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cbe26-4de1-4a22-a964-d27dc60c1f94 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:30.240875 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5fdfb-a986-4775-8d25-c13b5deae9af None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:30.301520 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4473ae9-12c5-4ac9-afa5-823bb8e0d3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:30.303296 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4473ae9-12c5-4ac9-afa5-823bb8e0d3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:30.303831 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4473ae9-12c5-4ac9-afa5-823bb8e0d3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:30.304308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4473ae9-12c5-4ac9-afa5-823bb8e0d3f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:30.305353 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4473ae9-12c5-4ac9-afa5-823bb8e0d3f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:30.305866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4473ae9-12c5-4ac9-afa5-823bb8e0d3f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:30.308410 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4473ae9-12c5-4ac9-afa5-823bb8e0d3f6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:30.325671 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:30.330135 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 312/602] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:24:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:30.333327 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54541d6-aed1-4853-9587-fe9833bf0d3a None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:30.333621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54541d6-aed1-4853-9587-fe9833bf0d3a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:30.333905 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54541d6-aed1-4853-9587-fe9833bf0d3a None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:30.338569 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 313/603] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:30.339890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54541d6-aed1-4853-9587-fe9833bf0d3a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:30.383974 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cbe26-4de1-4a22-a964-d27dc60c1f94 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:30.433540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fe3bd-bb29-4f9c-a75e-5071632ab601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:30.434200 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fe3bd-bb29-4f9c-a75e-5071632ab601 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:30.434596 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fe3bd-bb29-4f9c-a75e-5071632ab601 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:30.434884 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fe3bd-bb29-4f9c-a75e-5071632ab601 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:30.435620 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fe3bd-bb29-4f9c-a75e-5071632ab601 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:30.436380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fe3bd-bb29-4f9c-a75e-5071632ab601 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:30.437414 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fe3bd-bb29-4f9c-a75e-5071632ab601 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:30.449867 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 291/604] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:30.451212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cc639-3e11-4a7d-bd0d-c560babc8d7e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:30.451504 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cc639-3e11-4a7d-bd0d-c560babc8d7e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:30.451787 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cc639-3e11-4a7d-bd0d-c560babc8d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:30.474114 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-648cc639-3e11-4a7d-bd0d-c560babc8d7e None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:30.474114 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-648cc639-3e11-4a7d-bd0d-c560babc8d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:30.512865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54541d6-aed1-4853-9587-fe9833bf0d3a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:30.534842 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:30.557488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 292/605] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:30.558869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cc639-3e11-4a7d-bd0d-c560babc8d7e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:30.564582 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8706d-ece7-42fa-9a12-61e9656fd515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:30.565718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8706d-ece7-42fa-9a12-61e9656fd515 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:30.566180 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8706d-ece7-42fa-9a12-61e9656fd515 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:30.566607 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8706d-ece7-42fa-9a12-61e9656fd515 None admin] PATH_INFO: `/v3/projects/ba19b660ef1442289fb322231ce26f07/users/78d5b8b2802a44eead863280df22b027/roles/1d73a20858554285862ec7d933eb6149` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:30.593638 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8706d-ece7-42fa-9a12-61e9656fd515 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba19b660ef1442289fb322231ce26f07, user_id=78d5b8b2802a44eead863280df22b027, role_id=1d73a20858554285862ec7d933eb6149)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:30.596729 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8706d-ece7-42fa-9a12-61e9656fd515 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:30.620818 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 314/606] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:24:30 2022] PUT /identity/v3/projects/ba19b660ef1442289fb322231ce26f07/users/78d5b8b2802a44eead863280df22b027/roles/1d73a20858554285862ec7d933eb6149 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:30.622030 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8706d-ece7-42fa-9a12-61e9656fd515 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:30.646801 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:30.723055 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cc639-3e11-4a7d-bd0d-c560babc8d7e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:30.809616 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8706d-ece7-42fa-9a12-61e9656fd515 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:30.813798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c4ecd-d0c6-4126-9fc3-fbd6f7fa0ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:30.814891 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c4ecd-d0c6-4126-9fc3-fbd6f7fa0ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:30.815270 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c4ecd-d0c6-4126-9fc3-fbd6f7fa0ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:30.816559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c4ecd-d0c6-4126-9fc3-fbd6f7fa0ef5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:30.835864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c4ecd-d0c6-4126-9fc3-fbd6f7fa0ef5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:30.837812 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c4ecd-d0c6-4126-9fc3-fbd6f7fa0ef5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:30.856057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98fae9-6fea-4e10-902a-56fa615de6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:30.857132 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98fae9-6fea-4e10-902a-56fa615de6de None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:30.857568 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98fae9-6fea-4e10-902a-56fa615de6de None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:30.858012 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98fae9-6fea-4e10-902a-56fa615de6de None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:30.864570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-bf5c4ecd-d0c6-4126-9fc3-fbd6f7fa0ef5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:30.864570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:30.864570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:30.864570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:30.864570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:30.864570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:30.864570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:30.864570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:30.864570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:30.864570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:30.864570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:30.864570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:30.864570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:30.864570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:30.864570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:30.865710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:30.865710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:30.865710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:30.865710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:30.865710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:30.865710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:30.865710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:30.865710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:30.865710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:30.865710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:30.865710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:30.865710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:30.865710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:30.865710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:30.865710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:30.865710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:30.865710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:30.866742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:30.866742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:30.866742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:30.866742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:30.866742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:30.866742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:30.866742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:30.866742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:30.872452 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 293/607] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:30.873767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98fae9-6fea-4e10-902a-56fa615de6de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:30.882381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-bc98fae9-6fea-4e10-902a-56fa615de6de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:30.882381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:30.882381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:30.882381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:30.882381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:30.882381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:30.882381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:30.882381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:30.882381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:30.882381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:30.882381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:30.882381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:30.882381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:30.882381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:30.882381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:30.882381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:30.883578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:30.883578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:30.883578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:30.883578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:30.883578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:30.883578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:30.883578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:30.883578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:30.883578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:30.883578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:30.883578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:30.883578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:30.883578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:30.883578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:30.883578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:30.883578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:30.884616 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:30.884616 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:30.884616 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:30.884616 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:30.884616 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:30.884616 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:30.884616 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:30.884616 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:30.884616 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:30.884616 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:30.884616 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:30.884616 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:30.885488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c4ecd-d0c6-4126-9fc3-fbd6f7fa0ef5 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:30.887400 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 315/608] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:24:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:30.894211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98fae9-6fea-4e10-902a-56fa615de6de None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:30.930663 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:31.046693 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c4ecd-d0c6-4126-9fc3-fbd6f7fa0ef5 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:31.068519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:31.094593 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39ab47-f853-4c04-bbc5-780121242a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:31.097674 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39ab47-f853-4c04-bbc5-780121242a1e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:31.098644 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39ab47-f853-4c04-bbc5-780121242a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:31.099091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39ab47-f853-4c04-bbc5-780121242a1e None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:31.100073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39ab47-f853-4c04-bbc5-780121242a1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:31.100639 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39ab47-f853-4c04-bbc5-780121242a1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:31.102562 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f39ab47-f853-4c04-bbc5-780121242a1e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:31.121554 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 294/609] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:24:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:31.131149 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39ab47-f853-4c04-bbc5-780121242a1e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:31.137251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98fae9-6fea-4e10-902a-56fa615de6de None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:31.198329 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a0755-49af-497c-8e5c-edec9c7c6341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:31.199021 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a0755-49af-497c-8e5c-edec9c7c6341 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:31.199318 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a0755-49af-497c-8e5c-edec9c7c6341 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:31.199596 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a0755-49af-497c-8e5c-edec9c7c6341 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:31.200364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a0755-49af-497c-8e5c-edec9c7c6341 None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:31.200676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a0755-49af-497c-8e5c-edec9c7c6341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:31.202106 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a0755-49af-497c-8e5c-edec9c7c6341 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:31.223427 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 316/610] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jul 14 15:24:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:31.231099 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a0755-49af-497c-8e5c-edec9c7c6341 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:31.334322 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39ab47-f853-4c04-bbc5-780121242a1e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:31.402523 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:31.403450 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f350fc-ae03-4b87-b6cb-97c8b62f9f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:31.404360 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f350fc-ae03-4b87-b6cb-97c8b62f9f78 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:31.404639 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f350fc-ae03-4b87-b6cb-97c8b62f9f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:31.404912 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f350fc-ae03-4b87-b6cb-97c8b62f9f78 None admin] PATH_INFO: `/v3/projects/ba19b660ef1442289fb322231ce26f07/users/7b82de4816a244c0b62b5f9f894ccaf4/roles/1d73a20858554285862ec7d933eb6149` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:31.433144 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a0755-49af-497c-8e5c-edec9c7c6341 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:31.437343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f350fc-ae03-4b87-b6cb-97c8b62f9f78 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba19b660ef1442289fb322231ce26f07, user_id=7b82de4816a244c0b62b5f9f894ccaf4, role_id=1d73a20858554285862ec7d933eb6149)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:31.439447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f350fc-ae03-4b87-b6cb-97c8b62f9f78 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:31.470122 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 295/611] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:24:31 2022] PUT /identity/v3/projects/ba19b660ef1442289fb322231ce26f07/users/7b82de4816a244c0b62b5f9f894ccaf4/roles/1d73a20858554285862ec7d933eb6149 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:31.470122 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9eefdf-e425-405d-b6e6-bb960f104d74 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:31.470122 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9eefdf-e425-405d-b6e6-bb960f104d74 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:31.470122 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9eefdf-e425-405d-b6e6-bb960f104d74 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:31.472556 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 296/612] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:31.484676 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0aeb7f-b710-406b-8f38-13c013800e6b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:31.484988 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0aeb7f-b710-406b-8f38-13c013800e6b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:31.485412 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0aeb7f-b710-406b-8f38-13c013800e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:31.518367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a22bc-e4ec-4155-8321-f7aa44971b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:31.519335 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a22bc-e4ec-4155-8321-f7aa44971b8b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:31.519697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a22bc-e4ec-4155-8321-f7aa44971b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:31.519981 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a22bc-e4ec-4155-8321-f7aa44971b8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:31.521664 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2b0aeb7f-b710-406b-8f38-13c013800e6b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:31.522932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2b0aeb7f-b710-406b-8f38-13c013800e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:31.547020 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a22bc-e4ec-4155-8321-f7aa44971b8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:31.552262 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a22bc-e4ec-4155-8321-f7aa44971b8b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:31.585523 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:31.590264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-7b4a22bc-e4ec-4155-8321-f7aa44971b8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:31.590264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:31.590264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:31.590264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:31.590264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:31.590264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:31.590264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:31.590264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:31.590264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:31.590264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:31.590264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:31.590264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:31.590264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:31.590264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:31.590264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:31.591445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:31.591445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:31.591445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:31.591445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:31.591445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:31.591445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:31.591445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:31.591445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:31.591445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:31.591445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:31.591445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:31.591445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:31.591445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:31.591445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:31.591445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:31.591445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:31.591445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:31.592527 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:31.592527 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:31.592527 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:31.592527 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:31.598700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 317/613] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:31.601394 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a22bc-e4ec-4155-8321-f7aa44971b8b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:31.691217 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 297/614] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:24:31.733885 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0aeb7f-b710-406b-8f38-13c013800e6b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:31.798447 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a22bc-e4ec-4155-8321-f7aa44971b8b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:31.847494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64267bb-19a6-4fcf-aeeb-e0be217597a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:31.848240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64267bb-19a6-4fcf-aeeb-e0be217597a8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:31.848632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64267bb-19a6-4fcf-aeeb-e0be217597a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:31.849017 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64267bb-19a6-4fcf-aeeb-e0be217597a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:31.850484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64267bb-19a6-4fcf-aeeb-e0be217597a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:31.850916 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64267bb-19a6-4fcf-aeeb-e0be217597a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:31.852678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64267bb-19a6-4fcf-aeeb-e0be217597a8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:31.863810 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:31.864696 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0aeb7f-b710-406b-8f38-13c013800e6b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:31.872551 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 318/615] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:31.878463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64267bb-19a6-4fcf-aeeb-e0be217597a8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:31.905609 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f738149-6f37-4b95-830e-447b81e3f9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:31.906886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f738149-6f37-4b95-830e-447b81e3f9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:31.907677 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f738149-6f37-4b95-830e-447b81e3f9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:31.908184 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f738149-6f37-4b95-830e-447b81e3f9c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:31.919824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f738149-6f37-4b95-830e-447b81e3f9c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:31.928959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-4f738149-6f37-4b95-830e-447b81e3f9c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:31.928959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:31.928959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:31.928959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:31.928959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:31.928959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:31.928959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:31.928959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:31.928959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:31.928959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:31.928959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:31.928959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:31.928959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:31.928959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:31.928959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:31.928959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:31.929944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:31.929944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:31.929944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:31.929944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:31.929944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:31.929944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:31.929944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:31.929944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:31.929944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:31.929944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:31.929944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:31.929944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:31.929944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:31.929944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:31.929944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:31.929944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:31.930835 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:31.930835 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:31.930835 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:31.930835 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:31.930835 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:31.930835 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:31.930835 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:31.930835 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:31.930835 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:31.930835 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:31.930835 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:31.930835 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:31.934956 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 298/616] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:24:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:31.947500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f738149-6f37-4b95-830e-447b81e3f9c1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:31.984355 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:31.997494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64267bb-19a6-4fcf-aeeb-e0be217597a8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:32.035481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce45bdb-8d3f-4321-8dc9-065fba34d657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:32.036336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce45bdb-8d3f-4321-8dc9-065fba34d657 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:32.036563 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce45bdb-8d3f-4321-8dc9-065fba34d657 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:32.036839 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce45bdb-8d3f-4321-8dc9-065fba34d657 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.050110 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce45bdb-8d3f-4321-8dc9-065fba34d657 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:32.050110 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce45bdb-8d3f-4321-8dc9-065fba34d657 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:32.066239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-cce45bdb-8d3f-4321-8dc9-065fba34d657 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:24:32.066239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:32.066239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:32.066239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:32.066239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:32.066239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:32.066239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:32.066239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:32.066239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:32.066239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:32.066239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:32.066239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:32.066239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:32.066239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:32.066239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:32.066239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:32.067259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:32.067259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:32.067259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:32.067259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:32.067259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:32.067259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:32.067259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:32.067259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:32.067259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:32.067259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:32.067259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:32.067259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:32.067259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:32.067259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:32.067259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:32.067259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:32.067259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:32.067259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:32.068230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:32.068230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:32.068230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:32.068230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:32.068230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:32.068230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:32.068230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:32.068230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:32.068230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:24:32.068230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:32.070603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 319/617] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:24:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:32.075354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce45bdb-8d3f-4321-8dc9-065fba34d657 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:32.118499 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f738149-6f37-4b95-830e-447b81e3f9c1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:32.166372 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f434c7-ee70-45fe-a5cd-3391c77ddd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:32.167442 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f434c7-ee70-45fe-a5cd-3391c77ddd91 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:32.167970 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f434c7-ee70-45fe-a5cd-3391c77ddd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:32.168458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f434c7-ee70-45fe-a5cd-3391c77ddd91 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.169497 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f434c7-ee70-45fe-a5cd-3391c77ddd91 None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:32.170087 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f434c7-ee70-45fe-a5cd-3391c77ddd91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:32.172329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f434c7-ee70-45fe-a5cd-3391c77ddd91 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:32.184191 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 299/618] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jul 14 15:24:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:32.190247 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f434c7-ee70-45fe-a5cd-3391c77ddd91 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:32.222589 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:32.307364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce45bdb-8d3f-4321-8dc9-065fba34d657 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:32.352794 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1448a7-5458-4bea-aa47-3d3e141708a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:32.353644 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1448a7-5458-4bea-aa47-3d3e141708a6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:32.354696 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1448a7-5458-4bea-aa47-3d3e141708a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:32.355848 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1448a7-5458-4bea-aa47-3d3e141708a6 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.356843 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1448a7-5458-4bea-aa47-3d3e141708a6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:32.357515 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1448a7-5458-4bea-aa47-3d3e141708a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:32.363626 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1448a7-5458-4bea-aa47-3d3e141708a6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:32.380753 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:32.405137 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 320/619] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jul 14 15:24:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:32.410663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f434c7-ee70-45fe-a5cd-3391c77ddd91 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:32.411785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1448a7-5458-4bea-aa47-3d3e141708a6 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:32.494267 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9166a-5789-4372-a345-90cdcabeca53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:32.495305 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9166a-5789-4372-a345-90cdcabeca53 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:32.495728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9166a-5789-4372-a345-90cdcabeca53 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:32.496017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9166a-5789-4372-a345-90cdcabeca53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.523580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9166a-5789-4372-a345-90cdcabeca53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:32.525090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9166a-5789-4372-a345-90cdcabeca53 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:32.563849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-bad9166a-5789-4372-a345-90cdcabeca53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:32.563849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:32.563849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:32.563849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:32.563849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:32.563849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:32.563849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:32.563849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:32.563849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:32.563849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:32.563849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:32.563849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:32.563849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:32.563849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:32.563849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:32.564846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:32.564846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:32.564846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:32.564846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:32.564846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:32.564846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:32.564846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:32.564846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:32.564846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:32.564846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:32.564846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:32.564846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:32.564846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:32.564846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:32.564846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:32.564846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:32.564846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:32.565738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:32.565738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:32.565738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:32.565738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:32.569867 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 300/620] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:32.574162 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9166a-5789-4372-a345-90cdcabeca53 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:32.625372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1448a7-5458-4bea-aa47-3d3e141708a6 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:32.670567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:32.698033 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea1dcf-7f6d-42d7-871c-5e0b9b976a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:32.698921 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea1dcf-7f6d-42d7-871c-5e0b9b976a8c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:32.699219 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea1dcf-7f6d-42d7-871c-5e0b9b976a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:32.699493 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea1dcf-7f6d-42d7-871c-5e0b9b976a8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.723026 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea1dcf-7f6d-42d7-871c-5e0b9b976a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:32.724668 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea1dcf-7f6d-42d7-871c-5e0b9b976a8c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:32.733597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9166a-5789-4372-a345-90cdcabeca53 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:32.757010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-e2ea1dcf-7f6d-42d7-871c-5e0b9b976a8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:32.757010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:32.757010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:32.757010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:32.757010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:32.757010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:32.757010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:32.757010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:32.757010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:32.757010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:32.757010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:32.757010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:32.757010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:32.757010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:32.757010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:32.758221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:32.758221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:32.758221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:32.758221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:32.758221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:32.758221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:32.758221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:32.758221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:32.758221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:32.758221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:32.758221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:32.758221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:32.758221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:32.758221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:32.758221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:32.758221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:32.758221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:32.759133 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:32.759133 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:32.759133 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:32.759133 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:32.759133 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 321/621] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:32.760270 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5454ff-b1e6-441f-8824-b234aa9d30ec None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:32.760270 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5454ff-b1e6-441f-8824-b234aa9d30ec None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:32.760425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5454ff-b1e6-441f-8824-b234aa9d30ec None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.761836 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 322/622] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:32.767242 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5454ff-b1e6-441f-8824-b234aa9d30ec None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:32.775034 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:32.781818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98fb8f-d6c2-4267-999c-e423b36590f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:32.783505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98fb8f-d6c2-4267-999c-e423b36590f0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:32.783906 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98fb8f-d6c2-4267-999c-e423b36590f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:32.784259 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98fb8f-d6c2-4267-999c-e423b36590f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.785071 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98fb8f-d6c2-4267-999c-e423b36590f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:32.785457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98fb8f-d6c2-4267-999c-e423b36590f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:32.786988 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98fb8f-d6c2-4267-999c-e423b36590f0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:32.800665 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 301/623] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:32.801929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b382d5-1cd0-4bc4-926e-66a5155d50b3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:32.802304 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b382d5-1cd0-4bc4-926e-66a5155d50b3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:32.802665 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b382d5-1cd0-4bc4-926e-66a5155d50b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.822167 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-98b382d5-1cd0-4bc4-926e-66a5155d50b3 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:32.823525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-98b382d5-1cd0-4bc4-926e-66a5155d50b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:32.898802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5454ff-b1e6-441f-8824-b234aa9d30ec None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:32.903986 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 302/624] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:32.904845 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b382d5-1cd0-4bc4-926e-66a5155d50b3 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:32.964531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fcfd1-0efc-4412-870c-1fbdbbc08998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:32.965251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fcfd1-0efc-4412-870c-1fbdbbc08998 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:32.965595 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fcfd1-0efc-4412-870c-1fbdbbc08998 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:32.965955 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fcfd1-0efc-4412-870c-1fbdbbc08998 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:32.966799 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0fcfd1-0efc-4412-870c-1fbdbbc08998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:32.967203 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0fcfd1-0efc-4412-870c-1fbdbbc08998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:32.968875 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0fcfd1-0efc-4412-870c-1fbdbbc08998 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:32.983279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 323/625] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:32.984257 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fcfd1-0efc-4412-870c-1fbdbbc08998 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.016906 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:33.017683 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b382d5-1cd0-4bc4-926e-66a5155d50b3 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.046413 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:33.062026 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a3de5-2fb8-4d1e-a4da-574e2d347826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:33.063855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a3de5-2fb8-4d1e-a4da-574e2d347826 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.064404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a3de5-2fb8-4d1e-a4da-574e2d347826 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.064833 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a3de5-2fb8-4d1e-a4da-574e2d347826 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.073008 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a3de5-2fb8-4d1e-a4da-574e2d347826 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:33.074905 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a3de5-2fb8-4d1e-a4da-574e2d347826 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:33.091522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-676a3de5-2fb8-4d1e-a4da-574e2d347826 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:33.091522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:33.091522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:33.091522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:33.091522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:33.091522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:33.091522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:33.091522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:33.091522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:33.091522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:33.091522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:33.091522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:33.091522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:33.091522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:33.091522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:33.091522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:33.092712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:33.092712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:33.092712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:33.092712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:33.092712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:33.092712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:33.092712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:33.092712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:33.092712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:33.092712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:33.092712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:33.092712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:33.092712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:33.092712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:33.092712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:33.092712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:33.092712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:33.092712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:33.093698 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:33.093698 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:33.093698 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:33.093698 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:33.093698 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:33.093698 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:33.093698 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:33.093698 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:33.093698 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:33.093698 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:33.096419 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 303/626] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jul 14 15:24:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:33.097665 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a3de5-2fb8-4d1e-a4da-574e2d347826 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.134721 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fcfd1-0efc-4412-870c-1fbdbbc08998 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.173260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213a55a-0bce-430e-8580-cfb854b7bccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:33.174684 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213a55a-0bce-430e-8580-cfb854b7bccc None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.175179 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213a55a-0bce-430e-8580-cfb854b7bccc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.175515 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c213a55a-0bce-430e-8580-cfb854b7bccc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.187069 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c213a55a-0bce-430e-8580-cfb854b7bccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:33.195660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-c213a55a-0bce-430e-8580-cfb854b7bccc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:33.195660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:33.195660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:33.195660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:33.195660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:33.195660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:33.195660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:33.195660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:33.195660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:33.195660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:33.195660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:33.195660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:33.195660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:33.195660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:33.195660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:33.195660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:33.196676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:33.196676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:33.196676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:33.196676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:33.196676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:33.196676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:33.196676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:33.196676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:33.196676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:33.196676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:33.196676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:33.196676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:33.196676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:33.196676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:33.196676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:33.196676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:33.197555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:33.197555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:33.197555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:33.197555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:33.197555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:33.197555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:33.197555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:33.197555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:33.197555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:33.197555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:33.197555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:33.197555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:33.197555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 324/627] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:24:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:33.198322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213a55a-0bce-430e-8580-cfb854b7bccc None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.230412 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a3de5-2fb8-4d1e-a4da-574e2d347826 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.270740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf476b2c-76f3-408f-b1dd-c5ebe7cefa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:33.271534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf476b2c-76f3-408f-b1dd-c5ebe7cefa07 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.271821 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf476b2c-76f3-408f-b1dd-c5ebe7cefa07 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.272103 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf476b2c-76f3-408f-b1dd-c5ebe7cefa07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.279127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf476b2c-76f3-408f-b1dd-c5ebe7cefa07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:33.280586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf476b2c-76f3-408f-b1dd-c5ebe7cefa07 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:33.295146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-cf476b2c-76f3-408f-b1dd-c5ebe7cefa07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:33.295146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:33.295146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:33.295146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:33.295146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:33.295146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:33.295146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:33.295146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:33.295146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:33.295146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:33.295146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:33.295146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:33.295146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:33.295146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:33.295146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:33.296118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:33.296118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:33.296118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:33.296118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:33.296118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:33.296118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:33.296118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:33.296118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:33.296118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:33.296118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:33.296118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:33.296118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:33.296118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:33.296118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:33.296118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:33.296118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:33.296118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:33.297223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:33.297223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:33.297223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:33.297223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:33.297223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:33.297223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:33.297223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:33.297223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:33.297223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 304/628] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:33.299196 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001c1de-a569-48e9-9377-6ec8ca7633e7 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.299196 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001c1de-a569-48e9-9377-6ec8ca7633e7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.299453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001c1de-a569-48e9-9377-6ec8ca7633e7 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.300875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 305/629] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:33.301428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001c1de-a569-48e9-9377-6ec8ca7633e7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.311234 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:33.325736 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c213a55a-0bce-430e-8580-cfb854b7bccc None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.351525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:33.363289 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f5add-5f33-421c-ae89-6301ed04701d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:33.363963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f5add-5f33-421c-ae89-6301ed04701d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.364248 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f5add-5f33-421c-ae89-6301ed04701d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.364530 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f5add-5f33-421c-ae89-6301ed04701d None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.365366 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f5add-5f33-421c-ae89-6301ed04701d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:33.365679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f5add-5f33-421c-ae89-6301ed04701d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:33.367168 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f5add-5f33-421c-ae89-6301ed04701d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:33.390008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 325/630] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jul 14 15:24:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:33.390008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f5add-5f33-421c-ae89-6301ed04701d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.421558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001c1de-a569-48e9-9377-6ec8ca7633e7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.480410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87e1fd-586a-4479-b202-04d2d7de3af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:33.481162 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87e1fd-586a-4479-b202-04d2d7de3af6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.481440 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87e1fd-586a-4479-b202-04d2d7de3af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.481673 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87e1fd-586a-4479-b202-04d2d7de3af6 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.482498 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87e1fd-586a-4479-b202-04d2d7de3af6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:33.482809 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87e1fd-586a-4479-b202-04d2d7de3af6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:33.484361 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87e1fd-586a-4479-b202-04d2d7de3af6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:33.494088 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 306/631] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jul 14 15:24:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:33.495522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5365a77-7d7a-4373-820c-45f80a30bcb9 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.495814 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5365a77-7d7a-4373-820c-45f80a30bcb9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.496094 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5365a77-7d7a-4373-820c-45f80a30bcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.514446 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f5add-5f33-421c-ae89-6301ed04701d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.516374 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a5365a77-7d7a-4373-820c-45f80a30bcb9 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:33.518982 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a5365a77-7d7a-4373-820c-45f80a30bcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:33.555462 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c4cea-d525-43f5-ac77-93bc60e8ada8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:33.556132 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c4cea-d525-43f5-ac77-93bc60e8ada8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.556422 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c4cea-d525-43f5-ac77-93bc60e8ada8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.556705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c4cea-d525-43f5-ac77-93bc60e8ada8 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.557495 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c4cea-d525-43f5-ac77-93bc60e8ada8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:33.557811 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c4cea-d525-43f5-ac77-93bc60e8ada8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:33.559337 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c4cea-d525-43f5-ac77-93bc60e8ada8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:33.574623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 326/632] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:24:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:33.575499 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c4cea-d525-43f5-ac77-93bc60e8ada8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.588292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:33.604792 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 307/633] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:33.619089 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5365a77-7d7a-4373-820c-45f80a30bcb9 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.670217 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:33.717847 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c4cea-d525-43f5-ac77-93bc60e8ada8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.755377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5365a77-7d7a-4373-820c-45f80a30bcb9 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:33.769381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b96fc9-51bd-4976-99ad-75b448f4a736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:33.770852 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96fc9-51bd-4976-99ad-75b448f4a736 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.771750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96fc9-51bd-4976-99ad-75b448f4a736 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.772107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96fc9-51bd-4976-99ad-75b448f4a736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.791920 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d61e04-f9f3-4286-a7c3-e222458c3a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:33.792712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d61e04-f9f3-4286-a7c3-e222458c3a9f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:33.792992 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d61e04-f9f3-4286-a7c3-e222458c3a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:33.793269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d61e04-f9f3-4286-a7c3-e222458c3a9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:33.803869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d61e04-f9f3-4286-a7c3-e222458c3a9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:33.805348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d61e04-f9f3-4286-a7c3-e222458c3a9f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:33.824756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-b9d61e04-f9f3-4286-a7c3-e222458c3a9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:33.824756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:33.824756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:33.824756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:33.824756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:33.824756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:33.824756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:33.824756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:33.824756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:33.824756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:33.824756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:33.824756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:33.824756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:33.824756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:33.824756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:33.826005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:33.826005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:33.826005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:33.826005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:33.826005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:33.826005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:33.826005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:33.826005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:33.826005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:33.826005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:33.826005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:33.826005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:33.826005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:33.826005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:33.826005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:33.826005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:33.826005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:33.828130 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:33.828130 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:33.828130 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:33.828130 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:33.831405 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 308/634] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:33.832061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d61e04-f9f3-4286-a7c3-e222458c3a9f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:33.881753 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b96fc9-51bd-4976-99ad-75b448f4a736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:33.883678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b96fc9-51bd-4976-99ad-75b448f4a736 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:33.892960 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:33.939623 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:33.961192 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d61e04-f9f3-4286-a7c3-e222458c3a9f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:34.001491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f53f6-71a5-444f-803d-d84e6d6f5a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:34.002620 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f53f6-71a5-444f-803d-d84e6d6f5a6f None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:34.002906 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f53f6-71a5-444f-803d-d84e6d6f5a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:34.003182 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f53f6-71a5-444f-803d-d84e6d6f5a6f None admin] PATH_INFO: `/v3/projects/ba19b660ef1442289fb322231ce26f07/users/edbbc94ca71c42c0aac562c8c2ec83db/roles/1d73a20858554285862ec7d933eb6149` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:34.020034 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f53f6-71a5-444f-803d-d84e6d6f5a6f None admin] RBAC: Authorizing `identity:create_grant(project_id=ba19b660ef1442289fb322231ce26f07, user_id=edbbc94ca71c42c0aac562c8c2ec83db, role_id=1d73a20858554285862ec7d933eb6149)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:34.021408 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f53f6-71a5-444f-803d-d84e6d6f5a6f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:34.025334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 327/635] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:24:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:34.026668 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b96fc9-51bd-4976-99ad-75b448f4a736 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:34.039045 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 309/636] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:24:33 2022] PUT /identity/v3/projects/ba19b660ef1442289fb322231ce26f07/users/edbbc94ca71c42c0aac562c8c2ec83db/roles/1d73a20858554285862ec7d933eb6149 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:34.039886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f53f6-71a5-444f-803d-d84e6d6f5a6f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:34.179163 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b96fc9-51bd-4976-99ad-75b448f4a736 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:34.187998 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:34.195161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f53f6-71a5-444f-803d-d84e6d6f5a6f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:34.229333 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113d769-453f-40de-b724-6c978f3755a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:34.230232 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113d769-453f-40de-b724-6c978f3755a0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:34.230523 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113d769-453f-40de-b724-6c978f3755a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:34.230811 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113d769-453f-40de-b724-6c978f3755a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:34.235641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc667f5c-4bed-4129-8636-96eef17d907a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:34.236507 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc667f5c-4bed-4129-8636-96eef17d907a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:34.236797 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc667f5c-4bed-4129-8636-96eef17d907a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:34.237079 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc667f5c-4bed-4129-8636-96eef17d907a None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:34.237820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc667f5c-4bed-4129-8636-96eef17d907a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:34.238172 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc667f5c-4bed-4129-8636-96eef17d907a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:34.239556 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc667f5c-4bed-4129-8636-96eef17d907a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:34.242697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:34.243001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113d769-453f-40de-b724-6c978f3755a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:34.251816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-0113d769-453f-40de-b724-6c978f3755a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:34.251816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:34.251816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:34.251816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:34.251816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:34.251816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:34.251816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:34.251816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:34.251816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:34.251816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:34.251816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:34.251816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:34.251816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:34.251816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:34.251816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:34.251816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:34.253037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:34.253037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:34.253037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:34.253037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:34.253037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:34.253037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:34.253037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:34.253037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:34.253037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:34.253037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:34.253037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:34.253037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:34.253037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:34.253037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:34.253037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:34.253037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:34.253966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:34.253966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:34.253966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:34.253966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:34.253966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:34.253966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:34.253966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:34.253966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:34.253966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:34.253966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:34.253966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:34.253966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:34.253966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 328/637] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:24:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:34.254702 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113d769-453f-40de-b724-6c978f3755a0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:34.260929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 310/638] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:34.263416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee9fc0-71eb-44b2-bb3d-e29ebe05482a None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:34.263893 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee9fc0-71eb-44b2-bb3d-e29ebe05482a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:34.264338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee9fc0-71eb-44b2-bb3d-e29ebe05482a None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:34.265754 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 311/639] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:34.267466 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee9fc0-71eb-44b2-bb3d-e29ebe05482a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:34.371641 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113d769-453f-40de-b724-6c978f3755a0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:34.379861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee9fc0-71eb-44b2-bb3d-e29ebe05482a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:34.410152 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4645e6f-49cf-4d30-8a6b-c42fa076a359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:34.411090 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4645e6f-49cf-4d30-8a6b-c42fa076a359 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:34.411457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4645e6f-49cf-4d30-8a6b-c42fa076a359 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:34.411813 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4645e6f-49cf-4d30-8a6b-c42fa076a359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:34.416463 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d441a8-b07c-47c3-a111-c3f8ff550dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:34.417268 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d441a8-b07c-47c3-a111-c3f8ff550dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:34.417658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d441a8-b07c-47c3-a111-c3f8ff550dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:34.418059 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d441a8-b07c-47c3-a111-c3f8ff550dc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:34.418947 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d441a8-b07c-47c3-a111-c3f8ff550dc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:34.419354 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d441a8-b07c-47c3-a111-c3f8ff550dc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:34.420852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d441a8-b07c-47c3-a111-c3f8ff550dc6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:34.428219 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4645e6f-49cf-4d30-8a6b-c42fa076a359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:34.429907 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4645e6f-49cf-4d30-8a6b-c42fa076a359 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:34.441981 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 312/640] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jul 14 15:24:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:34.441981 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d441a8-b07c-47c3-a111-c3f8ff550dc6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:34.453425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-d4645e6f-49cf-4d30-8a6b-c42fa076a359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:34.453425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:34.453425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:34.453425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:34.453425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:34.453425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:34.453425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:34.453425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:34.453425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:34.453425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:34.453425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:34.453425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:34.453425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:34.453425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:34.453425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:34.455062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:34.455062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:34.455062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:34.455062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:34.455062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:34.455062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:34.455062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:34.455062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:34.455062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:34.455062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:34.455062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:34.455062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:34.455062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:34.455062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:34.455062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:34.455062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:34.455062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:34.456262 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:34.456262 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:34.456262 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:34.456262 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:34.459594 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 329/641] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:34.460926 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd79437-d934-4930-ac45-6e9ceddd94af None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:34.461335 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd79437-d934-4930-ac45-6e9ceddd94af None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:34.461495 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd79437-d934-4930-ac45-6e9ceddd94af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:34.478954 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8cd79437-d934-4930-ac45-6e9ceddd94af None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:34.480248 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8cd79437-d934-4930-ac45-6e9ceddd94af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:34.495361 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:34.514299 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:34.569980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d441a8-b07c-47c3-a111-c3f8ff550dc6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:34.583465 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 330/642] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:34.584112 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd79437-d934-4930-ac45-6e9ceddd94af None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:34.624778 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed6c70-e398-413c-8704-eb5207d3e553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:34.625931 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed6c70-e398-413c-8704-eb5207d3e553 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:34.626416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed6c70-e398-413c-8704-eb5207d3e553 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:34.627308 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed6c70-e398-413c-8704-eb5207d3e553 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:34.635885 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed6c70-e398-413c-8704-eb5207d3e553 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:34.637478 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed6c70-e398-413c-8704-eb5207d3e553 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:34.652349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f0ed6c70-e398-413c-8704-eb5207d3e553 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 15:24:34.652349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:34.652349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:34.652349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:34.652349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:34.652349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:34.652349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:34.652349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:34.652349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:34.652349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:34.652349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:34.652349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:34.652349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:34.652349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:34.652349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:34.652349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:34.653423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:34.653423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:34.653423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:34.653423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:34.653423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:34.653423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:34.653423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:34.653423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:34.653423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:34.653423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:34.653423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:34.653423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:34.653423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:34.653423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:34.653423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:34.653423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:34.653423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:34.653423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:34.654870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:34.654870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:34.654870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:34.654870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:34.654870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:34.654870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:34.654870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:34.654870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:34.654870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 15:24:34.654870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:34.654870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 313/643] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:24:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:34.654870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed6c70-e398-413c-8704-eb5207d3e553 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:34.694994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd79437-d934-4930-ac45-6e9ceddd94af None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:34.730986 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6647f02-fcca-4df7-8dc8-823458c5a833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:34.731779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6647f02-fcca-4df7-8dc8-823458c5a833 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:34.732070 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6647f02-fcca-4df7-8dc8-823458c5a833 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:34.732337 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6647f02-fcca-4df7-8dc8-823458c5a833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:34.742433 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6647f02-fcca-4df7-8dc8-823458c5a833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:34.743892 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6647f02-fcca-4df7-8dc8-823458c5a833 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:34.752722 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:34.762549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-d6647f02-fcca-4df7-8dc8-823458c5a833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:34.762549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:34.762549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:34.762549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:34.762549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:34.762549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:34.762549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:34.762549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:34.762549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:34.762549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:34.762549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:34.762549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:34.762549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:34.762549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:34.762549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:34.763692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:34.763692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:34.763692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:34.763692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:34.763692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:34.763692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:34.763692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:34.763692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:34.763692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:34.763692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:34.763692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:34.763692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:34.763692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:34.763692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:34.763692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:34.763692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:34.763692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:34.764879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:34.764879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:34.764879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:34.764879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:34.767376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 331/644] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:34.768402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6647f02-fcca-4df7-8dc8-823458c5a833 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:34.780738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed6c70-e398-413c-8704-eb5207d3e553 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:34.800916 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:34.820267 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188f075-d372-4218-bb0e-22bbca2cce4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:34.820949 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188f075-d372-4218-bb0e-22bbca2cce4d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:34.821245 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188f075-d372-4218-bb0e-22bbca2cce4d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:34.821529 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188f075-d372-4218-bb0e-22bbca2cce4d None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:34.822287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188f075-d372-4218-bb0e-22bbca2cce4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:34.822603 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188f075-d372-4218-bb0e-22bbca2cce4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:34.824253 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188f075-d372-4218-bb0e-22bbca2cce4d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:34.846737 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 314/645] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:34.846737 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188f075-d372-4218-bb0e-22bbca2cce4d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:34.916845 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6647f02-fcca-4df7-8dc8-823458c5a833 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:34.959016 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b814dfb-5a21-4475-bb2e-86cab8972088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:34.959248 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188f075-d372-4218-bb0e-22bbca2cce4d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:34.959824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b814dfb-5a21-4475-bb2e-86cab8972088 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:34.960111 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b814dfb-5a21-4475-bb2e-86cab8972088 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:34.960406 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b814dfb-5a21-4475-bb2e-86cab8972088 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:34.972015 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b814dfb-5a21-4475-bb2e-86cab8972088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:34.979857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-0b814dfb-5a21-4475-bb2e-86cab8972088 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:34.979857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:34.979857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:34.979857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:34.979857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:34.979857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:34.979857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:34.979857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:34.979857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:34.979857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:34.979857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:34.979857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:34.979857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:34.979857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:34.979857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:34.979857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:34.981042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:34.981042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:34.981042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:34.981042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:34.981042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:34.981042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:34.981042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:34.981042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:34.981042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:34.981042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:34.981042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:34.981042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:34.981042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:34.981042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:34.981042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:34.981042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:34.981910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:34.981910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:34.981910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:34.981910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:34.981910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:34.981910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:34.981910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:34.981910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:34.981910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:34.981910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:34.981910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:34.981910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:34.981910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 332/646] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:24:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:34.982672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b814dfb-5a21-4475-bb2e-86cab8972088 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:35.002317 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ef416-d26a-43b1-b922-9aa8c42e0c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:35.003244 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ef416-d26a-43b1-b922-9aa8c42e0c18 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:35.003694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ef416-d26a-43b1-b922-9aa8c42e0c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:35.003981 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ef416-d26a-43b1-b922-9aa8c42e0c18 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:35.004821 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ef416-d26a-43b1-b922-9aa8c42e0c18 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:35.005136 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ef416-d26a-43b1-b922-9aa8c42e0c18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:35.006616 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ef416-d26a-43b1-b922-9aa8c42e0c18 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:35.030371 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 315/647] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jul 14 15:24:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:35.030371 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ef416-d26a-43b1-b922-9aa8c42e0c18 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:35.058118 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:35.070332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:35.106195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b814dfb-5a21-4475-bb2e-86cab8972088 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:35.141263 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ef416-d26a-43b1-b922-9aa8c42e0c18 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:35.142740 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b13268-cd7a-42c5-8003-184ef04e537f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:35.143527 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b13268-cd7a-42c5-8003-184ef04e537f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:35.143818 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b13268-cd7a-42c5-8003-184ef04e537f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:35.144220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b13268-cd7a-42c5-8003-184ef04e537f None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:35.144955 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b13268-cd7a-42c5-8003-184ef04e537f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:35.145266 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b13268-cd7a-42c5-8003-184ef04e537f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:35.146705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b13268-cd7a-42c5-8003-184ef04e537f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:35.165998 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 333/648] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:35.165998 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b13268-cd7a-42c5-8003-184ef04e537f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:35.182651 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cffd79-6ba6-47d3-8732-fc1d79e006a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:35.183376 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cffd79-6ba6-47d3-8732-fc1d79e006a3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:35.183663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cffd79-6ba6-47d3-8732-fc1d79e006a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:35.183942 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cffd79-6ba6-47d3-8732-fc1d79e006a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:35.193117 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cffd79-6ba6-47d3-8732-fc1d79e006a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:35.194665 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cffd79-6ba6-47d3-8732-fc1d79e006a3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:35.211503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-77cffd79-6ba6-47d3-8732-fc1d79e006a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:35.211503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:35.211503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:35.211503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:35.211503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:35.211503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:35.211503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:35.211503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:35.211503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:35.211503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:35.211503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:35.211503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:35.211503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:35.211503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:35.211503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:35.212500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:35.212500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:35.212500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:35.212500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:35.212500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:35.212500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:35.212500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:35.212500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:35.212500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:35.212500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:35.212500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:35.212500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:35.212500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:35.212500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:35.212500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:35.212500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:35.212500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:35.214256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:35.214256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:35.214256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:35.214256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:35.214256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:35.214256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:35.214256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:35.214256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:35.214256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 316/649] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:35.214256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cffd79-6ba6-47d3-8732-fc1d79e006a3 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:35.299838 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b13268-cd7a-42c5-8003-184ef04e537f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:35.321449 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:35.327912 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:35.339971 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b064d-d6ba-4779-b33b-717ab49011fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:35.340652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b064d-d6ba-4779-b33b-717ab49011fe None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:35.340941 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b064d-d6ba-4779-b33b-717ab49011fe None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:35.341220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b064d-d6ba-4779-b33b-717ab49011fe None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:35.341974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b064d-d6ba-4779-b33b-717ab49011fe None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:35.342316 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b064d-d6ba-4779-b33b-717ab49011fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:35.343734 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b064d-d6ba-4779-b33b-717ab49011fe None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:35.345617 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cffd79-6ba6-47d3-8732-fc1d79e006a3 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:35.354722 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 334/650] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jul 14 15:24:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:35.355552 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b064d-d6ba-4779-b33b-717ab49011fe None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:35.387632 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2070f-2620-44f4-9f6b-38ceb2b64b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:35.388275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2070f-2620-44f4-9f6b-38ceb2b64b7c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:35.388560 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2070f-2620-44f4-9f6b-38ceb2b64b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:35.388831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2070f-2620-44f4-9f6b-38ceb2b64b7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:35.474564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2070f-2620-44f4-9f6b-38ceb2b64b7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:35.475947 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2070f-2620-44f4-9f6b-38ceb2b64b7c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:35.479029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b064d-d6ba-4779-b33b-717ab49011fe None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:35.519393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665b7fb-4f01-4b78-bc16-334db2d7ebce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:35.520618 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665b7fb-4f01-4b78-bc16-334db2d7ebce None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:35.521062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665b7fb-4f01-4b78-bc16-334db2d7ebce None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:35.521490 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665b7fb-4f01-4b78-bc16-334db2d7ebce None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:35.530336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665b7fb-4f01-4b78-bc16-334db2d7ebce None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:35.531818 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665b7fb-4f01-4b78-bc16-334db2d7ebce None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:35.547054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-6665b7fb-4f01-4b78-bc16-334db2d7ebce None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:24:35.547054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:35.547054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:35.547054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:35.547054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:35.547054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:35.547054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:35.547054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:35.547054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:35.547054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:35.547054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:35.547054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:35.547054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:35.547054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:35.547054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:35.547054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:35.549252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:35.549252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:35.549252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:35.549252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:35.549252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:35.549252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:35.549252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:35.549252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:35.549252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:35.549252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:35.549252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:35.549252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:35.549252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:35.549252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:35.549252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:35.549252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:35.549252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:35.549252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:35.550600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:35.550600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:35.550600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:35.550600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:35.550600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:35.550600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:35.550600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:35.550600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:35.550600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:24:35.550600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:35.550600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 335/651] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:24:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:35.550600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665b7fb-4f01-4b78-bc16-334db2d7ebce None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:35.598589 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:35.606311 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 317/652] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:35.613578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2070f-2620-44f4-9f6b-38ceb2b64b7c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:35.615710 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:35.699297 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665b7fb-4f01-4b78-bc16-334db2d7ebce None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:35.742532 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6715f-14b7-4070-a970-fd6be5f2d3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:35.743255 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6715f-14b7-4070-a970-fd6be5f2d3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:35.743643 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6715f-14b7-4070-a970-fd6be5f2d3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:35.744028 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6715f-14b7-4070-a970-fd6be5f2d3e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:35.744937 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6715f-14b7-4070-a970-fd6be5f2d3e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:35.745328 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6715f-14b7-4070-a970-fd6be5f2d3e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:35.746907 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6715f-14b7-4070-a970-fd6be5f2d3e6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:35.751715 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2070f-2620-44f4-9f6b-38ceb2b64b7c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:35.761159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 336/653] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:24:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:35.763458 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6715f-14b7-4070-a970-fd6be5f2d3e6 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:35.793679 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659f60b-3172-421c-b8e6-7a246b2d08e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:35.794606 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659f60b-3172-421c-b8e6-7a246b2d08e5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:35.794966 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659f60b-3172-421c-b8e6-7a246b2d08e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:35.795393 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659f60b-3172-421c-b8e6-7a246b2d08e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:35.807540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659f60b-3172-421c-b8e6-7a246b2d08e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:35.809001 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659f60b-3172-421c-b8e6-7a246b2d08e5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:35.827586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-3659f60b-3172-421c-b8e6-7a246b2d08e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:35.827586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:35.827586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:35.827586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:35.827586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:35.827586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:35.827586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:35.827586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:35.827586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:35.827586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:35.827586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:35.827586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:35.827586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:35.827586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:35.827586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:35.828887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:35.828887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:35.828887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:35.828887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:35.828887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:35.828887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:35.828887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:35.828887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:35.828887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:35.828887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:35.828887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:35.828887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:35.828887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:35.828887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:35.828887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:35.828887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:35.828887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:35.829800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:35.829800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:35.829800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:35.829800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:35.833648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 318/654] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:35.834618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659f60b-3172-421c-b8e6-7a246b2d08e5 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:35.904123 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:35.924828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6715f-14b7-4070-a970-fd6be5f2d3e6 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:35.926673 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:35.964771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4aeb3-c564-4f3d-8d38-387f7df61142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:35.965450 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4aeb3-c564-4f3d-8d38-387f7df61142 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:35.965745 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4aeb3-c564-4f3d-8d38-387f7df61142 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:35.966028 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4aeb3-c564-4f3d-8d38-387f7df61142 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:35.966895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4aeb3-c564-4f3d-8d38-387f7df61142 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:35.967211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4aeb3-c564-4f3d-8d38-387f7df61142 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:35.968026 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659f60b-3172-421c-b8e6-7a246b2d08e5 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:35.968756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4aeb3-c564-4f3d-8d38-387f7df61142 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:35.993611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 337/655] 10.222.0.39 () {56 vars in 1137 bytes} [Thu Jul 14 15:24:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:35.993611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4aeb3-c564-4f3d-8d38-387f7df61142 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:36.010264 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7c96f-5e8a-4092-ad9c-64955a5df5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:36.011075 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7c96f-5e8a-4092-ad9c-64955a5df5da None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:36.011363 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7c96f-5e8a-4092-ad9c-64955a5df5da None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:36.011643 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c7c96f-5e8a-4092-ad9c-64955a5df5da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:36.024111 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7c96f-5e8a-4092-ad9c-64955a5df5da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:36.025709 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c7c96f-5e8a-4092-ad9c-64955a5df5da None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:36.045542 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-d3c7c96f-5e8a-4092-ad9c-64955a5df5da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:36.045542 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:36.045542 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:36.045542 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:36.045542 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:36.045542 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:36.045542 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:36.045542 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:36.045542 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:36.045542 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:36.045542 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:36.045542 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:36.045542 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:36.045542 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:36.045542 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:36.046697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:36.046697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:36.046697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:36.046697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:36.046697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:36.046697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:36.046697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:36.046697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:36.046697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:36.046697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:36.046697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:36.046697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:36.046697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:36.046697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:36.046697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:36.046697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:36.046697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:36.047788 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:36.047788 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:36.047788 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:36.047788 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:36.048017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 319/656] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:36.049502 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7c96f-5e8a-4092-ad9c-64955a5df5da None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:36.128257 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4aeb3-c564-4f3d-8d38-387f7df61142 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:36.164768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032befd-21fd-4015-927c-273ef166ac55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:36.165416 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032befd-21fd-4015-927c-273ef166ac55 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:36.165703 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032befd-21fd-4015-927c-273ef166ac55 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:36.165978 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032befd-21fd-4015-927c-273ef166ac55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:36.166786 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:36.166932 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032befd-21fd-4015-927c-273ef166ac55 None admin] RBAC: Adding query filter params (role.id=1d73a20858554285862ec7d933eb6149, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=64f6b597a47c4a0eb08d1eabc4c0305c) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:36.167132 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032befd-21fd-4015-927c-273ef166ac55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:36.168623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032befd-21fd-4015-927c-273ef166ac55 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:36.170161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c7c96f-5e8a-4092-ad9c-64955a5df5da None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:36.177444 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 338/657] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:24:35 2022] GET /identity/v3/role_assignments?user.id=64f6b597a47c4a0eb08d1eabc4c0305c&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=1d73a20858554285862ec7d933eb6149 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:36.178311 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032befd-21fd-4015-927c-273ef166ac55 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:36.218033 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f8b56-118f-4783-bfe6-07d9f22825ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:36.218877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f8b56-118f-4783-bfe6-07d9f22825ea None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:36.219167 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f8b56-118f-4783-bfe6-07d9f22825ea None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:36.219592 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f8b56-118f-4783-bfe6-07d9f22825ea None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:36.220494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f8b56-118f-4783-bfe6-07d9f22825ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:36.220810 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f8b56-118f-4783-bfe6-07d9f22825ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:36.221508 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:36.222360 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f8b56-118f-4783-bfe6-07d9f22825ea None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:36.236082 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 320/658] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:36.236714 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f8b56-118f-4783-bfe6-07d9f22825ea None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:36.321375 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032befd-21fd-4015-927c-273ef166ac55 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:36.362511 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f8b56-118f-4783-bfe6-07d9f22825ea None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:36.376627 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652849b-d4f5-4c01-966b-ad78c689021d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:36.377307 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652849b-d4f5-4c01-966b-ad78c689021d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:36.377586 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652849b-d4f5-4c01-966b-ad78c689021d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:36.377865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652849b-d4f5-4c01-966b-ad78c689021d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:36.413997 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b93f02-b2d9-42ba-9dab-707dc8e97603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:36.414516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b93f02-b2d9-42ba-9dab-707dc8e97603 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:36.414800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b93f02-b2d9-42ba-9dab-707dc8e97603 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:36.417482 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b93f02-b2d9-42ba-9dab-707dc8e97603 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:36.417482 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b93f02-b2d9-42ba-9dab-707dc8e97603 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:36.417482 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b93f02-b2d9-42ba-9dab-707dc8e97603 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:36.418530 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b93f02-b2d9-42ba-9dab-707dc8e97603 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:36.441082 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 321/659] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:36.443215 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9483e-1070-4c57-ba67-2d2b08b9ebd4 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:36.443513 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9483e-1070-4c57-ba67-2d2b08b9ebd4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:36.443796 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9483e-1070-4c57-ba67-2d2b08b9ebd4 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:36.445069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 322/660] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:36.445921 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9483e-1070-4c57-ba67-2d2b08b9ebd4 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:36.470984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:36.478977 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652849b-d4f5-4c01-966b-ad78c689021d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:36.480570 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652849b-d4f5-4c01-966b-ad78c689021d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:36.510102 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:36.562914 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9483e-1070-4c57-ba67-2d2b08b9ebd4 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:36.592498 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 339/661] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:24:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:36.593273 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652849b-d4f5-4c01-966b-ad78c689021d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:36.605283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc28ed-70bf-4f2f-a535-0af4142f874e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:36.606140 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc28ed-70bf-4f2f-a535-0af4142f874e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:36.606423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc28ed-70bf-4f2f-a535-0af4142f874e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:36.606694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc28ed-70bf-4f2f-a535-0af4142f874e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:36.615240 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc28ed-70bf-4f2f-a535-0af4142f874e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:36.616729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc28ed-70bf-4f2f-a535-0af4142f874e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:36.632329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ffdc28ed-70bf-4f2f-a535-0af4142f874e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 15:24:36.632329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:36.632329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:36.632329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:36.632329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:36.632329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:36.632329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:36.632329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:36.632329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:36.632329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:36.632329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:36.632329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:36.632329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:36.632329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:36.632329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:36.632329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:36.633338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:36.633338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:36.633338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:36.633338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:36.633338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:36.633338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:36.633338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:36.633338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:36.633338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:36.633338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:36.633338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:36.633338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:36.633338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:36.633338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:36.633338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:36.633338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:36.633338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:36.633338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:36.634357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:36.634357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:36.634357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:36.634357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:36.634357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:36.634357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:36.634357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:36.634357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:36.634357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 15:24:36.634357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:36.638472 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 323/662] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:24:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:36.639568 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea247187-90c2-4584-8341-94abcd47d6f4 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:36.639854 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea247187-90c2-4584-8341-94abcd47d6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:36.640286 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea247187-90c2-4584-8341-94abcd47d6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:36.658004 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ea247187-90c2-4584-8341-94abcd47d6f4 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:36.659247 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ea247187-90c2-4584-8341-94abcd47d6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:36.704534 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652849b-d4f5-4c01-966b-ad78c689021d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:36.730490 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:36.739017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 324/663] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:36.739915 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea247187-90c2-4584-8341-94abcd47d6f4 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:36.744646 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887cb6f-4322-4397-b97a-9dfeb4c65917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:36.745145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887cb6f-4322-4397-b97a-9dfeb4c65917 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:36.745427 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887cb6f-4322-4397-b97a-9dfeb4c65917 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:36.745706 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887cb6f-4322-4397-b97a-9dfeb4c65917 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:36.754163 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887cb6f-4322-4397-b97a-9dfeb4c65917 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:36.755607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:36.755732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887cb6f-4322-4397-b97a-9dfeb4c65917 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:36.771988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-1887cb6f-4322-4397-b97a-9dfeb4c65917 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:36.771988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:36.771988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:36.771988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:36.771988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:36.771988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:36.771988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:36.771988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:36.771988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:36.771988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:36.771988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:36.771988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:36.771988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:36.771988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:36.771988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:36.773228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:36.773228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:36.773228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:36.773228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:36.773228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:36.773228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:36.773228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:36.773228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:36.773228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:36.773228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:36.773228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:36.773228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:36.773228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:36.773228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:36.773228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:36.773228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:36.773228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:36.779001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:36.779001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:36.779001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:36.779001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:36.779001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:36.779001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:36.779001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:36.779001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:36.779001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 340/664] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:36.779001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887cb6f-4322-4397-b97a-9dfeb4c65917 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:36.863215 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea247187-90c2-4584-8341-94abcd47d6f4 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:36.888178 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887cb6f-4322-4397-b97a-9dfeb4c65917 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:36.898034 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680f1af-281e-4420-a7aa-dbb602521ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:36.898858 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680f1af-281e-4420-a7aa-dbb602521ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:36.899144 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680f1af-281e-4420-a7aa-dbb602521ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:36.899421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680f1af-281e-4420-a7aa-dbb602521ed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:36.912180 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680f1af-281e-4420-a7aa-dbb602521ed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:36.913799 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680f1af-281e-4420-a7aa-dbb602521ed0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:36.932911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-8680f1af-281e-4420-a7aa-dbb602521ed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:36.932911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:36.932911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:36.932911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:36.932911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:36.932911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:36.932911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:36.932911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:36.932911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:36.932911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:36.932911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:36.932911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:36.932911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:36.932911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:36.932911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:36.934218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:36.934218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:36.934218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:36.934218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:36.934218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:36.934218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:36.934218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:36.934218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:36.934218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:36.934218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:36.934218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:36.934218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:36.934218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:36.934218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:36.934218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:36.934218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:36.934218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:36.935209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:36.935209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:36.935209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:36.935209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:36.935209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 325/665] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:36.935546 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680f1af-281e-4420-a7aa-dbb602521ed0 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:36.941282 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d70ef-6acc-4e1a-8dbb-5da496f20a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:36.942363 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d70ef-6acc-4e1a-8dbb-5da496f20a7e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:36.942816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d70ef-6acc-4e1a-8dbb-5da496f20a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:36.943257 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d70ef-6acc-4e1a-8dbb-5da496f20a7e None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:36.944580 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d70ef-6acc-4e1a-8dbb-5da496f20a7e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:36.945116 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d70ef-6acc-4e1a-8dbb-5da496f20a7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:36.950964 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d70ef-6acc-4e1a-8dbb-5da496f20a7e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:36.971540 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 341/666] 10.222.0.39 () {56 vars in 1139 bytes} [Thu Jul 14 15:24:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:36.976669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d70ef-6acc-4e1a-8dbb-5da496f20a7e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:37.014655 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:37.026247 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:37.060131 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680f1af-281e-4420-a7aa-dbb602521ed0 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:37.090138 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d70ef-6acc-4e1a-8dbb-5da496f20a7e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:37.102342 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029da95-7850-4016-a154-500f67a604d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:37.103435 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029da95-7850-4016-a154-500f67a604d7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:37.103721 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029da95-7850-4016-a154-500f67a604d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:37.103997 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029da95-7850-4016-a154-500f67a604d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:37.118155 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029da95-7850-4016-a154-500f67a604d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:37.126112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-0029da95-7850-4016-a154-500f67a604d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:37.126112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:37.126112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:37.126112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:37.126112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:37.126112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:37.126112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:37.126112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:37.126112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:37.126112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:37.126112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:37.126112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:37.126112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:37.126112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:37.126112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:37.126112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:37.127346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:37.127346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:37.127346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:37.127346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:37.127346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:37.127346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:37.127346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:37.127346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:37.127346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:37.127346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:37.127346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:37.127346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:37.127346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:37.127346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:37.127346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:37.127346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:37.128882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:37.128882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:37.128882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:37.128882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:37.128882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:37.128882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:37.128882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:37.128882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:37.128882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:37.128882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:37.128882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:37.128882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:37.129540 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432a7b5-40a8-4f0e-b112-63d8f8218f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:37.129540 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432a7b5-40a8-4f0e-b112-63d8f8218f95 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:37.129540 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432a7b5-40a8-4f0e-b112-63d8f8218f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:37.129540 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432a7b5-40a8-4f0e-b112-63d8f8218f95 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:37.129810 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 326/667] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:24:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:37.129810 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029da95-7850-4016-a154-500f67a604d7 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:37.129933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432a7b5-40a8-4f0e-b112-63d8f8218f95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:37.129933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432a7b5-40a8-4f0e-b112-63d8f8218f95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:37.130476 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432a7b5-40a8-4f0e-b112-63d8f8218f95 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:37.148296 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 342/668] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:24:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:37.148296 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432a7b5-40a8-4f0e-b112-63d8f8218f95 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:37.247531 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029da95-7850-4016-a154-500f67a604d7 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:37.255167 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432a7b5-40a8-4f0e-b112-63d8f8218f95 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:37.257014 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:37.275492 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:37.289680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13186e05-8cfd-4775-8a01-e0888fce2a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:37.290384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13186e05-8cfd-4775-8a01-e0888fce2a76 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:37.290669 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13186e05-8cfd-4775-8a01-e0888fce2a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:37.290944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13186e05-8cfd-4775-8a01-e0888fce2a76 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:37.291664 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13186e05-8cfd-4775-8a01-e0888fce2a76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:37.291978 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13186e05-8cfd-4775-8a01-e0888fce2a76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:37.293375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13186e05-8cfd-4775-8a01-e0888fce2a76 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:37.294556 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3996d2-9f5d-48ee-8cc9-bf18a2b63062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:37.295407 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3996d2-9f5d-48ee-8cc9-bf18a2b63062 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:37.295856 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3996d2-9f5d-48ee-8cc9-bf18a2b63062 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:37.296195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3996d2-9f5d-48ee-8cc9-bf18a2b63062 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:37.311408 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 327/669] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:37.311408 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13186e05-8cfd-4775-8a01-e0888fce2a76 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:37.379531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3996d2-9f5d-48ee-8cc9-bf18a2b63062 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:37.380909 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3996d2-9f5d-48ee-8cc9-bf18a2b63062 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:37.412917 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13186e05-8cfd-4775-8a01-e0888fce2a76 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:37.455564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3d820-b3e4-4681-b01f-329056f95ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:37.456590 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3d820-b3e4-4681-b01f-329056f95ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:37.457149 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3d820-b3e4-4681-b01f-329056f95ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:37.457426 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc3d820-b3e4-4681-b01f-329056f95ea7 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:37.458232 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3d820-b3e4-4681-b01f-329056f95ea7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:37.458542 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3d820-b3e4-4681-b01f-329056f95ea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:37.460173 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc3d820-b3e4-4681-b01f-329056f95ea7 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:37.471894 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 328/670] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jul 14 15:24:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:37.473141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3d820-b3e4-4681-b01f-329056f95ea7 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:37.503939 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 343/671] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:24:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:37.505396 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3996d2-9f5d-48ee-8cc9-bf18a2b63062 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:37.507984 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:37.534716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:37.593391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc3d820-b3e4-4681-b01f-329056f95ea7 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:37.630422 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f38a6e-3fd9-4742-a51c-2f4aced578ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:37.630891 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3996d2-9f5d-48ee-8cc9-bf18a2b63062 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:37.631010 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f38a6e-3fd9-4742-a51c-2f4aced578ca None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:37.631261 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f38a6e-3fd9-4742-a51c-2f4aced578ca None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:37.631539 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f38a6e-3fd9-4742-a51c-2f4aced578ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:37.632372 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f38a6e-3fd9-4742-a51c-2f4aced578ca None admin] RBAC: Adding query filter params (role.id=1d73a20858554285862ec7d933eb6149, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=14c582c1127142f8a4ebf64bb7b34516) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:37.632683 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f38a6e-3fd9-4742-a51c-2f4aced578ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:37.634149 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f38a6e-3fd9-4742-a51c-2f4aced578ca None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:37.647325 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 329/672] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:24:37 2022] GET /identity/v3/role_assignments?user.id=14c582c1127142f8a4ebf64bb7b34516&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=1d73a20858554285862ec7d933eb6149 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:37.648305 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f38a6e-3fd9-4742-a51c-2f4aced578ca None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:37.677032 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fccb8f-5e5c-4f1d-b9e8-561d0a6bb896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:37.677963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fccb8f-5e5c-4f1d-b9e8-561d0a6bb896 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:37.678861 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fccb8f-5e5c-4f1d-b9e8-561d0a6bb896 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:37.679328 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fccb8f-5e5c-4f1d-b9e8-561d0a6bb896 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:37.690591 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fccb8f-5e5c-4f1d-b9e8-561d0a6bb896 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:37.692462 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fccb8f-5e5c-4f1d-b9e8-561d0a6bb896 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:37.713105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-c0fccb8f-5e5c-4f1d-b9e8-561d0a6bb896 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:37.713105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:37.713105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:37.713105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:37.713105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:37.713105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:37.713105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:37.713105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:37.713105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:37.713105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:37.713105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:37.713105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:37.713105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:37.713105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:37.713105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:37.714156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:37.714156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:37.714156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:37.714156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:37.714156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:37.714156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:37.714156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:37.714156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:37.714156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:37.714156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:37.714156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:37.714156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:37.714156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:37.714156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:37.714156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:37.714156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:37.714156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:37.715157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:37.715157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:37.715157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:37.715157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:37.715157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:37.715157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:37.715157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:37.715157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:37.718232 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 344/673] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:37.719659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fccb8f-5e5c-4f1d-b9e8-561d0a6bb896 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:37.806345 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:37.811889 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f38a6e-3fd9-4742-a51c-2f4aced578ca None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:37.826452 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:37.870346 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fccb8f-5e5c-4f1d-b9e8-561d0a6bb896 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:37.871814 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1574a-853b-4996-bbdc-b68e6aa6ab48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:37.872050 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1574a-853b-4996-bbdc-b68e6aa6ab48 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:37.872312 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1574a-853b-4996-bbdc-b68e6aa6ab48 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:37.872588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1574a-853b-4996-bbdc-b68e6aa6ab48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:37.885403 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1574a-853b-4996-bbdc-b68e6aa6ab48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:37.886818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1574a-853b-4996-bbdc-b68e6aa6ab48 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:37.905760 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-b4a1574a-853b-4996-bbdc-b68e6aa6ab48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:37.905760 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:37.905760 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:37.905760 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:37.905760 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:37.905760 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:37.905760 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:37.905760 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:37.905760 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:37.905760 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:37.905760 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:37.905760 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:37.905760 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:37.905760 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:37.905760 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:37.906779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:37.906779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:37.906779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:37.906779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:37.906779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:37.906779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:37.906779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:37.906779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:37.906779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:37.906779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:37.906779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:37.906779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:37.906779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:37.906779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:37.906779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:37.906779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:37.906779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:37.908450 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:37.908450 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:37.908450 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:37.908450 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:37.908450 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 330/674] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:37.909222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1574a-853b-4996-bbdc-b68e6aa6ab48 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:37.919242 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89ceaa-a677-4a14-b487-1179cf127d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:37.920400 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89ceaa-a677-4a14-b487-1179cf127d6d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:37.920913 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89ceaa-a677-4a14-b487-1179cf127d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:37.921405 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89ceaa-a677-4a14-b487-1179cf127d6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:37.934855 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89ceaa-a677-4a14-b487-1179cf127d6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:37.936335 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89ceaa-a677-4a14-b487-1179cf127d6d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:37.962608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-ca89ceaa-a677-4a14-b487-1179cf127d6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:37.962608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:37.962608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:37.962608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:37.962608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:37.962608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:37.962608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:37.962608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:37.962608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:37.962608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:37.962608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:37.962608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:37.962608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:37.962608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:37.962608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:37.963590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:37.963590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:37.963590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:37.963590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:37.963590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:37.963590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:37.963590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:37.963590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:37.963590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:37.963590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:37.963590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:37.963590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:37.963590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:37.963590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:37.963590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:37.963590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:37.963590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:37.964495 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:37.964495 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:37.964495 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:37.964495 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:37.964495 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 345/675] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:37.965238 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89ceaa-a677-4a14-b487-1179cf127d6d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:38.053135 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1574a-853b-4996-bbdc-b68e6aa6ab48 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:38.084138 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89ceaa-a677-4a14-b487-1179cf127d6d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:38.100263 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988c5f2-9370-48ea-8a13-2380e08e5855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:38.101526 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:38.102421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988c5f2-9370-48ea-8a13-2380e08e5855 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:38.102918 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988c5f2-9370-48ea-8a13-2380e08e5855 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:38.103367 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988c5f2-9370-48ea-8a13-2380e08e5855 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:38.104374 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988c5f2-9370-48ea-8a13-2380e08e5855 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:38.104858 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988c5f2-9370-48ea-8a13-2380e08e5855 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:38.106825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988c5f2-9370-48ea-8a13-2380e08e5855 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:38.124033 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 331/676] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:24:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:38.124895 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988c5f2-9370-48ea-8a13-2380e08e5855 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:38.134096 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049cd8c-71e0-4d77-8a2c-7f708a08aa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:38.134096 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049cd8c-71e0-4d77-8a2c-7f708a08aa53 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:38.134096 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049cd8c-71e0-4d77-8a2c-7f708a08aa53 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:38.134096 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049cd8c-71e0-4d77-8a2c-7f708a08aa53 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:38.134506 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049cd8c-71e0-4d77-8a2c-7f708a08aa53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:38.134506 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049cd8c-71e0-4d77-8a2c-7f708a08aa53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:38.135853 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049cd8c-71e0-4d77-8a2c-7f708a08aa53 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:38.153079 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 346/677] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:38.153079 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049cd8c-71e0-4d77-8a2c-7f708a08aa53 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:38.162458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:38.251945 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988c5f2-9370-48ea-8a13-2380e08e5855 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:38.263936 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049cd8c-71e0-4d77-8a2c-7f708a08aa53 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:38.293367 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d447bd-c17c-4648-b2c2-4de1b74adae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:38.294573 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d447bd-c17c-4648-b2c2-4de1b74adae0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:38.295062 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d447bd-c17c-4648-b2c2-4de1b74adae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:38.295531 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d447bd-c17c-4648-b2c2-4de1b74adae0 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:38.296545 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d447bd-c17c-4648-b2c2-4de1b74adae0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:38.297156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d447bd-c17c-4648-b2c2-4de1b74adae0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:38.298950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d447bd-c17c-4648-b2c2-4de1b74adae0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:38.303303 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1993b-2371-463c-9157-7202f9711514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:38.304291 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1993b-2371-463c-9157-7202f9711514 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:38.304804 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1993b-2371-463c-9157-7202f9711514 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:38.305285 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1993b-2371-463c-9157-7202f9711514 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:38.306496 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1993b-2371-463c-9157-7202f9711514 None admin] RBAC: Adding query filter params (role.id=1d73a20858554285862ec7d933eb6149, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=78d5b8b2802a44eead863280df22b027) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:38.307022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1993b-2371-463c-9157-7202f9711514 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:38.308785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1993b-2371-463c-9157-7202f9711514 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:38.316095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 332/678] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:38.322483 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d447bd-c17c-4648-b2c2-4de1b74adae0 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:38.322697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 347/679] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:24:38 2022] GET /identity/v3/role_assignments?user.id=78d5b8b2802a44eead863280df22b027&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=1d73a20858554285862ec7d933eb6149 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:38.322697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1993b-2371-463c-9157-7202f9711514 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:38.401600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:38.484665 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1993b-2371-463c-9157-7202f9711514 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:38.491883 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:38.514188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d447bd-c17c-4648-b2c2-4de1b74adae0 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:38.531369 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0526e-6922-4034-86a8-d389155c280e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:38.532428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0526e-6922-4034-86a8-d389155c280e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:38.532715 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0526e-6922-4034-86a8-d389155c280e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:38.532993 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0526e-6922-4034-86a8-d389155c280e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:38.542182 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0526e-6922-4034-86a8-d389155c280e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:38.543754 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0526e-6922-4034-86a8-d389155c280e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:38.559808 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8abdf7-952b-409b-9c10-c77137bb7660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:38.560298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-56f0526e-6922-4034-86a8-d389155c280e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:38.560298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:38.560298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:38.560298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:38.560298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:38.560298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:38.560298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:38.560298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:38.560298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:38.560298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:38.560298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:38.560298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:38.560298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:38.560298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:38.560298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:38.561170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:38.561170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:38.561170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:38.561170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:38.561170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:38.561170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:38.561170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:38.561170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:38.561170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:38.561170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:38.561170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:38.561170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:38.561170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:38.561170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:38.561170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:38.561170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:38.561170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:38.562092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:38.562092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:38.562092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:38.562092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:38.562092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:38.562092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:38.562092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:38.562092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:38.562545 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8abdf7-952b-409b-9c10-c77137bb7660 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:38.562545 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8abdf7-952b-409b-9c10-c77137bb7660 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:38.562545 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8abdf7-952b-409b-9c10-c77137bb7660 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:38.562736 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 348/680] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:38.566097 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862a466-5dcf-44cf-983e-d87bd5edd26a None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:38.566097 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862a466-5dcf-44cf-983e-d87bd5edd26a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:38.566097 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862a466-5dcf-44cf-983e-d87bd5edd26a None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:38.566519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 349/681] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:38.567817 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862a466-5dcf-44cf-983e-d87bd5edd26a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:38.576160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8abdf7-952b-409b-9c10-c77137bb7660 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:38.579643 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8abdf7-952b-409b-9c10-c77137bb7660 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:38.600831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-2b8abdf7-952b-409b-9c10-c77137bb7660 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:24:38.600831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:38.600831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:38.600831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:38.600831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:38.600831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:38.600831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:38.600831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:38.600831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:38.600831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:38.600831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:38.600831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:38.600831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:38.600831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:38.600831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:38.600831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:38.603690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:38.603690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:38.603690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:38.603690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:38.603690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:38.603690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:38.603690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:38.603690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:38.603690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:38.603690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:38.603690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:38.603690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:38.603690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:38.603690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:38.603690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:38.603690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:38.603690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:38.603690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:38.605845 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:38.605845 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:38.605845 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:38.605845 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:38.605845 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:38.605845 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:38.605845 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:38.605845 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:38.605845 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:24:38.605845 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:38.605845 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 333/682] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:24:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:38.605845 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5cc7f-3afe-45de-8888-43a13d1a818f None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:38.605845 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5cc7f-3afe-45de-8888-43a13d1a818f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:38.607587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5cc7f-3afe-45de-8888-43a13d1a818f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:38.622521 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-4ca5cc7f-3afe-45de-8888-43a13d1a818f None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:38.623759 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4ca5cc7f-3afe-45de-8888-43a13d1a818f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:38.699242 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 334/683] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:38.707061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5cc7f-3afe-45de-8888-43a13d1a818f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:38.707988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:38.722949 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862a466-5dcf-44cf-983e-d87bd5edd26a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:38.776120 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496010fd-2860-4426-9c56-c7b067e6a849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:38.777211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496010fd-2860-4426-9c56-c7b067e6a849 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:38.777907 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496010fd-2860-4426-9c56-c7b067e6a849 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:38.778418 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496010fd-2860-4426-9c56-c7b067e6a849 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:38.779443 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496010fd-2860-4426-9c56-c7b067e6a849 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:38.779971 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496010fd-2860-4426-9c56-c7b067e6a849 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:38.781718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496010fd-2860-4426-9c56-c7b067e6a849 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:38.788874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:38.796701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 350/684] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:24:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:38.798264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496010fd-2860-4426-9c56-c7b067e6a849 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:38.828536 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5cc7f-3afe-45de-8888-43a13d1a818f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:38.870212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8ee7c-5ac0-45d7-92cb-189624e05371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:38.870737 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8ee7c-5ac0-45d7-92cb-189624e05371 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:38.871079 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8ee7c-5ac0-45d7-92cb-189624e05371 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:38.871372 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8ee7c-5ac0-45d7-92cb-189624e05371 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:38.872325 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8ee7c-5ac0-45d7-92cb-189624e05371 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:38.872567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8ee7c-5ac0-45d7-92cb-189624e05371 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:38.874293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8ee7c-5ac0-45d7-92cb-189624e05371 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:38.900410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 335/685] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jul 14 15:24:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:38.900410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8ee7c-5ac0-45d7-92cb-189624e05371 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:38.936605 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496010fd-2860-4426-9c56-c7b067e6a849 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:38.982891 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337c137-53d3-4ca7-90eb-2210d7b287a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:38.984149 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337c137-53d3-4ca7-90eb-2210d7b287a4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:38.984736 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337c137-53d3-4ca7-90eb-2210d7b287a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:38.985740 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337c137-53d3-4ca7-90eb-2210d7b287a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:38.998994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337c137-53d3-4ca7-90eb-2210d7b287a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:39.010990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-f337c137-53d3-4ca7-90eb-2210d7b287a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:39.010990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:39.010990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:39.010990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:39.010990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:39.010990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:39.010990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:39.010990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:39.010990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:39.010990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:39.010990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:39.010990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:39.010990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:39.010990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:39.010990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:39.010990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:39.012022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:39.012022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:39.012022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:39.012022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:39.012022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:39.012022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:39.012022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:39.012022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:39.012022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:39.012022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:39.012022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:39.012022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:39.012022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:39.012022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:39.012022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:39.012022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:39.012869 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:39.012869 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:39.012869 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:39.012869 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:39.012869 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:39.012869 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:39.012869 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:39.012869 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:39.012869 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:39.012869 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:39.012869 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:39.012869 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:39.020602 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 351/686] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:24:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:39.020602 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337c137-53d3-4ca7-90eb-2210d7b287a4 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:39.039321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8ee7c-5ac0-45d7-92cb-189624e05371 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:39.043244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:39.072673 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:39.083416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d9281-fdf4-4ba2-84ba-3a2ad599f6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:39.084434 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d9281-fdf4-4ba2-84ba-3a2ad599f6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:39.084944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d9281-fdf4-4ba2-84ba-3a2ad599f6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:39.085423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d9281-fdf4-4ba2-84ba-3a2ad599f6e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:39.086646 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d9281-fdf4-4ba2-84ba-3a2ad599f6e7 None admin] RBAC: Adding query filter params (role.id=1d73a20858554285862ec7d933eb6149, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=7b82de4816a244c0b62b5f9f894ccaf4) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:39.087211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d9281-fdf4-4ba2-84ba-3a2ad599f6e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:39.089008 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d9281-fdf4-4ba2-84ba-3a2ad599f6e7 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:39.096561 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 336/687] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:24:38 2022] GET /identity/v3/role_assignments?user.id=7b82de4816a244c0b62b5f9f894ccaf4&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=1d73a20858554285862ec7d933eb6149 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:39.097874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d9281-fdf4-4ba2-84ba-3a2ad599f6e7 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:39.139518 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337c137-53d3-4ca7-90eb-2210d7b287a4 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:39.178179 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f6428-f0bd-4642-bf85-2e186d3ee72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:39.179278 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f6428-f0bd-4642-bf85-2e186d3ee72c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:39.179278 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f6428-f0bd-4642-bf85-2e186d3ee72c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:39.179475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f6428-f0bd-4642-bf85-2e186d3ee72c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:39.228711 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d9281-fdf4-4ba2-84ba-3a2ad599f6e7 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:39.271327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da6b7d-85b0-445c-9cc8-b6b38a8a28de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:39.272411 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da6b7d-85b0-445c-9cc8-b6b38a8a28de None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:39.272904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da6b7d-85b0-445c-9cc8-b6b38a8a28de None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:39.273429 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da6b7d-85b0-445c-9cc8-b6b38a8a28de None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:39.274506 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da6b7d-85b0-445c-9cc8-b6b38a8a28de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:39.275139 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da6b7d-85b0-445c-9cc8-b6b38a8a28de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:39.277014 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da6b7d-85b0-445c-9cc8-b6b38a8a28de None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:39.278570 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f6428-f0bd-4642-bf85-2e186d3ee72c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:39.280249 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f6428-f0bd-4642-bf85-2e186d3ee72c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:39.288387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 337/688] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:24:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:39.294331 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da6b7d-85b0-445c-9cc8-b6b38a8a28de None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:39.316575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:39.360493 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:39.412901 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da6b7d-85b0-445c-9cc8-b6b38a8a28de None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:39.453743 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1b239-92c5-4269-92e2-cfd7e3989406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:39.454956 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1b239-92c5-4269-92e2-cfd7e3989406 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:39.455445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1b239-92c5-4269-92e2-cfd7e3989406 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:39.455922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1b239-92c5-4269-92e2-cfd7e3989406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:39.468368 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1b239-92c5-4269-92e2-cfd7e3989406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:39.470622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 352/689] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:24:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:39.471071 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1b239-92c5-4269-92e2-cfd7e3989406 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:39.479248 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f6428-f0bd-4642-bf85-2e186d3ee72c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:39.497877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-45a1b239-92c5-4269-92e2-cfd7e3989406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:39.497877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:39.497877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:39.497877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:39.497877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:39.497877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:39.497877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:39.497877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:39.497877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:39.497877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:39.497877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:39.497877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:39.497877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:39.497877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:39.497877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:39.498904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:39.498904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:39.498904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:39.498904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:39.498904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:39.498904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:39.498904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:39.498904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:39.498904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:39.498904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:39.498904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:39.498904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:39.498904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:39.498904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:39.498904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:39.498904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:39.498904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:39.499820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:39.499820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:39.499820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:39.499820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:39.499820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 338/690] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:39.508103 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1b239-92c5-4269-92e2-cfd7e3989406 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:39.602258 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f6428-f0bd-4642-bf85-2e186d3ee72c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:39.617200 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1b239-92c5-4269-92e2-cfd7e3989406 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:39.622350 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:39.624480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:39.644167 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda2198-fd5e-4b3e-89ab-7c6b98ef868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:39.645381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda2198-fd5e-4b3e-89ab-7c6b98ef868a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:39.645925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda2198-fd5e-4b3e-89ab-7c6b98ef868a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:39.646498 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda2198-fd5e-4b3e-89ab-7c6b98ef868a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:39.657877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f653b-019e-4a19-bd00-3000fc78468a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:39.658229 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f653b-019e-4a19-bd00-3000fc78468a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:39.658440 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f653b-019e-4a19-bd00-3000fc78468a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:39.658721 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f653b-019e-4a19-bd00-3000fc78468a None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:39.659453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f653b-019e-4a19-bd00-3000fc78468a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:39.659764 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f653b-019e-4a19-bd00-3000fc78468a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:39.661169 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f653b-019e-4a19-bd00-3000fc78468a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:39.661554 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda2198-fd5e-4b3e-89ab-7c6b98ef868a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:39.663273 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda2198-fd5e-4b3e-89ab-7c6b98ef868a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:39.675677 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 339/691] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:39.688383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f653b-019e-4a19-bd00-3000fc78468a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:39.690559 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-5dda2198-fd5e-4b3e-89ab-7c6b98ef868a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:39.690559 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:39.690559 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:39.690559 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:39.690559 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:39.690559 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:39.690559 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:39.690559 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:39.690559 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:39.690559 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:39.690559 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:39.690559 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:39.690559 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:39.690559 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:39.690559 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:39.691494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:39.691494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:39.691494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:39.691494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:39.691494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:39.691494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:39.691494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:39.691494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:39.691494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:39.691494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:39.691494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:39.691494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:39.691494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:39.691494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:39.691494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:39.691494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:39.691494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:39.692497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:39.692497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:39.692497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:39.692497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:39.694822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 353/692] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:39.700661 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda2198-fd5e-4b3e-89ab-7c6b98ef868a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:39.827449 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda2198-fd5e-4b3e-89ab-7c6b98ef868a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:39.827848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f653b-019e-4a19-bd00-3000fc78468a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:39.866242 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6953235-5fa6-438b-8a90-38d0bd47df92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:39.867277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6953235-5fa6-438b-8a90-38d0bd47df92 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:39.867804 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6953235-5fa6-438b-8a90-38d0bd47df92 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:39.868287 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6953235-5fa6-438b-8a90-38d0bd47df92 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:39.869231 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6953235-5fa6-438b-8a90-38d0bd47df92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:39.869761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6953235-5fa6-438b-8a90-38d0bd47df92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:39.871414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6953235-5fa6-438b-8a90-38d0bd47df92 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:39.876850 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fc17b-e780-4810-9052-3eaf57ef0ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:39.877951 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fc17b-e780-4810-9052-3eaf57ef0ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:39.878294 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fc17b-e780-4810-9052-3eaf57ef0ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:39.878635 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fc17b-e780-4810-9052-3eaf57ef0ad4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:39.887969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fc17b-e780-4810-9052-3eaf57ef0ad4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:39.888674 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 354/693] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:39.890232 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fc17b-e780-4810-9052-3eaf57ef0ad4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:39.894948 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6953235-5fa6-438b-8a90-38d0bd47df92 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:39.919584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-b64fc17b-e780-4810-9052-3eaf57ef0ad4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:39.919584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:39.919584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:39.919584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:39.919584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:39.919584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:39.919584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:39.919584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:39.919584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:39.919584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:39.919584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:39.919584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:39.919584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:39.919584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:39.919584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:39.919584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:39.921410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:39.921410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:39.921410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:39.921410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:39.921410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:39.921410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:39.921410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:39.921410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:39.921410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:39.921410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:39.921410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:39.921410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:39.921410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:39.921410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:39.921410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:39.921410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:39.921410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:39.921410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:39.924219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:39.924219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:39.924219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:39.924219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:39.924219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:39.924219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:39.924219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:39.924219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:39.924219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:39.924219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:39.928059 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 340/694] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jul 14 15:24:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:39.933765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:39.936490 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fc17b-e780-4810-9052-3eaf57ef0ad4 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:39.967346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:40.016750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6953235-5fa6-438b-8a90-38d0bd47df92 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:40.050374 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fc17b-e780-4810-9052-3eaf57ef0ad4 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:40.055156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4ed05-c941-4025-be32-b3df4e714cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:40.056227 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4ed05-c941-4025-be32-b3df4e714cab None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:40.056719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4ed05-c941-4025-be32-b3df4e714cab None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:40.057210 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4ed05-c941-4025-be32-b3df4e714cab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:40.065067 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4ed05-c941-4025-be32-b3df4e714cab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:40.066975 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4ed05-c941-4025-be32-b3df4e714cab None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:40.082931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-17a4ed05-c941-4025-be32-b3df4e714cab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:40.082931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:40.082931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:40.082931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:40.082931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:40.082931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:40.082931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:40.082931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:40.082931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:40.082931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:40.082931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:40.082931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:40.082931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:40.082931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:40.082931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:40.083950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:40.083950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:40.083950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:40.083950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:40.083950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:40.083950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:40.083950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:40.083950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:40.083950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:40.083950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:40.083950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:40.083950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:40.083950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:40.083950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:40.083950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:40.083950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:40.083950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:40.084898 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:40.084898 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:40.084898 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:40.084898 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:40.084898 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:40.084898 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:40.084898 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:40.084898 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:40.087467 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 355/695] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:40.094453 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4ed05-c941-4025-be32-b3df4e714cab None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:40.114478 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf70a74-faa8-44fb-95e0-731ea5408005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:40.115205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf70a74-faa8-44fb-95e0-731ea5408005 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:40.115491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf70a74-faa8-44fb-95e0-731ea5408005 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:40.115769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf70a74-faa8-44fb-95e0-731ea5408005 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:40.116880 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf70a74-faa8-44fb-95e0-731ea5408005 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:40.116999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf70a74-faa8-44fb-95e0-731ea5408005 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:40.118452 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf70a74-faa8-44fb-95e0-731ea5408005 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:40.138603 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 341/696] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jul 14 15:24:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:40.144923 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf70a74-faa8-44fb-95e0-731ea5408005 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:40.203643 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:40.215914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4ed05-c941-4025-be32-b3df4e714cab None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:40.253944 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a116a-3811-4c8d-8c69-2507ccaec976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:40.255078 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a116a-3811-4c8d-8c69-2507ccaec976 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:40.255571 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a116a-3811-4c8d-8c69-2507ccaec976 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:40.256054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a116a-3811-4c8d-8c69-2507ccaec976 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:40.256577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:40.257280 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a116a-3811-4c8d-8c69-2507ccaec976 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:40.257819 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a116a-3811-4c8d-8c69-2507ccaec976 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:40.260265 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a116a-3811-4c8d-8c69-2507ccaec976 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:40.260434 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf70a74-faa8-44fb-95e0-731ea5408005 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:40.284555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 356/697] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:24:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:40.286684 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff79588-9f94-4bbf-930c-ade5ea802d99 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:40.287188 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff79588-9f94-4bbf-930c-ade5ea802d99 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:40.287699 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff79588-9f94-4bbf-930c-ade5ea802d99 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:40.289253 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 357/698] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:40.290436 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff79588-9f94-4bbf-930c-ade5ea802d99 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:40.299046 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c580d-17dc-434c-97af-6e335a9fe47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:40.299710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c580d-17dc-434c-97af-6e335a9fe47e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:40.299997 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c580d-17dc-434c-97af-6e335a9fe47e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:40.300276 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c580d-17dc-434c-97af-6e335a9fe47e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:40.375123 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c580d-17dc-434c-97af-6e335a9fe47e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:40.377588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c580d-17dc-434c-97af-6e335a9fe47e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:40.402667 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff79588-9f94-4bbf-930c-ade5ea802d99 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:40.448655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8e5d5-a101-4703-9c62-a927b645cedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:40.450125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8e5d5-a101-4703-9c62-a927b645cedc None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:40.450820 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8e5d5-a101-4703-9c62-a927b645cedc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:40.451497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8e5d5-a101-4703-9c62-a927b645cedc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:40.453091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8e5d5-a101-4703-9c62-a927b645cedc None admin] RBAC: Adding query filter params (role.id=1d73a20858554285862ec7d933eb6149, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=edbbc94ca71c42c0aac562c8c2ec83db) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:40.453965 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8e5d5-a101-4703-9c62-a927b645cedc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:40.456899 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8e5d5-a101-4703-9c62-a927b645cedc None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:40.465277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 358/699] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:24:40 2022] GET /identity/v3/role_assignments?user.id=edbbc94ca71c42c0aac562c8c2ec83db&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=1d73a20858554285862ec7d933eb6149 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:40.466990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b80bf-17b6-4f70-9f5a-5fe6e4e1c0c4 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:40.467540 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b80bf-17b6-4f70-9f5a-5fe6e4e1c0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:40.468065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b80bf-17b6-4f70-9f5a-5fe6e4e1c0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:40.492254 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:40.498134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-472b80bf-17b6-4f70-9f5a-5fe6e4e1c0c4 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:40.498817 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 342/700] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:24:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:40.505284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-472b80bf-17b6-4f70-9f5a-5fe6e4e1c0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:40.505580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c580d-17dc-434c-97af-6e335a9fe47e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:40.525472 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:40.623856 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c580d-17dc-434c-97af-6e335a9fe47e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:40.661014 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 359/701] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:40.666133 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd61299-e972-40a3-bc51-00c9abc11d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:40.667446 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd61299-e972-40a3-bc51-00c9abc11d0b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:40.667960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd61299-e972-40a3-bc51-00c9abc11d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:40.668443 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd61299-e972-40a3-bc51-00c9abc11d0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:40.681724 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd61299-e972-40a3-bc51-00c9abc11d0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:40.683735 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd61299-e972-40a3-bc51-00c9abc11d0b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:40.704006 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b80bf-17b6-4f70-9f5a-5fe6e4e1c0c4 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:40.705255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-9cd61299-e972-40a3-bc51-00c9abc11d0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:40.705255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:40.705255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:40.705255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:40.705255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:40.705255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:40.705255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:40.705255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:40.705255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:40.705255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:40.705255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:40.705255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:40.705255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:40.705255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:40.705255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:40.706188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:40.706188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:40.706188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:40.706188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:40.706188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:40.706188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:40.706188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:40.706188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:40.706188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:40.706188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:40.706188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:40.706188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:40.706188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:40.706188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:40.706188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:40.706188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:40.706188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:40.707133 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:40.707133 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:40.707133 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:40.707133 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:40.709456 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 343/702] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:40.715589 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd61299-e972-40a3-bc51-00c9abc11d0b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:40.770513 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:40.843932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd61299-e972-40a3-bc51-00c9abc11d0b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:40.863563 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472b80bf-17b6-4f70-9f5a-5fe6e4e1c0c4 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:40.887509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597799cb-01d5-485a-898a-5e4c7051df44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:40.888646 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597799cb-01d5-485a-898a-5e4c7051df44 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:40.889142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597799cb-01d5-485a-898a-5e4c7051df44 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:40.889636 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597799cb-01d5-485a-898a-5e4c7051df44 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:40.890792 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597799cb-01d5-485a-898a-5e4c7051df44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:40.891648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597799cb-01d5-485a-898a-5e4c7051df44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:40.893325 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597799cb-01d5-485a-898a-5e4c7051df44 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:40.906691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9d251-1ee1-49ef-ad76-744c3d080481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:40.908314 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9d251-1ee1-49ef-ad76-744c3d080481 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:40.908613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9d251-1ee1-49ef-ad76-744c3d080481 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:40.908897 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9d251-1ee1-49ef-ad76-744c3d080481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:40.915826 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 344/703] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:40.917257 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597799cb-01d5-485a-898a-5e4c7051df44 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:40.922099 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9d251-1ee1-49ef-ad76-744c3d080481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:40.923002 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9d251-1ee1-49ef-ad76-744c3d080481 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:40.926539 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:40.945463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-b9b9d251-1ee1-49ef-ad76-744c3d080481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:40.945463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:40.945463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:40.945463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:40.945463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:40.945463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:40.945463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:40.945463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:40.945463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:40.945463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:40.945463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:40.945463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:40.945463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:40.945463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:40.945463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:40.946550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:40.946550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:40.946550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:40.946550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:40.946550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:40.946550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:40.946550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:40.946550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:40.946550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:40.946550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:40.946550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:40.946550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:40.946550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:40.946550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:40.946550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:40.946550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:40.946550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:40.947483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:40.947483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:40.947483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:40.947483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:40.947483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 360/704] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:40.953849 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9d251-1ee1-49ef-ad76-744c3d080481 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:41.038505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:41.044173 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597799cb-01d5-485a-898a-5e4c7051df44 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:41.075036 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9d251-1ee1-49ef-ad76-744c3d080481 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:41.090307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12254340-0d48-4b84-b404-652ae95bc156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:41.091990 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12254340-0d48-4b84-b404-652ae95bc156 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:41.092608 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12254340-0d48-4b84-b404-652ae95bc156 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:41.093377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12254340-0d48-4b84-b404-652ae95bc156 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:41.107197 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12254340-0d48-4b84-b404-652ae95bc156 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:41.110946 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12254340-0d48-4b84-b404-652ae95bc156 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:41.120484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6dc74-0eca-445f-a4eb-3db49d6b6489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:41.120484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6dc74-0eca-445f-a4eb-3db49d6b6489 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:41.120776 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6dc74-0eca-445f-a4eb-3db49d6b6489 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:41.121030 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6dc74-0eca-445f-a4eb-3db49d6b6489 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:41.121758 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6dc74-0eca-445f-a4eb-3db49d6b6489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:41.122090 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6dc74-0eca-445f-a4eb-3db49d6b6489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:41.123515 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6dc74-0eca-445f-a4eb-3db49d6b6489 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:41.126980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-12254340-0d48-4b84-b404-652ae95bc156 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:41.126980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:41.126980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:41.126980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:41.126980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:41.126980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:41.126980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:41.126980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:41.126980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:41.126980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:41.126980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:41.126980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:41.126980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:41.126980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:41.126980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:41.128601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:41.128601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:41.128601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:41.128601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:41.128601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:41.128601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:41.128601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:41.128601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:41.128601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:41.128601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:41.128601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:41.128601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:41.128601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:41.128601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:41.128601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:41.128601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:41.128601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:41.130394 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:41.130394 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:41.130394 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:41.130394 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:41.130394 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:41.130394 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:41.130394 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:41.130394 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:41.130394 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 345/705] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:41.130394 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aecb23-9030-406b-82f5-f99a4e23e251 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:41.130394 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aecb23-9030-406b-82f5-f99a4e23e251 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:41.131643 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aecb23-9030-406b-82f5-f99a4e23e251 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:41.133423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 346/706] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:41.137791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4b912-182f-44a9-8ba8-afd244b003b2 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:41.138145 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4b912-182f-44a9-8ba8-afd244b003b2 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:41.138398 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4b912-182f-44a9-8ba8-afd244b003b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:41.151929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 361/707] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:41.153769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6dc74-0eca-445f-a4eb-3db49d6b6489 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:41.166354 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-19c4b912-182f-44a9-8ba8-afd244b003b2 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:41.168170 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-19c4b912-182f-44a9-8ba8-afd244b003b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:41.257413 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:41.294522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 347/708] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:24:41.296323 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4b912-182f-44a9-8ba8-afd244b003b2 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:41.342793 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6dc74-0eca-445f-a4eb-3db49d6b6489 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:41.401419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087346ee-e262-4e5c-a9fd-9a300aec9b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:41.402531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087346ee-e262-4e5c-a9fd-9a300aec9b3e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:41.403019 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087346ee-e262-4e5c-a9fd-9a300aec9b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:41.403500 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087346ee-e262-4e5c-a9fd-9a300aec9b3e None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:41.404902 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087346ee-e262-4e5c-a9fd-9a300aec9b3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:41.405435 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087346ee-e262-4e5c-a9fd-9a300aec9b3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:41.408708 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087346ee-e262-4e5c-a9fd-9a300aec9b3e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:41.434340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 362/709] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:24:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:41.435901 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087346ee-e262-4e5c-a9fd-9a300aec9b3e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:41.464972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:41.495852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4b912-182f-44a9-8ba8-afd244b003b2 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:41.559378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3dbd6-e17c-445d-ae91-e7156c5c6578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:41.560964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3dbd6-e17c-445d-ae91-e7156c5c6578 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:41.561697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3dbd6-e17c-445d-ae91-e7156c5c6578 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:41.562744 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3dbd6-e17c-445d-ae91-e7156c5c6578 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:41.563897 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3dbd6-e17c-445d-ae91-e7156c5c6578 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:41.567042 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3dbd6-e17c-445d-ae91-e7156c5c6578 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:41.602864 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087346ee-e262-4e5c-a9fd-9a300aec9b3e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:41.614126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 348/710] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jul 14 15:24:41 2022] POST /identity/v3/users => generated 254 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:41.614126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3dbd6-e17c-445d-ae91-e7156c5c6578 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:41.644823 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:41.688907 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641c02a-5ff7-459c-bca9-8e55f29a5ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:41.690370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641c02a-5ff7-459c-bca9-8e55f29a5ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:41.690666 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641c02a-5ff7-459c-bca9-8e55f29a5ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:41.690942 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641c02a-5ff7-459c-bca9-8e55f29a5ba2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:41.692774 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641c02a-5ff7-459c-bca9-8e55f29a5ba2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:41.694427 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641c02a-5ff7-459c-bca9-8e55f29a5ba2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:41.733751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-4641c02a-5ff7-459c-bca9-8e55f29a5ba2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:24:41.733751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:41.733751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:41.733751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:41.733751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:41.733751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:41.733751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:41.733751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:41.733751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:24:41.733751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:41.733751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:41.733751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:41.733751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:41.733751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:41.733751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:41.733751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:41.736274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:41.736274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:41.736274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:41.736274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:41.736274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:41.736274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:41.736274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:41.736274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:41.736274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:41.736274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:41.736274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:41.736274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:41.736274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:41.736274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:41.736274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:41.736274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:41.737974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:41.737974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:41.737974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:41.737974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:41.737974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:41.737974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:41.737974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:41.737974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:41.737974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:41.737974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:41.737974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:41.737974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:41.737974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:41.737974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:24:41.737974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:41.745944 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 363/711] 10.222.0.39 () {56 vars in 1129 bytes} [Thu Jul 14 15:24:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:41.754698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641c02a-5ff7-459c-bca9-8e55f29a5ba2 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:41.857929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3dbd6-e17c-445d-ae91-e7156c5c6578 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:41.910771 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65023db7-1b16-413a-ac27-1fefd2ed510a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:41.910995 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65023db7-1b16-413a-ac27-1fefd2ed510a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:41.911249 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65023db7-1b16-413a-ac27-1fefd2ed510a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:41.911381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65023db7-1b16-413a-ac27-1fefd2ed510a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:41.912225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65023db7-1b16-413a-ac27-1fefd2ed510a None admin] RBAC: Adding query filter params (role.id=87f040877bfa47bda56305eb022af09e, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=64f6b597a47c4a0eb08d1eabc4c0305c) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:41.912545 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65023db7-1b16-413a-ac27-1fefd2ed510a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:41.914341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65023db7-1b16-413a-ac27-1fefd2ed510a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:41.920903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 349/712] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:24:41 2022] GET /identity/v3/role_assignments?user.id=64f6b597a47c4a0eb08d1eabc4c0305c&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=87f040877bfa47bda56305eb022af09e => generated 259 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:41.951388 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641c02a-5ff7-459c-bca9-8e55f29a5ba2 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:41.955934 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f8ef7-a76c-46c8-8034-9aef77b265c0 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:41.956468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f8ef7-a76c-46c8-8034-9aef77b265c0 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:41.956907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f8ef7-a76c-46c8-8034-9aef77b265c0 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:41.958857 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 350/713] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:24:41.964524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28aef94-42d1-47e9-a0bd-6772b9b22cb3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:41.964824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28aef94-42d1-47e9-a0bd-6772b9b22cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:41.965099 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28aef94-42d1-47e9-a0bd-6772b9b22cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:41.988323 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a28aef94-42d1-47e9-a0bd-6772b9b22cb3 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:41.989605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a28aef94-42d1-47e9-a0bd-6772b9b22cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:41.994100 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:42.013097 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119be52e-f3a6-4cc4-8749-aadfd9dc7ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:42.014813 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119be52e-f3a6-4cc4-8749-aadfd9dc7ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:42.015475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119be52e-f3a6-4cc4-8749-aadfd9dc7ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:42.016111 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119be52e-f3a6-4cc4-8749-aadfd9dc7ee9 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:42.018133 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119be52e-f3a6-4cc4-8749-aadfd9dc7ee9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:42.018865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119be52e-f3a6-4cc4-8749-aadfd9dc7ee9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:42.021481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119be52e-f3a6-4cc4-8749-aadfd9dc7ee9 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:42.030627 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 364/714] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jul 14 15:24:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:42.038581 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119be52e-f3a6-4cc4-8749-aadfd9dc7ee9 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:42.126275 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:42.134161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 351/715] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:24:42.159817 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28aef94-42d1-47e9-a0bd-6772b9b22cb3 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:42.218198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119be52e-f3a6-4cc4-8749-aadfd9dc7ee9 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:42.299722 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189113c6-641b-4a34-ba1b-2e833d773786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:42.300415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189113c6-641b-4a34-ba1b-2e833d773786 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:42.300701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189113c6-641b-4a34-ba1b-2e833d773786 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:42.300978 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189113c6-641b-4a34-ba1b-2e833d773786 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:42.301709 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189113c6-641b-4a34-ba1b-2e833d773786 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:42.302020 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189113c6-641b-4a34-ba1b-2e833d773786 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:42.303787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189113c6-641b-4a34-ba1b-2e833d773786 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:42.316663 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 365/716] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jul 14 15:24:42 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:42.362970 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28aef94-42d1-47e9-a0bd-6772b9b22cb3 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:42.436394 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71a1b4-870e-44a9-a940-d2637de3ae67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:42.437220 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71a1b4-870e-44a9-a940-d2637de3ae67 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:42.437558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71a1b4-870e-44a9-a940-d2637de3ae67 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:42.437846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71a1b4-870e-44a9-a940-d2637de3ae67 None admin] PATH_INFO: `/v3/services/network` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:42.439221 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71a1b4-870e-44a9-a940-d2637de3ae67 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:42.440654 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71a1b4-870e-44a9-a940-d2637de3ae67 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:42.450155 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:42.466494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-dc71a1b4-870e-44a9-a940-d2637de3ae67 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:24:42.466494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:42.466494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:42.466494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:42.466494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:42.466494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:42.466494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:42.466494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:42.466494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:24:42.466494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:42.466494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:42.466494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:42.466494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:42.466494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:42.466494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:42.466494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:42.466494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:42.467640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:42.467640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:42.467640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:42.467640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:42.467640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:42.467640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:42.467640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:42.467640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:42.467640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:42.467640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:42.467640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:42.467640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:42.467640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:42.467640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:42.467640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:42.467640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:42.468588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:42.468588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:42.468588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:42.468588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:42.468588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:42.468588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:42.468588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:42.468588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:42.468588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:42.468588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:42.468588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:42.468588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:42.468588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:24:42.468588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:42.468588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 352/717] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:42 2022] GET /identity/v3/services/network => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:42.475161 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189113c6-641b-4a34-ba1b-2e833d773786 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:42.617379 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189113c6-641b-4a34-ba1b-2e833d773786 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:42.629555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:42.667405 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadeae6b-3cc2-4288-a5a2-004e137e84a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:42.668532 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadeae6b-3cc2-4288-a5a2-004e137e84a6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:42.669061 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadeae6b-3cc2-4288-a5a2-004e137e84a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:42.669547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadeae6b-3cc2-4288-a5a2-004e137e84a6 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:42.670501 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadeae6b-3cc2-4288-a5a2-004e137e84a6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:42.671022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadeae6b-3cc2-4288-a5a2-004e137e84a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:42.673337 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadeae6b-3cc2-4288-a5a2-004e137e84a6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:42.681040 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 366/718] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jul 14 15:24:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:42.691248 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71a1b4-870e-44a9-a940-d2637de3ae67 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:42.840672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71a1b4-870e-44a9-a940-d2637de3ae67 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:42.896507 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5747ca3d-8ece-421d-bf37-f60303c5ed3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:42.897314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747ca3d-8ece-421d-bf37-f60303c5ed3c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:42.897511 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747ca3d-8ece-421d-bf37-f60303c5ed3c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:42.897751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747ca3d-8ece-421d-bf37-f60303c5ed3c None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:42.898505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747ca3d-8ece-421d-bf37-f60303c5ed3c None admin] RBAC: Adding query filter params (type=network) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:42.898820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747ca3d-8ece-421d-bf37-f60303c5ed3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:42.900230 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5747ca3d-8ece-421d-bf37-f60303c5ed3c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:42.906673 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 353/719] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jul 14 15:24:42 2022] GET /identity/v3/services?type=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:43.713084 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc5a5c-0d08-478e-b44f-a3d11d36bc3e None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:43.713596 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc5a5c-0d08-478e-b44f-a3d11d36bc3e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:43.713596 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc5a5c-0d08-478e-b44f-a3d11d36bc3e None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:43.715274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 367/720] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:43.721330 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf248c-87af-4272-a33e-3ae5dc436428 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:43.721625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf248c-87af-4272-a33e-3ae5dc436428 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:43.721912 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf248c-87af-4272-a33e-3ae5dc436428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:43.744622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-caaf248c-87af-4272-a33e-3ae5dc436428 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:43.745846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-caaf248c-87af-4272-a33e-3ae5dc436428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:43.834638 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:43.852029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 354/721] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:24:43.898603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc5a5c-0d08-478e-b44f-a3d11d36bc3e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:44.083808 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc5a5c-0d08-478e-b44f-a3d11d36bc3e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:44.132288 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72687b-70fd-4b80-a941-5bc7e0394a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:44.133094 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72687b-70fd-4b80-a941-5bc7e0394a7b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:44.133380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72687b-70fd-4b80-a941-5bc7e0394a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:44.133665 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72687b-70fd-4b80-a941-5bc7e0394a7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:44.146134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72687b-70fd-4b80-a941-5bc7e0394a7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:44.154141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-bd72687b-70fd-4b80-a941-5bc7e0394a7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:44.154141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:44.154141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:44.154141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:44.154141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:44.154141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:44.154141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:44.154141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:44.154141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:44.154141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:44.154141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:44.154141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:44.154141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:44.154141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:44.154141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:44.154141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:44.155131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:44.155131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:44.155131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:44.155131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:44.155131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:44.155131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:44.155131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:44.155131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:44.155131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:44.155131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:44.155131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:44.155131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:44.155131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:44.155131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:44.155131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:44.155131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:44.156008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:44.156008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:44.156008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:44.156008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:44.156008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:44.156008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:44.156008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:44.156008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:44.156008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:44.156008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:44.156008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:44.156008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:44.156008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 368/722] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:24:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:44.164131 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf248c-87af-4272-a33e-3ae5dc436428 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:44.341010 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf248c-87af-4272-a33e-3ae5dc436428 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:44.396277 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99b1f4-5fa8-4ad9-9eaf-0b712ec4c32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:44.396969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99b1f4-5fa8-4ad9-9eaf-0b712ec4c32e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:44.397256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99b1f4-5fa8-4ad9-9eaf-0b712ec4c32e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:44.397534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99b1f4-5fa8-4ad9-9eaf-0b712ec4c32e None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:44.398320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99b1f4-5fa8-4ad9-9eaf-0b712ec4c32e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:44.398629 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99b1f4-5fa8-4ad9-9eaf-0b712ec4c32e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:44.400033 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99b1f4-5fa8-4ad9-9eaf-0b712ec4c32e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:44.413870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 355/723] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:24:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:44.420831 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72687b-70fd-4b80-a941-5bc7e0394a7b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:44.481555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:44.590687 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72687b-70fd-4b80-a941-5bc7e0394a7b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:44.634330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fe6e1-0a34-4053-899d-7ba0c5086e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:44.635051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fe6e1-0a34-4053-899d-7ba0c5086e3d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:44.635338 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fe6e1-0a34-4053-899d-7ba0c5086e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:44.635616 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fe6e1-0a34-4053-899d-7ba0c5086e3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:44.635874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3d8fe-587a-4a8b-b005-100ea39226dc None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:44.636388 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3d8fe-587a-4a8b-b005-100ea39226dc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:44.636864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3d8fe-587a-4a8b-b005-100ea39226dc None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:44.638787 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 356/724] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:44.648367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fe6e1-0a34-4053-899d-7ba0c5086e3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:44.649859 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fe6e1-0a34-4053-899d-7ba0c5086e3d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:44.652024 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a69462-1727-4a79-8286-46dc4f2465cb None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:44.652803 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a69462-1727-4a79-8286-46dc4f2465cb None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:44.653313 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a69462-1727-4a79-8286-46dc4f2465cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:44.668824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-445fe6e1-0a34-4053-899d-7ba0c5086e3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:44.668824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:44.668824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:44.668824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:44.668824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:44.668824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:44.668824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:44.668824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:44.668824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:44.668824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:44.668824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:44.668824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:44.668824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:44.668824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:44.668824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:44.669866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:44.669866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:44.669866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:44.669866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:44.669866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:44.669866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:44.669866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:44.669866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:44.669866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:44.669866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:44.669866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:44.669866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:44.669866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:44.669866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:44.669866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:44.669866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:44.669866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:44.670798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:44.670798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:44.670798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:44.670798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:44.670798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 369/725] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:44.680545 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fe6e1-0a34-4053-899d-7ba0c5086e3d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:44.696949 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a1a69462-1727-4a79-8286-46dc4f2465cb None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:44.698396 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a1a69462-1727-4a79-8286-46dc4f2465cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:44.757081 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:44.776424 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 357/726] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:24:44.777967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b40009-8d5c-45bd-b07e-65c71c830fd3 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:44.778429 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b40009-8d5c-45bd-b07e-65c71c830fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:44.778852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b40009-8d5c-45bd-b07e-65c71c830fd3 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:44.780490 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 358/727] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:44.799041 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:44.804942 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe29fa-8c98-43f6-bb6f-8f7a0e5aa2cb None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:44.805417 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe29fa-8c98-43f6-bb6f-8f7a0e5aa2cb None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:44.805844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe29fa-8c98-43f6-bb6f-8f7a0e5aa2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:44.819756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fe6e1-0a34-4053-899d-7ba0c5086e3d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:44.827043 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-bebe29fa-8c98-43f6-bb6f-8f7a0e5aa2cb None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:44.828458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bebe29fa-8c98-43f6-bb6f-8f7a0e5aa2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:44.856376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d87478-4761-4e0f-b9ad-ec0a3bd70ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:44.857082 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d87478-4761-4e0f-b9ad-ec0a3bd70ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:44.857396 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d87478-4761-4e0f-b9ad-ec0a3bd70ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:44.857680 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d87478-4761-4e0f-b9ad-ec0a3bd70ef1 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:44.858435 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d87478-4761-4e0f-b9ad-ec0a3bd70ef1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:44.858750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d87478-4761-4e0f-b9ad-ec0a3bd70ef1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:44.860860 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d87478-4761-4e0f-b9ad-ec0a3bd70ef1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:44.873903 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 370/728] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:44.874902 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d87478-4761-4e0f-b9ad-ec0a3bd70ef1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:44.906702 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 359/729] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 15:24:44.908218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe29fa-8c98-43f6-bb6f-8f7a0e5aa2cb None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:45.014268 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d87478-4761-4e0f-b9ad-ec0a3bd70ef1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:45.021187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe29fa-8c98-43f6-bb6f-8f7a0e5aa2cb None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:45.040290 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:45.053975 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57642b2b-fb84-45e2-8bb8-3d636849c5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:45.054757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57642b2b-fb84-45e2-8bb8-3d636849c5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:45.055044 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57642b2b-fb84-45e2-8bb8-3d636849c5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:45.055325 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57642b2b-fb84-45e2-8bb8-3d636849c5d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:45.061833 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c54603-1496-42d1-89c1-66adeef0b5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:45.063020 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c54603-1496-42d1-89c1-66adeef0b5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:45.063851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c54603-1496-42d1-89c1-66adeef0b5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:45.064288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c54603-1496-42d1-89c1-66adeef0b5b3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:45.066594 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57642b2b-fb84-45e2-8bb8-3d636849c5d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:45.072815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c54603-1496-42d1-89c1-66adeef0b5b3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:45.074429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-57642b2b-fb84-45e2-8bb8-3d636849c5d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:45.074429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:45.074429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:45.074429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:45.074429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:45.074429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:45.074429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:45.074429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:45.074429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:45.074429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:45.074429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:45.074429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:45.074429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:45.074429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:45.074429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:45.074429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:45.075522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:45.075522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:45.075522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:45.075522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:45.075522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:45.075522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:45.075522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:45.075522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:45.075522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:45.075522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:45.075522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:45.075522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:45.075522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:45.075522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:45.075522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:45.075522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:45.076526 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:45.076526 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:45.076526 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:45.076526 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:45.076526 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:45.076526 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:45.076526 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:45.076526 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:45.076526 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:45.076526 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:45.076526 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:45.076526 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:45.077373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c54603-1496-42d1-89c1-66adeef0b5b3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:45.081877 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 371/730] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:24:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:45.082819 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57642b2b-fb84-45e2-8bb8-3d636849c5d9 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:45.087023 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:45.096175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-e2c54603-1496-42d1-89c1-66adeef0b5b3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:24:45.096175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:45.096175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:45.096175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:45.096175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:45.096175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:45.096175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:45.096175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:45.096175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:45.096175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:45.096175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:45.096175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:45.096175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:45.096175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:45.096175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:45.096175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:45.097159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:45.097159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:45.097159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:45.097159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:45.097159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:45.097159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:45.097159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:45.097159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:45.097159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:45.097159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:45.097159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:45.097159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:45.097159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:45.097159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:45.097159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:45.097159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:45.097159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:45.097159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:45.098187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:45.098187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:45.098187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:45.098187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:45.098187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:45.098187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:45.098187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:45.098187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:45.098187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:24:45.098187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:45.098187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 360/731] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:24:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:45.102261 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c54603-1496-42d1-89c1-66adeef0b5b3 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:45.197969 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57642b2b-fb84-45e2-8bb8-3d636849c5d9 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:45.210442 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c54603-1496-42d1-89c1-66adeef0b5b3 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:45.248996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87051d95-73a5-42e2-9fe6-c3c568c478fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:45.249678 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87051d95-73a5-42e2-9fe6-c3c568c478fd None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:45.249966 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87051d95-73a5-42e2-9fe6-c3c568c478fd None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:45.250276 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87051d95-73a5-42e2-9fe6-c3c568c478fd None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:45.251433 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87051d95-73a5-42e2-9fe6-c3c568c478fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:45.251644 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6596b7-e4c6-44b3-8bb2-ee19340e3f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:45.251947 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87051d95-73a5-42e2-9fe6-c3c568c478fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:45.253152 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6596b7-e4c6-44b3-8bb2-ee19340e3f79 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:45.253525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87051d95-73a5-42e2-9fe6-c3c568c478fd None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:45.253956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6596b7-e4c6-44b3-8bb2-ee19340e3f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:45.254641 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6596b7-e4c6-44b3-8bb2-ee19340e3f79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:45.263019 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 361/732] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jul 14 15:24:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:45.264349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e191c-969c-4f50-b489-2f96f9e486bc None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:45.264636 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e191c-969c-4f50-b489-2f96f9e486bc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:45.264908 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e191c-969c-4f50-b489-2f96f9e486bc None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:45.266503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 362/733] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:45.267221 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e191c-969c-4f50-b489-2f96f9e486bc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:45.276573 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6596b7-e4c6-44b3-8bb2-ee19340e3f79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:45.288039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-fd6596b7-e4c6-44b3-8bb2-ee19340e3f79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:45.288039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:45.288039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:45.288039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:45.288039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:45.288039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:45.288039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:45.288039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:45.288039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:45.288039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:45.288039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:45.288039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:45.288039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:45.288039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:45.288039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:45.288039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:45.289841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:45.289841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:45.289841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:45.289841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:45.289841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:45.289841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:45.289841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:45.289841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:45.289841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:45.289841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:45.289841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:45.289841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:45.289841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:45.289841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:45.289841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:45.289841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:45.290751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:45.290751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:45.290751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:45.290751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:45.290751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:45.290751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:45.290751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:45.290751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:45.290751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:45.290751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:45.290751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:45.290751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:45.290751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 372/734] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:24:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:45.290751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6596b7-e4c6-44b3-8bb2-ee19340e3f79 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:45.339538 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:45.372787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:45.434816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6596b7-e4c6-44b3-8bb2-ee19340e3f79 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:45.444376 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e191c-969c-4f50-b489-2f96f9e486bc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:45.475766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd737f61-3180-4682-ae41-3a581fe998dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:45.476767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd737f61-3180-4682-ae41-3a581fe998dd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:45.477184 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd737f61-3180-4682-ae41-3a581fe998dd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:45.477602 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd737f61-3180-4682-ae41-3a581fe998dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:45.488587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7926d-b4d6-4bbe-b569-ec136a8c67df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:45.489688 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7926d-b4d6-4bbe-b569-ec136a8c67df None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:45.489966 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7926d-b4d6-4bbe-b569-ec136a8c67df None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:45.490469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7926d-b4d6-4bbe-b569-ec136a8c67df None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:45.491324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7926d-b4d6-4bbe-b569-ec136a8c67df None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:45.491487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd737f61-3180-4682-ae41-3a581fe998dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:45.491644 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7926d-b4d6-4bbe-b569-ec136a8c67df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:45.493088 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7926d-b4d6-4bbe-b569-ec136a8c67df None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:45.493371 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd737f61-3180-4682-ae41-3a581fe998dd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:45.512888 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-cd737f61-3180-4682-ae41-3a581fe998dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:45.512888 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:45.512888 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:45.512888 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:45.512888 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:45.512888 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:45.512888 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:45.512888 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:45.512888 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:45.512888 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:45.512888 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:45.512888 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:45.512888 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:45.512888 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:45.512888 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:45.513880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:45.513880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:45.513880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:45.513880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:45.513880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:45.513880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:45.513880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:45.513880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:45.513880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:45.513880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:45.513880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:45.513880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:45.513880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:45.513880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:45.513880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:45.513880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:45.513880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:45.514831 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:45.514831 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:45.514831 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:45.514831 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:45.514831 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 373/735] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:45.515848 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4ae69-74f7-4808-be07-efdda0dbb74a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:45.516190 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4ae69-74f7-4808-be07-efdda0dbb74a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:45.517004 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4ae69-74f7-4808-be07-efdda0dbb74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:45.524807 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 363/736] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jul 14 15:24:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:45.524807 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7926d-b4d6-4bbe-b569-ec136a8c67df None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:45.535455 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f0f4ae69-74f7-4808-be07-efdda0dbb74a None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:45.536674 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f0f4ae69-74f7-4808-be07-efdda0dbb74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:45.617334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 374/737] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:45.618240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4ae69-74f7-4808-be07-efdda0dbb74a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:45.653468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:45.661273 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7926d-b4d6-4bbe-b569-ec136a8c67df None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:45.671112 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:45.696363 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b95d81-d06e-4ff4-bfc2-023b3731b2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:45.697037 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b95d81-d06e-4ff4-bfc2-023b3731b2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:45.697323 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b95d81-d06e-4ff4-bfc2-023b3731b2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:45.697601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b95d81-d06e-4ff4-bfc2-023b3731b2a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:45.698483 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b95d81-d06e-4ff4-bfc2-023b3731b2a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:45.698787 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b95d81-d06e-4ff4-bfc2-023b3731b2a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:45.700185 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b95d81-d06e-4ff4-bfc2-023b3731b2a9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:45.710427 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 364/738] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:24:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:45.711350 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b95d81-d06e-4ff4-bfc2-023b3731b2a9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:45.728768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4ae69-74f7-4808-be07-efdda0dbb74a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:45.763557 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09543f-2a61-4d94-8bc1-61bb9331e2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:45.764224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09543f-2a61-4d94-8bc1-61bb9331e2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:45.764510 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09543f-2a61-4d94-8bc1-61bb9331e2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:45.764787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09543f-2a61-4d94-8bc1-61bb9331e2d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:45.765517 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09543f-2a61-4d94-8bc1-61bb9331e2d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:45.765820 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09543f-2a61-4d94-8bc1-61bb9331e2d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:45.767803 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09543f-2a61-4d94-8bc1-61bb9331e2d8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:45.779406 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 375/739] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:45.780729 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93619ed-d1f7-4c58-a44b-807d67134015 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:45.781020 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93619ed-d1f7-4c58-a44b-807d67134015 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:45.781304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93619ed-d1f7-4c58-a44b-807d67134015 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:45.783220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 376/740] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:45.783943 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93619ed-d1f7-4c58-a44b-807d67134015 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:45.819727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b95d81-d06e-4ff4-bfc2-023b3731b2a9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:45.856223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0f4ea-030f-435d-81cd-6b11ee1cb641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:45.856879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0f4ea-030f-435d-81cd-6b11ee1cb641 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:45.857164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0f4ea-030f-435d-81cd-6b11ee1cb641 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:45.857443 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0f4ea-030f-435d-81cd-6b11ee1cb641 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:45.885388 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:45.889251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93619ed-d1f7-4c58-a44b-807d67134015 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:45.897217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:45.926362 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77a4f2-44ca-41bf-93be-b028f523425f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:45.927026 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77a4f2-44ca-41bf-93be-b028f523425f None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:45.927307 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77a4f2-44ca-41bf-93be-b028f523425f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:45.927583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77a4f2-44ca-41bf-93be-b028f523425f None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:45.928136 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0f4ea-030f-435d-81cd-6b11ee1cb641 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:45.928292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77a4f2-44ca-41bf-93be-b028f523425f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:45.929627 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0f4ea-030f-435d-81cd-6b11ee1cb641 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:45.929735 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77a4f2-44ca-41bf-93be-b028f523425f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:45.945775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 377/741] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jul 14 15:24:45 2022] POST /identity/v3/services => generated 251 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:45.946637 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77a4f2-44ca-41bf-93be-b028f523425f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:46.065210 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 365/742] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:24:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:46.065210 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0f4ea-030f-435d-81cd-6b11ee1cb641 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:46.089573 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77a4f2-44ca-41bf-93be-b028f523425f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:46.135653 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:46.138110 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62922e13-39e9-4735-b8d7-aa4f0abb2c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:46.138110 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62922e13-39e9-4735-b8d7-aa4f0abb2c1b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:46.138110 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62922e13-39e9-4735-b8d7-aa4f0abb2c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:46.138468 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62922e13-39e9-4735-b8d7-aa4f0abb2c1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:46.155131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62922e13-39e9-4735-b8d7-aa4f0abb2c1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:46.156619 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62922e13-39e9-4735-b8d7-aa4f0abb2c1b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:46.179658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-62922e13-39e9-4735-b8d7-aa4f0abb2c1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:46.179658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:46.179658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:46.179658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:46.179658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:46.179658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:46.179658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:46.179658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:46.179658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:46.179658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:46.179658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:46.179658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:46.179658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:46.179658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:46.179658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:46.180632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:46.180632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:46.180632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:46.180632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:46.180632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:46.180632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:46.180632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:46.180632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:46.180632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:46.180632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:46.180632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:46.180632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:46.180632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:46.180632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:46.180632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:46.180632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:46.180632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:46.181564 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:46.181564 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:46.181564 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:46.181564 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:46.181564 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 378/743] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:46.182160 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b72a88-a6cc-4685-8d50-2f59759b640e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:46.182445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b72a88-a6cc-4685-8d50-2f59759b640e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:46.182722 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b72a88-a6cc-4685-8d50-2f59759b640e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:46.197334 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0f4ea-030f-435d-81cd-6b11ee1cb641 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:46.199642 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c2b72a88-a6cc-4685-8d50-2f59759b640e None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:46.200833 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c2b72a88-a6cc-4685-8d50-2f59759b640e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:46.211399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:46.237313 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caffb51-4464-42ec-9c4b-3fbca9e99d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:46.238154 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caffb51-4464-42ec-9c4b-3fbca9e99d14 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:46.238437 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caffb51-4464-42ec-9c4b-3fbca9e99d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:46.238711 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caffb51-4464-42ec-9c4b-3fbca9e99d14 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:46.246808 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caffb51-4464-42ec-9c4b-3fbca9e99d14 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:46.248383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caffb51-4464-42ec-9c4b-3fbca9e99d14 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:46.266659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-7caffb51-4464-42ec-9c4b-3fbca9e99d14 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:24:46.266659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:46.266659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:46.266659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:46.266659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:46.266659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:46.266659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:46.266659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:46.266659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:46.266659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:46.266659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:46.266659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:46.266659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:46.266659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:46.266659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:46.266659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:46.268222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:46.268222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:46.268222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:46.268222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:46.268222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:46.268222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:46.268222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:46.268222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:46.268222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:46.268222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:46.268222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:46.268222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:46.268222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:46.268222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:46.268222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:46.268222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:46.268222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:46.268222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:46.269181 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:46.269181 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:46.269181 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:46.269181 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:46.269181 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:46.269181 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:46.269181 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:46.269181 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:46.269181 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:24:46.269181 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:46.282570 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 379/744] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:46.282806 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 366/745] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jul 14 15:24:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:46.282891 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b72a88-a6cc-4685-8d50-2f59759b640e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:46.282965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caffb51-4464-42ec-9c4b-3fbca9e99d14 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:46.404933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caffb51-4464-42ec-9c4b-3fbca9e99d14 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:46.405210 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b72a88-a6cc-4685-8d50-2f59759b640e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:46.432706 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:46.456088 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6192df7-8f8b-4402-aac3-9a7274b7fc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:46.456503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e656752-9a52-42a1-b730-5bcbae9c940f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:46.456821 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6192df7-8f8b-4402-aac3-9a7274b7fc89 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:46.457050 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6192df7-8f8b-4402-aac3-9a7274b7fc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:46.457327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6192df7-8f8b-4402-aac3-9a7274b7fc89 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:46.457688 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e656752-9a52-42a1-b730-5bcbae9c940f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:46.457981 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e656752-9a52-42a1-b730-5bcbae9c940f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:46.458187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6192df7-8f8b-4402-aac3-9a7274b7fc89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:46.458279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e656752-9a52-42a1-b730-5bcbae9c940f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:46.458367 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6192df7-8f8b-4402-aac3-9a7274b7fc89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:46.459769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6192df7-8f8b-4402-aac3-9a7274b7fc89 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:46.478365 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 367/746] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:46.478580 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e656752-9a52-42a1-b730-5bcbae9c940f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:46.478681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6192df7-8f8b-4402-aac3-9a7274b7fc89 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:46.478807 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e656752-9a52-42a1-b730-5bcbae9c940f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:46.483311 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:46.505222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-8e656752-9a52-42a1-b730-5bcbae9c940f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:46.505222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:46.505222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:46.505222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:46.505222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:46.505222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:46.505222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:46.505222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:46.505222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:46.505222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:46.505222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:46.505222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:46.505222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:46.505222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:46.505222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:46.506336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:46.506336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:46.506336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:46.506336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:46.506336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:46.506336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:46.506336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:46.506336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:46.506336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:46.506336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:46.506336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:46.506336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:46.506336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:46.506336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:46.506336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:46.506336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:46.506336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:46.507258 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:46.507258 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:46.507258 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:46.507258 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:46.507258 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 380/747] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:46.508204 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e656752-9a52-42a1-b730-5bcbae9c940f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:46.621279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6192df7-8f8b-4402-aac3-9a7274b7fc89 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:46.652027 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e656752-9a52-42a1-b730-5bcbae9c940f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:46.660928 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32a79d-74e8-4d91-8cd3-37c74fac29f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:46.662001 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32a79d-74e8-4d91-8cd3-37c74fac29f5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:46.662321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32a79d-74e8-4d91-8cd3-37c74fac29f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:46.662616 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32a79d-74e8-4d91-8cd3-37c74fac29f5 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:46.663540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32a79d-74e8-4d91-8cd3-37c74fac29f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:46.664019 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32a79d-74e8-4d91-8cd3-37c74fac29f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:46.666087 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32a79d-74e8-4d91-8cd3-37c74fac29f5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:46.688347 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 368/748] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jul 14 15:24:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:46.689616 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32a79d-74e8-4d91-8cd3-37c74fac29f5 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:46.712483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15651e0a-e192-4e46-b758-d99994d78c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:46.713163 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15651e0a-e192-4e46-b758-d99994d78c0d None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:46.713450 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15651e0a-e192-4e46-b758-d99994d78c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:46.713729 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15651e0a-e192-4e46-b758-d99994d78c0d None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:46.714500 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15651e0a-e192-4e46-b758-d99994d78c0d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:46.715921 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15651e0a-e192-4e46-b758-d99994d78c0d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:46.734152 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 381/749] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jul 14 15:24:46 2022] POST /identity/v3/services => generated 240 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:46.734152 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15651e0a-e192-4e46-b758-d99994d78c0d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:46.744051 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:46.824764 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:46.856262 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32a79d-74e8-4d91-8cd3-37c74fac29f5 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:46.906780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d3f7d-f9db-48bc-aa7b-7170eb422870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:46.907665 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d3f7d-f9db-48bc-aa7b-7170eb422870 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:46.908110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d3f7d-f9db-48bc-aa7b-7170eb422870 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:46.908433 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d3f7d-f9db-48bc-aa7b-7170eb422870 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:46.909436 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15651e0a-e192-4e46-b758-d99994d78c0d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:46.924124 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d3f7d-f9db-48bc-aa7b-7170eb422870 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:46.926467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d3f7d-f9db-48bc-aa7b-7170eb422870 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:46.954587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-b98d3f7d-f9db-48bc-aa7b-7170eb422870 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:46.954587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:46.954587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:46.954587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:46.954587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:46.954587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:46.954587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:46.954587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:46.954587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:46.954587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:46.954587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:46.954587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:46.954587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:46.954587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:46.954587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:46.954587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:46.956110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:46.956110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:46.956110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:46.956110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:46.956110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:46.956110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:46.956110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:46.956110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:46.956110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:46.956110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:46.956110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:46.956110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:46.956110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:46.956110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:46.956110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:46.956110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:46.956110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:46.956110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:46.957373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:46.957373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:46.957373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:46.957373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:46.957373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:46.957373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:46.957373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:46.957373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:46.957373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:46.957373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:46.957373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 369/750] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jul 14 15:24:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:46.966450 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d3f7d-f9db-48bc-aa7b-7170eb422870 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:46.982754 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108d54a-cb7d-49c9-bcd2-17ef5c042ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:46.983439 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108d54a-cb7d-49c9-bcd2-17ef5c042ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:46.983805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108d54a-cb7d-49c9-bcd2-17ef5c042ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:46.984088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108d54a-cb7d-49c9-bcd2-17ef5c042ec9 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:46.984725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108d54a-cb7d-49c9-bcd2-17ef5c042ec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:46.986661 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108d54a-cb7d-49c9-bcd2-17ef5c042ec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:46.988266 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108d54a-cb7d-49c9-bcd2-17ef5c042ec9 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:47.011680 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 382/751] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:47.011680 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108d54a-cb7d-49c9-bcd2-17ef5c042ec9 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:47.130767 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:47.145042 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d3f7d-f9db-48bc-aa7b-7170eb422870 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:47.203070 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108d54a-cb7d-49c9-bcd2-17ef5c042ec9 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:47.213454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc8311-c211-4f70-8a6f-ae2b87fd7fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:47.214264 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc8311-c211-4f70-8a6f-ae2b87fd7fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:47.214621 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc8311-c211-4f70-8a6f-ae2b87fd7fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:47.215134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc8311-c211-4f70-8a6f-ae2b87fd7fd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:47.226182 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:47.257867 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec740e82-93c3-4c94-bf4c-62c9c7f32ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:47.259164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec740e82-93c3-4c94-bf4c-62c9c7f32ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:47.260005 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec740e82-93c3-4c94-bf4c-62c9c7f32ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:47.260880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec740e82-93c3-4c94-bf4c-62c9c7f32ed7 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:47.262229 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec740e82-93c3-4c94-bf4c-62c9c7f32ed7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:47.262994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec740e82-93c3-4c94-bf4c-62c9c7f32ed7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:47.265541 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec740e82-93c3-4c94-bf4c-62c9c7f32ed7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:47.300239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 383/752] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jul 14 15:24:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:47.301775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec740e82-93c3-4c94-bf4c-62c9c7f32ed7 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:47.311219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc8311-c211-4f70-8a6f-ae2b87fd7fd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:47.312708 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc8311-c211-4f70-8a6f-ae2b87fd7fd5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:47.424423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:47.428794 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec740e82-93c3-4c94-bf4c-62c9c7f32ed7 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:47.445014 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 370/753] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:24:46 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:24:47.445014 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc8311-c211-4f70-8a6f-ae2b87fd7fd5 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:47.482566 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0e1ca-8853-42d5-b917-01e00320595a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:47.483620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0e1ca-8853-42d5-b917-01e00320595a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:47.484053 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0e1ca-8853-42d5-b917-01e00320595a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:47.484476 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0e1ca-8853-42d5-b917-01e00320595a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:47.492524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0e1ca-8853-42d5-b917-01e00320595a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:47.494274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0e1ca-8853-42d5-b917-01e00320595a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:47.509415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-abc0e1ca-8853-42d5-b917-01e00320595a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:47.509415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:47.509415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:47.509415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:47.509415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:47.509415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:47.509415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:47.509415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:47.509415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:47.509415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:47.509415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:47.509415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:47.509415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:47.509415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:47.509415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:47.510548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:47.510548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:47.510548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:47.510548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:47.510548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:47.510548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:47.510548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:47.510548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:47.510548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:47.510548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:47.510548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:47.510548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:47.510548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:47.510548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:47.510548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:47.510548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:47.510548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:47.511445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:47.511445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:47.511445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:47.511445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:47.511445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:47.511445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:47.511445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:47.511445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:47.513953 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 384/754] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:47.514971 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0e1ca-8853-42d5-b917-01e00320595a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:47.553509 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:47.581577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc8311-c211-4f70-8a6f-ae2b87fd7fd5 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:47.632607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dd10b-b27e-4ddc-976d-22967299d2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:47.633861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dd10b-b27e-4ddc-976d-22967299d2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:47.634246 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dd10b-b27e-4ddc-976d-22967299d2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:47.635173 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dd10b-b27e-4ddc-976d-22967299d2a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:47.646317 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0e1ca-8853-42d5-b917-01e00320595a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:47.650753 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23dd10b-b27e-4ddc-976d-22967299d2a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:47.652225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23dd10b-b27e-4ddc-976d-22967299d2a2 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:47.677430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-c23dd10b-b27e-4ddc-976d-22967299d2a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:47.677430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:47.677430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:47.677430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:47.677430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:47.677430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:47.677430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:47.677430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:47.677430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:47.677430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:47.677430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:47.677430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:47.677430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:47.677430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:47.677430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:47.678965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:47.678965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:47.678965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:47.678965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:47.678965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:47.678965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:47.678965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:47.678965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:47.678965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:47.678965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:47.678965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:47.678965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:47.678965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:47.678965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:47.678965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:47.678965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:47.678965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:47.679861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:47.679861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:47.679861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:47.679861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:47.683198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 371/755] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:47.685222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dd10b-b27e-4ddc-976d-22967299d2a2 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:47.689666 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bac948-852c-4fb6-9f46-c4db190a020c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:47.690588 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bac948-852c-4fb6-9f46-c4db190a020c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:47.690873 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bac948-852c-4fb6-9f46-c4db190a020c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:47.691175 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bac948-852c-4fb6-9f46-c4db190a020c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:47.703266 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bac948-852c-4fb6-9f46-c4db190a020c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:47.705353 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bac948-852c-4fb6-9f46-c4db190a020c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:47.724818 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-d5bac948-852c-4fb6-9f46-c4db190a020c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:47.724818 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:47.724818 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:47.724818 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:47.724818 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:47.724818 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:47.724818 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:47.724818 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:47.724818 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:47.724818 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:47.724818 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:47.724818 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:47.724818 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:47.724818 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:47.724818 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:47.725824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:47.725824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:47.725824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:47.725824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:47.725824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:47.725824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:47.725824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:47.725824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:47.725824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:47.725824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:47.725824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:47.725824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:47.725824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:47.725824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:47.725824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:47.725824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:47.725824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:47.726750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:47.726750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:47.726750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:47.726750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:47.730505 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 385/756] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:47.731287 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bac948-852c-4fb6-9f46-c4db190a020c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:47.756769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:47.820408 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dd10b-b27e-4ddc-976d-22967299d2a2 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:47.863255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d2bbe-2462-49bf-b170-ba9e33660132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:47.864390 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d2bbe-2462-49bf-b170-ba9e33660132 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:47.864886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d2bbe-2462-49bf-b170-ba9e33660132 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:47.865375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d2bbe-2462-49bf-b170-ba9e33660132 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:47.866435 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d2bbe-2462-49bf-b170-ba9e33660132 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:47.866991 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d2bbe-2462-49bf-b170-ba9e33660132 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:47.868708 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d2bbe-2462-49bf-b170-ba9e33660132 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:47.883512 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 372/757] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:24:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:47.884865 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d2bbe-2462-49bf-b170-ba9e33660132 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:47.940792 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:47.960957 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bac948-852c-4fb6-9f46-c4db190a020c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:47.998018 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46dd0bf-5b3f-457f-98d9-bcaa0caf0851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:47.998955 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dd0bf-5b3f-457f-98d9-bcaa0caf0851 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:47.999076 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dd0bf-5b3f-457f-98d9-bcaa0caf0851 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:47.999305 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dd0bf-5b3f-457f-98d9-bcaa0caf0851 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:48.000961 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46dd0bf-5b3f-457f-98d9-bcaa0caf0851 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:48.001367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46dd0bf-5b3f-457f-98d9-bcaa0caf0851 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:48.002715 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46dd0bf-5b3f-457f-98d9-bcaa0caf0851 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:48.007278 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d2bbe-2462-49bf-b170-ba9e33660132 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:48.010206 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:48.015964 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 386/758] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:48.017001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46dd0bf-5b3f-457f-98d9-bcaa0caf0851 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:48.050184 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce411ce4-cd47-4384-9861-95952d8db706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:48.051334 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce411ce4-cd47-4384-9861-95952d8db706 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:48.051881 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce411ce4-cd47-4384-9861-95952d8db706 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:48.052369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce411ce4-cd47-4384-9861-95952d8db706 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:48.053360 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce411ce4-cd47-4384-9861-95952d8db706 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:48.053892 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce411ce4-cd47-4384-9861-95952d8db706 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:48.055808 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce411ce4-cd47-4384-9861-95952d8db706 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:48.070699 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 373/759] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:48.071998 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce411ce4-cd47-4384-9861-95952d8db706 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:48.130541 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46dd0bf-5b3f-457f-98d9-bcaa0caf0851 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:48.166234 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f829f-ca31-4b79-acb4-e9ebfff7ab84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:48.167013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f829f-ca31-4b79-acb4-e9ebfff7ab84 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:48.167202 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f829f-ca31-4b79-acb4-e9ebfff7ab84 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:48.167438 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f829f-ca31-4b79-acb4-e9ebfff7ab84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:48.168331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f829f-ca31-4b79-acb4-e9ebfff7ab84 None admin] RBAC: Adding query filter params (role.id=87f040877bfa47bda56305eb022af09e, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=edbbc94ca71c42c0aac562c8c2ec83db) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:48.168644 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f829f-ca31-4b79-acb4-e9ebfff7ab84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:48.170130 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f829f-ca31-4b79-acb4-e9ebfff7ab84 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:48.177035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 387/760] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:24:48 2022] GET /identity/v3/role_assignments?user.id=edbbc94ca71c42c0aac562c8c2ec83db&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=87f040877bfa47bda56305eb022af09e => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:48.177926 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f829f-ca31-4b79-acb4-e9ebfff7ab84 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:48.186060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce411ce4-cd47-4384-9861-95952d8db706 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:48.187045 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:48.226484 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91eba1-6cf8-4b15-a037-606df18459c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:48.227714 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91eba1-6cf8-4b15-a037-606df18459c6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:48.228237 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91eba1-6cf8-4b15-a037-606df18459c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:48.228754 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91eba1-6cf8-4b15-a037-606df18459c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:48.237663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91eba1-6cf8-4b15-a037-606df18459c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:48.239504 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91eba1-6cf8-4b15-a037-606df18459c6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:48.254924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-1c91eba1-6cf8-4b15-a037-606df18459c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:48.254924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:48.254924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:48.254924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:48.254924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:48.254924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:48.254924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:48.254924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:48.254924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:48.254924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:48.254924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:48.254924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:48.254924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:48.254924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:48.254924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:48.255904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:48.255904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:48.255904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:48.255904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:48.255904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:48.255904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:48.255904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:48.255904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:48.255904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:48.255904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:48.255904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:48.255904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:48.255904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:48.255904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:48.255904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:48.255904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:48.255904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:48.256806 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:48.256806 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:48.256806 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:48.256806 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:48.256806 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:48.256806 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:48.256806 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:48.256806 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:48.259453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 374/761] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:48.271162 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91eba1-6cf8-4b15-a037-606df18459c6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:48.291994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f829f-ca31-4b79-acb4-e9ebfff7ab84 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:48.312048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:48.336316 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a155af-f548-456f-ae97-13c47f8e6f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:48.337131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a155af-f548-456f-ae97-13c47f8e6f00 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:48.337413 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a155af-f548-456f-ae97-13c47f8e6f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:48.337689 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a155af-f548-456f-ae97-13c47f8e6f00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:48.351978 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a155af-f548-456f-ae97-13c47f8e6f00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:48.353447 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a155af-f548-456f-ae97-13c47f8e6f00 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:48.380691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-a7a155af-f548-456f-ae97-13c47f8e6f00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:48.380691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:48.380691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:48.380691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:48.380691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:48.380691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:48.380691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:48.380691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:48.380691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:48.380691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:48.380691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:48.380691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:48.380691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:48.380691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:48.380691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:48.381678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:48.381678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:48.381678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:48.381678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:48.381678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:48.381678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:48.381678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:48.381678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:48.381678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:48.381678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:48.381678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:48.381678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:48.381678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:48.381678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:48.381678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:48.381678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:48.381678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:48.382689 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:48.382689 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:48.382689 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:48.382689 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:48.382689 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:48.382689 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:48.382689 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:48.382689 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:48.383136 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 388/762] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:48.388907 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a155af-f548-456f-ae97-13c47f8e6f00 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:48.477582 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91eba1-6cf8-4b15-a037-606df18459c6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:48.479958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:48.516649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86845a4c-e6a3-4bd4-b1b0-e814a92a8726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:48.517216 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86845a4c-e6a3-4bd4-b1b0-e814a92a8726 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:48.517819 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86845a4c-e6a3-4bd4-b1b0-e814a92a8726 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:48.517819 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86845a4c-e6a3-4bd4-b1b0-e814a92a8726 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:48.518559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86845a4c-e6a3-4bd4-b1b0-e814a92a8726 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:48.518870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86845a4c-e6a3-4bd4-b1b0-e814a92a8726 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:48.520314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86845a4c-e6a3-4bd4-b1b0-e814a92a8726 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:48.538121 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 375/763] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:24:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:48.538121 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d1d70-a4d0-4b79-9324-92f269b7216c None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:48.538121 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d1d70-a4d0-4b79-9324-92f269b7216c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:48.538121 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d1d70-a4d0-4b79-9324-92f269b7216c None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:48.538121 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 376/764] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:48.538676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a155af-f548-456f-ae97-13c47f8e6f00 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:48.542663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ed946-f446-493f-9430-67197fa742b3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:48.543127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ed946-f446-493f-9430-67197fa742b3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:48.543550 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ed946-f446-493f-9430-67197fa742b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:48.570150 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f72ed946-f446-493f-9430-67197fa742b3 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:48.572098 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f72ed946-f446-493f-9430-67197fa742b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:48.579651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d650112-0928-4f45-9a37-c66c61361e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:48.580716 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d650112-0928-4f45-9a37-c66c61361e23 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:48.581212 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d650112-0928-4f45-9a37-c66c61361e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:48.581673 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d650112-0928-4f45-9a37-c66c61361e23 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:48.582701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d650112-0928-4f45-9a37-c66c61361e23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:48.583216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d650112-0928-4f45-9a37-c66c61361e23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:48.584840 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d650112-0928-4f45-9a37-c66c61361e23 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:48.599189 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 389/765] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:24:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:48.605040 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d650112-0928-4f45-9a37-c66c61361e23 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:48.682189 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 377/766] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Jul 14 15:24:48.683376 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ed946-f446-493f-9430-67197fa742b3 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:48.716759 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:48.738060 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d650112-0928-4f45-9a37-c66c61361e23 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:48.768476 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:48.780087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db299dc-d0b8-485c-b7a6-128daac7d47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:48.781519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db299dc-d0b8-485c-b7a6-128daac7d47f None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:48.782944 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db299dc-d0b8-485c-b7a6-128daac7d47f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:48.783413 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db299dc-d0b8-485c-b7a6-128daac7d47f None admin] PATH_INFO: `/v3/projects/ba19b660ef1442289fb322231ce26f07/users/64f6b597a47c4a0eb08d1eabc4c0305c/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:48.785977 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db299dc-d0b8-485c-b7a6-128daac7d47f None admin] RBAC: Authorizing `identity:create_grant(project_id=ba19b660ef1442289fb322231ce26f07, user_id=64f6b597a47c4a0eb08d1eabc4c0305c, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:48.787825 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db299dc-d0b8-485c-b7a6-128daac7d47f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:48.825477 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 390/767] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:24:48 2022] PUT /identity/v3/projects/ba19b660ef1442289fb322231ce26f07/users/64f6b597a47c4a0eb08d1eabc4c0305c/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:48.826540 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db299dc-d0b8-485c-b7a6-128daac7d47f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:48.894569 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ed946-f446-493f-9430-67197fa742b3 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:48.965352 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db299dc-d0b8-485c-b7a6-128daac7d47f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:49.015817 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7185c-ecb6-4ee4-ae80-dda53cfbd828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:49.017920 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7185c-ecb6-4ee4-ae80-dda53cfbd828 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:49.018250 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7185c-ecb6-4ee4-ae80-dda53cfbd828 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:49.018698 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7185c-ecb6-4ee4-ae80-dda53cfbd828 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:49.019613 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7185c-ecb6-4ee4-ae80-dda53cfbd828 None admin] RBAC: Adding query filter params (role.id=1d73a20858554285862ec7d933eb6149, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=8103402ac83c4b4191a3ec4d55038e1b) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:49.019936 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7185c-ecb6-4ee4-ae80-dda53cfbd828 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:49.021409 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7185c-ecb6-4ee4-ae80-dda53cfbd828 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:49.027573 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2bc15-6589-42a4-878c-1d9793028670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:49.028611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2bc15-6589-42a4-878c-1d9793028670 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:49.029017 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2bc15-6589-42a4-878c-1d9793028670 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:49.029304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2bc15-6589-42a4-878c-1d9793028670 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:49.029992 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2bc15-6589-42a4-878c-1d9793028670 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:49.031444 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2bc15-6589-42a4-878c-1d9793028670 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:49.046483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-f8a2bc15-6589-42a4-878c-1d9793028670 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:24:49.046483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:49.046483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:49.046483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:49.046483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:49.046483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:49.046483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:49.046483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:49.046483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:24:49.046483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:49.046483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:49.046483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:49.046483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:49.046483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:49.046483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:49.046483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:49.048279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:49.048279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:49.048279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:49.048279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:49.048279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:49.048279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:49.048279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:49.048279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:49.048279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:49.048279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:49.048279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:49.048279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:49.048279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:49.048279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:49.048279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:49.048279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:49.049697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:49.049697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:49.049697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:49.049697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:49.049697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:49.049697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:49.049697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:49.049697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:49.049697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:49.049697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:49.049697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:49.049697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:49.049697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:49.049697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:24:49.049697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:49.049697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 391/768] 10.222.0.39 () {56 vars in 1129 bytes} [Thu Jul 14 15:24:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:49.054142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 378/769] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:24:48 2022] GET /identity/v3/role_assignments?user.id=8103402ac83c4b4191a3ec4d55038e1b&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=1d73a20858554285862ec7d933eb6149 => generated 259 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:49.055477 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2bc15-6589-42a4-878c-1d9793028670 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:49.069532 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05fd49-8c6b-4a0f-83ed-cea01dd9a564 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:49.069873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05fd49-8c6b-4a0f-83ed-cea01dd9a564 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:49.070056 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05fd49-8c6b-4a0f-83ed-cea01dd9a564 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:49.071791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 379/770] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:49.077902 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab36c3-a7be-4295-8da1-cc10224303b0 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:49.078291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab36c3-a7be-4295-8da1-cc10224303b0 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:49.079377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab36c3-a7be-4295-8da1-cc10224303b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:49.107198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e2ab36c3-a7be-4295-8da1-cc10224303b0 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:49.108291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e2ab36c3-a7be-4295-8da1-cc10224303b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:49.154678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:49.200161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 380/771] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:49.226728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab36c3-a7be-4295-8da1-cc10224303b0 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:49.250676 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:49.298500 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2bc15-6589-42a4-878c-1d9793028670 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:49.351938 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac3025-aa77-4b86-991a-0fc456760753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:49.352683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac3025-aa77-4b86-991a-0fc456760753 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:49.352975 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac3025-aa77-4b86-991a-0fc456760753 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:49.353248 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac3025-aa77-4b86-991a-0fc456760753 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:49.353966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac3025-aa77-4b86-991a-0fc456760753 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:49.354296 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac3025-aa77-4b86-991a-0fc456760753 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:49.355686 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac3025-aa77-4b86-991a-0fc456760753 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:49.370408 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 392/772] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jul 14 15:24:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:49.379433 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac3025-aa77-4b86-991a-0fc456760753 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:49.431742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab36c3-a7be-4295-8da1-cc10224303b0 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:49.511984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0602a3c-da62-432c-be31-b51737bcbae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:49.512805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0602a3c-da62-432c-be31-b51737bcbae9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:49.513097 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0602a3c-da62-432c-be31-b51737bcbae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:49.513367 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0602a3c-da62-432c-be31-b51737bcbae9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:49.514033 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0602a3c-da62-432c-be31-b51737bcbae9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:49.515990 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0602a3c-da62-432c-be31-b51737bcbae9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:49.528828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-a0602a3c-da62-432c-be31-b51737bcbae9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:24:49.528828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:49.528828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:49.528828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:49.528828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:49.528828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:49.528828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:49.528828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:49.528828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:24:49.528828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:49.528828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:49.528828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:49.528828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:49.528828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:49.528828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:49.528828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:49.528828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:49.529903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:49.529903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:49.529903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:49.529903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:49.529903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:49.529903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:49.529903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:49.529903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:49.529903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:49.529903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:49.529903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:49.529903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:49.529903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:49.529903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:49.529903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:49.529903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:49.531336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:49.531336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:49.531336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:49.531336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:49.531336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:49.531336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:49.531336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:49.531336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:49.531336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:49.531336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:49.531336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:49.531336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:49.531336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:24:49.531336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:49.531336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 381/773] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:49 2022] GET /identity/v3/services/network => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:49.539147 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0602a3c-da62-432c-be31-b51737bcbae9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:49.577835 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac3025-aa77-4b86-991a-0fc456760753 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:49.596833 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:49.649499 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8be98-adba-42f1-9905-88f150f5c844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:49.650263 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8be98-adba-42f1-9905-88f150f5c844 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:49.650543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8be98-adba-42f1-9905-88f150f5c844 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:49.650816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8be98-adba-42f1-9905-88f150f5c844 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:49.651534 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8be98-adba-42f1-9905-88f150f5c844 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:49.651842 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8be98-adba-42f1-9905-88f150f5c844 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:49.653289 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8be98-adba-42f1-9905-88f150f5c844 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:49.657414 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:49.663308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 393/774] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jul 14 15:24:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:49.669052 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8be98-adba-42f1-9905-88f150f5c844 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:49.689999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0602a3c-da62-432c-be31-b51737bcbae9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:49.747502 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1828ce-3b97-4c54-90b4-71c9f7a46198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:49.748177 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1828ce-3b97-4c54-90b4-71c9f7a46198 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:49.748459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1828ce-3b97-4c54-90b4-71c9f7a46198 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:49.748733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1828ce-3b97-4c54-90b4-71c9f7a46198 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:49.749451 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1828ce-3b97-4c54-90b4-71c9f7a46198 None admin] RBAC: Adding query filter params (name=network) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:49.749737 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1828ce-3b97-4c54-90b4-71c9f7a46198 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:49.751433 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1828ce-3b97-4c54-90b4-71c9f7a46198 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:49.760408 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 382/775] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jul 14 15:24:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:49.765147 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1828ce-3b97-4c54-90b4-71c9f7a46198 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:49.888809 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1828ce-3b97-4c54-90b4-71c9f7a46198 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:49.940172 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0d335-8ec3-4eb9-9505-2104c30b3db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:49.940172 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0d335-8ec3-4eb9-9505-2104c30b3db9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:49.940172 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0d335-8ec3-4eb9-9505-2104c30b3db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:49.940172 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0d335-8ec3-4eb9-9505-2104c30b3db9 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:49.940576 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0d335-8ec3-4eb9-9505-2104c30b3db9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:49.940576 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0d335-8ec3-4eb9-9505-2104c30b3db9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:49.940576 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0d335-8ec3-4eb9-9505-2104c30b3db9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:49.944922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:49.944922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 383/776] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jul 14 15:24:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:49.950344 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0d335-8ec3-4eb9-9505-2104c30b3db9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:49.968174 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8be98-adba-42f1-9905-88f150f5c844 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:50.082303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0d335-8ec3-4eb9-9505-2104c30b3db9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:50.087966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe553b-ae10-4fe5-bc08-a7526622a821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:50.089010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe553b-ae10-4fe5-bc08-a7526622a821 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:50.089465 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe553b-ae10-4fe5-bc08-a7526622a821 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:50.089915 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe553b-ae10-4fe5-bc08-a7526622a821 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:50.091411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe553b-ae10-4fe5-bc08-a7526622a821 None admin] RBAC: Adding query filter params (interface=public, service_id=30483e5ef94d4881afcbfa30324eecb8, region_id=RegionOne) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:50.091916 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe553b-ae10-4fe5-bc08-a7526622a821 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:50.094887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe553b-ae10-4fe5-bc08-a7526622a821 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:50.130939 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 394/777] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jul 14 15:24:49 2022] GET /identity/v3/endpoints?service_id=30483e5ef94d4881afcbfa30324eecb8&interface=public®ion_id=RegionOne => generated 194 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:50.134219 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe553b-ae10-4fe5-bc08-a7526622a821 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:50.200260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fb463-3a16-467b-8eaf-c1ebcb2f483a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:50.200851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fb463-3a16-467b-8eaf-c1ebcb2f483a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:50.201137 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fb463-3a16-467b-8eaf-c1ebcb2f483a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:50.201416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fb463-3a16-467b-8eaf-c1ebcb2f483a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:50.202249 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fb463-3a16-467b-8eaf-c1ebcb2f483a None admin] RBAC: Adding query filter params (interface=public, service_id=f589ce8db9b24e41932991de8be88638, region_id=RegionOne) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:50.202569 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fb463-3a16-467b-8eaf-c1ebcb2f483a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:50.204256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fb463-3a16-467b-8eaf-c1ebcb2f483a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:50.224406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 384/778] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jul 14 15:24:49 2022] GET /identity/v3/endpoints?service_id=f589ce8db9b24e41932991de8be88638&interface=public®ion_id=RegionOne => generated 194 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:50.229782 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fb463-3a16-467b-8eaf-c1ebcb2f483a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:50.236396 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:50.358019 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe553b-ae10-4fe5-bc08-a7526622a821 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:50.430099 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:50.433569 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def96d04-b701-4662-b94a-e5f8fbe69989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:50.434728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def96d04-b701-4662-b94a-e5f8fbe69989 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:50.435184 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def96d04-b701-4662-b94a-e5f8fbe69989 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:50.435654 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def96d04-b701-4662-b94a-e5f8fbe69989 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:50.437108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def96d04-b701-4662-b94a-e5f8fbe69989 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:50.439764 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def96d04-b701-4662-b94a-e5f8fbe69989 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:50.450225 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 395/779] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jul 14 15:24:50 2022] GET /identity/v3/services => generated 772 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:50.507146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fb463-3a16-467b-8eaf-c1ebcb2f483a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:50.548667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85458b54-3175-4b47-851e-05fb232f6e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:50.550012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85458b54-3175-4b47-851e-05fb232f6e2b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:50.550555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85458b54-3175-4b47-851e-05fb232f6e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:50.551050 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85458b54-3175-4b47-851e-05fb232f6e2b None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:50.551981 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85458b54-3175-4b47-851e-05fb232f6e2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:50.553632 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85458b54-3175-4b47-851e-05fb232f6e2b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:50.560425 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 385/780] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jul 14 15:24:50 2022] GET /identity/v3/services => generated 772 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:50.888494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e63f8-54df-4153-9338-f177565533ff None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:50.889225 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e63f8-54df-4153-9338-f177565533ff None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:50.889750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e63f8-54df-4153-9338-f177565533ff None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:50.892054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 396/781] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:50.900073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889336df-9a4a-4a88-944c-33a04433f61e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:50.900715 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889336df-9a4a-4a88-944c-33a04433f61e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:50.901219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889336df-9a4a-4a88-944c-33a04433f61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:50.922483 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-889336df-9a4a-4a88-944c-33a04433f61e None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:50.925404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-889336df-9a4a-4a88-944c-33a04433f61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:51.010188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 386/782] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:51.030388 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e63f8-54df-4153-9338-f177565533ff None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:51.207854 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e63f8-54df-4153-9338-f177565533ff None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:51.216432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:51.261636 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e95acb-a985-4d5d-8219-1c025098065f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:51.262507 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e95acb-a985-4d5d-8219-1c025098065f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:51.262939 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e95acb-a985-4d5d-8219-1c025098065f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:51.263225 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e95acb-a985-4d5d-8219-1c025098065f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:51.284615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e95acb-a985-4d5d-8219-1c025098065f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:51.295669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-66e95acb-a985-4d5d-8219-1c025098065f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:51.295669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:51.295669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:51.295669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:51.295669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:51.295669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:51.295669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:51.295669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:51.295669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:51.295669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:51.295669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:51.295669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:51.295669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:51.295669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:51.295669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:51.295669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:51.296713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:51.296713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:51.296713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:51.296713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:51.296713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:51.296713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:51.296713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:51.296713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:51.296713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:51.296713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:51.296713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:51.296713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:51.296713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:51.296713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:51.296713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:51.296713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:51.299217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:51.299217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:51.299217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:51.299217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:51.299217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:51.299217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:51.299217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:51.299217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:51.299217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:51.299217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:51.299217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:51.299217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:51.299217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 397/783] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:24:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:51.307203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889336df-9a4a-4a88-944c-33a04433f61e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:51.385921 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:51.438001 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889336df-9a4a-4a88-944c-33a04433f61e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:51.486232 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131f99b-adcd-40a7-af8b-c2e06cb4b368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:51.487250 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131f99b-adcd-40a7-af8b-c2e06cb4b368 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:51.487704 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131f99b-adcd-40a7-af8b-c2e06cb4b368 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:51.488151 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131f99b-adcd-40a7-af8b-c2e06cb4b368 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:51.489417 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131f99b-adcd-40a7-af8b-c2e06cb4b368 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:51.489921 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131f99b-adcd-40a7-af8b-c2e06cb4b368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:51.492360 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131f99b-adcd-40a7-af8b-c2e06cb4b368 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:51.507935 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 387/784] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:24:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:51.513311 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e95acb-a985-4d5d-8219-1c025098065f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:51.548931 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20e3ba-eb6c-446a-98f8-8a4bd0946352 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:51.549402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20e3ba-eb6c-446a-98f8-8a4bd0946352 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:51.549853 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20e3ba-eb6c-446a-98f8-8a4bd0946352 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:51.552462 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 388/785] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:51.570844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5f97a-37bd-419b-a926-2125c095d073 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:51.571206 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5f97a-37bd-419b-a926-2125c095d073 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:51.571503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5f97a-37bd-419b-a926-2125c095d073 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:51.573353 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 389/786] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:24:51.574657 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccae92-36e6-40d6-a796-6c195f2c3862 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:51.574953 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccae92-36e6-40d6-a796-6c195f2c3862 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:51.575241 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccae92-36e6-40d6-a796-6c195f2c3862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:51.597464 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-89ccae92-36e6-40d6-a796-6c195f2c3862 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:51.599562 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-89ccae92-36e6-40d6-a796-6c195f2c3862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:51.676098 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 390/787] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:51.677676 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe85d95-dfbc-452a-8ff6-93183aac2e8d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:51.678168 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe85d95-dfbc-452a-8ff6-93183aac2e8d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:51.678621 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe85d95-dfbc-452a-8ff6-93183aac2e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:51.684427 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e95acb-a985-4d5d-8219-1c025098065f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:51.711651 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9fe85d95-dfbc-452a-8ff6-93183aac2e8d None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:51.713141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9fe85d95-dfbc-452a-8ff6-93183aac2e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:51.735772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f73abf-627c-4287-9896-5bcd10d6deb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:51.737025 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f73abf-627c-4287-9896-5bcd10d6deb9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:51.737517 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f73abf-627c-4287-9896-5bcd10d6deb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:51.738136 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f73abf-627c-4287-9896-5bcd10d6deb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:51.753004 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f73abf-627c-4287-9896-5bcd10d6deb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:51.754792 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f73abf-627c-4287-9896-5bcd10d6deb9 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:51.777946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-f5f73abf-627c-4287-9896-5bcd10d6deb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:51.777946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:51.777946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:51.777946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:51.777946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:51.777946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:51.777946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:51.777946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:51.777946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:51.777946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:51.777946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:51.777946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:51.777946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:51.777946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:51.777946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:51.778968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:51.778968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:51.778968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:51.778968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:51.778968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:51.778968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:51.778968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:51.778968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:51.778968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:51.778968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:51.778968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:51.778968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:51.778968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:51.778968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:51.778968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:51.778968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:51.778968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:51.779878 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:51.779878 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:51.779878 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:51.779878 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:51.785125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 398/788] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:51.786176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f73abf-627c-4287-9896-5bcd10d6deb9 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:51.794478 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:51.807119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 391/789] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:51.808403 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe85d95-dfbc-452a-8ff6-93183aac2e8d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:51.811109 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:51.938056 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe85d95-dfbc-452a-8ff6-93183aac2e8d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:51.944937 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f73abf-627c-4287-9896-5bcd10d6deb9 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:51.980478 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb62b7-3e6d-42bd-b070-624001cde812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:51.981417 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb62b7-3e6d-42bd-b070-624001cde812 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:51.981714 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb62b7-3e6d-42bd-b070-624001cde812 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:51.981990 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb62b7-3e6d-42bd-b070-624001cde812 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:51.983188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb62b7-3e6d-42bd-b070-624001cde812 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:51.983508 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb62b7-3e6d-42bd-b070-624001cde812 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:51.985874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb62b7-3e6d-42bd-b070-624001cde812 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:51.993024 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf77f3-cdd8-4d9e-9ff6-856a6d0df32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:51.994278 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf77f3-cdd8-4d9e-9ff6-856a6d0df32f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:51.994906 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf77f3-cdd8-4d9e-9ff6-856a6d0df32f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:51.995733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf77f3-cdd8-4d9e-9ff6-856a6d0df32f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:52.002700 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 392/790] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:52.004392 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb62b7-3e6d-42bd-b070-624001cde812 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:52.018715 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf77f3-cdd8-4d9e-9ff6-856a6d0df32f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:52.032786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-0ebf77f3-cdd8-4d9e-9ff6-856a6d0df32f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:52.032786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:52.032786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:52.032786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:52.032786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:52.032786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:52.032786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:52.032786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:52.032786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:52.032786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:52.032786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:52.032786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:52.032786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:52.032786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:52.032786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:52.032786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:52.034484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:52.034484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:52.034484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:52.034484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:52.034484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:52.034484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:52.034484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:52.034484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:52.034484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:52.034484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:52.034484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:52.034484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:52.034484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:52.034484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:52.034484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:52.034484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:52.035354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:52.035354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:52.035354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:52.035354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:52.035354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:52.035354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:52.035354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:52.035354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:52.035354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:52.035354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:52.035354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:52.035354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:52.041471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 399/791] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:24:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:52.041471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf77f3-cdd8-4d9e-9ff6-856a6d0df32f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:52.079842 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:52.150991 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:52.156741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb62b7-3e6d-42bd-b070-624001cde812 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:52.191693 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf77f3-cdd8-4d9e-9ff6-856a6d0df32f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:52.199301 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb445a-619e-4818-b325-46871c6edf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:52.200800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb445a-619e-4818-b325-46871c6edf64 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:52.201276 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb445a-619e-4818-b325-46871c6edf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:52.201834 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb445a-619e-4818-b325-46871c6edf64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:52.215855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb445a-619e-4818-b325-46871c6edf64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:52.228126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-e7bb445a-619e-4818-b325-46871c6edf64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:52.228126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:52.228126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:52.228126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:52.228126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:52.228126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:52.228126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:52.228126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:52.228126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:52.228126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:52.228126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:52.228126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:52.228126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:52.228126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:52.228126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:52.228126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:52.229203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:52.229203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:52.229203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:52.229203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:52.229203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:52.229203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:52.229203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:52.229203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:52.229203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:52.229203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:52.229203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:52.229203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:52.229203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:52.229203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:52.229203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:52.229203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:52.230105 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:52.230105 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:52.230105 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:52.230105 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:52.230105 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:52.230105 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:52.230105 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:52.230105 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:52.230105 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:52.230105 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:52.230105 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:52.230105 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:52.237821 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 393/792] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:24:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:52.237821 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb445a-619e-4818-b325-46871c6edf64 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:52.238168 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1f3b3-8055-47a9-8618-783d3b4e568e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:52.238168 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1f3b3-8055-47a9-8618-783d3b4e568e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:52.238168 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1f3b3-8055-47a9-8618-783d3b4e568e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:52.238168 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1f3b3-8055-47a9-8618-783d3b4e568e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:52.249997 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1f3b3-8055-47a9-8618-783d3b4e568e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:52.251917 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1f3b3-8055-47a9-8618-783d3b4e568e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:52.268233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-75a1f3b3-8055-47a9-8618-783d3b4e568e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:24:52.268233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:52.268233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:52.268233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:52.268233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:52.268233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:52.268233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:52.268233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:52.268233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:52.268233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:52.268233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:52.268233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:52.268233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:52.268233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:52.268233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:52.268233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:52.269531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:52.269531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:52.269531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:52.269531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:52.269531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:52.269531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:52.269531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:52.269531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:52.269531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:52.269531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:52.269531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:52.269531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:52.269531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:52.269531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:52.269531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:52.269531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:52.269531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:52.269531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:52.270769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:52.270769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:52.270769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:52.270769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:52.270769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:52.270769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:52.270769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:52.270769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:52.270769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:24:52.270769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:52.273246 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 400/793] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:24:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:52.274260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1f3b3-8055-47a9-8618-783d3b4e568e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:52.377712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:52.382102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb445a-619e-4818-b325-46871c6edf64 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:52.404475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1f3b3-8055-47a9-8618-783d3b4e568e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:52.435373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ab26d-07b1-4732-9541-19b5979cf64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:52.436259 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ab26d-07b1-4732-9541-19b5979cf64e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:52.437010 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ab26d-07b1-4732-9541-19b5979cf64e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:52.437296 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ab26d-07b1-4732-9541-19b5979cf64e None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:52.438769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ab26d-07b1-4732-9541-19b5979cf64e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:52.439196 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ab26d-07b1-4732-9541-19b5979cf64e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:52.440807 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ab26d-07b1-4732-9541-19b5979cf64e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:52.458258 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 394/794] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:24:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:52.459830 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ab26d-07b1-4732-9541-19b5979cf64e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:52.466471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22762a4-393d-454e-a208-1af2d7aa090f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:52.468064 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22762a4-393d-454e-a208-1af2d7aa090f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:52.468751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22762a4-393d-454e-a208-1af2d7aa090f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:52.469265 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22762a4-393d-454e-a208-1af2d7aa090f None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:52.470600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22762a4-393d-454e-a208-1af2d7aa090f None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:52.471108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22762a4-393d-454e-a208-1af2d7aa090f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:52.472876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22762a4-393d-454e-a208-1af2d7aa090f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:52.479049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:52.485490 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 401/795] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jul 14 15:24:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:52.486912 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22762a4-393d-454e-a208-1af2d7aa090f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:52.604682 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ab26d-07b1-4732-9541-19b5979cf64e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:52.615050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22762a4-393d-454e-a208-1af2d7aa090f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:52.646153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69b64b-bf5b-442e-b80e-bbbfed40ccc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:52.646969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69b64b-bf5b-442e-b80e-bbbfed40ccc1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:52.647327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69b64b-bf5b-442e-b80e-bbbfed40ccc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:52.647874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69b64b-bf5b-442e-b80e-bbbfed40ccc1 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:52.648594 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69b64b-bf5b-442e-b80e-bbbfed40ccc1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:52.648968 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69b64b-bf5b-442e-b80e-bbbfed40ccc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:52.650582 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69b64b-bf5b-442e-b80e-bbbfed40ccc1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:52.657258 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b945740-7063-4d98-b5cd-1b1abc7c8c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:52.658445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b945740-7063-4d98-b5cd-1b1abc7c8c60 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:52.658953 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b945740-7063-4d98-b5cd-1b1abc7c8c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:52.659457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b945740-7063-4d98-b5cd-1b1abc7c8c60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:52.671471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b945740-7063-4d98-b5cd-1b1abc7c8c60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:52.674682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b945740-7063-4d98-b5cd-1b1abc7c8c60 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:52.677177 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 395/796] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jul 14 15:24:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:52.678151 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69b64b-bf5b-442e-b80e-bbbfed40ccc1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:52.697697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-7b945740-7063-4d98-b5cd-1b1abc7c8c60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:52.697697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:52.697697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:52.697697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:52.697697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:52.697697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:52.697697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:52.697697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:52.697697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:52.697697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:52.697697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:52.697697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:52.697697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:52.697697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:52.697697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:52.698741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:52.698741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:52.698741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:52.698741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:52.698741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:52.698741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:52.698741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:52.698741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:52.698741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:52.698741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:52.698741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:52.698741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:52.698741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:52.698741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:52.698741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:52.698741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:52.698741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:52.699643 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:52.699643 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:52.699643 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:52.699643 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:52.700983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:52.703438 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 402/797] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:52.705661 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b945740-7063-4d98-b5cd-1b1abc7c8c60 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:52.772566 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:52.795515 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69b64b-bf5b-442e-b80e-bbbfed40ccc1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:52.831348 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b945740-7063-4d98-b5cd-1b1abc7c8c60 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:52.835093 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb6d55-f130-4fb2-8260-ffbe6a397e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:52.835396 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb6d55-f130-4fb2-8260-ffbe6a397e88 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:52.835619 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb6d55-f130-4fb2-8260-ffbe6a397e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:52.835898 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb6d55-f130-4fb2-8260-ffbe6a397e88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:52.848003 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb6d55-f130-4fb2-8260-ffbe6a397e88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:52.849486 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb6d55-f130-4fb2-8260-ffbe6a397e88 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:52.869485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-dfdb6d55-f130-4fb2-8260-ffbe6a397e88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:52.869485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:52.869485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:52.869485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:52.869485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:52.869485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:52.869485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:52.869485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:52.869485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:52.869485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:52.869485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:52.869485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:52.869485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:52.869485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:52.869485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:52.870469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:52.870469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:52.870469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:52.870469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:52.870469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:52.870469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:52.870469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:52.870469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:52.870469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:52.870469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:52.870469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:52.870469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:52.870469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:52.870469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:52.870469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:52.870469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:52.870469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:52.871391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:52.871391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:52.871391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:52.871391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:52.875708 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 396/798] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:52.876719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb6d55-f130-4fb2-8260-ffbe6a397e88 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:52.879219 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e5bf0-ab4f-4168-bb80-d527be26fc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:52.880394 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e5bf0-ab4f-4168-bb80-d527be26fc56 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:52.881015 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e5bf0-ab4f-4168-bb80-d527be26fc56 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:52.881555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e5bf0-ab4f-4168-bb80-d527be26fc56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:52.896969 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e5bf0-ab4f-4168-bb80-d527be26fc56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:52.899063 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e5bf0-ab4f-4168-bb80-d527be26fc56 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:52.919292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-8e1e5bf0-ab4f-4168-bb80-d527be26fc56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:52.919292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:52.919292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:52.919292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:52.919292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:52.919292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:52.919292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:52.919292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:52.919292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:52.919292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:52.919292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:52.919292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:52.919292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:52.919292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:52.919292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:52.920260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:52.920260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:52.920260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:52.920260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:52.920260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:52.920260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:52.920260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:52.920260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:52.920260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:52.920260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:52.920260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:52.920260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:52.920260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:52.920260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:52.920260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:52.920260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:52.920260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:52.921262 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:52.921262 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:52.921262 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:52.921262 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:52.924660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 403/799] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:52.925791 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e5bf0-ab4f-4168-bb80-d527be26fc56 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:52.962047 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:52.996111 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb6d55-f130-4fb2-8260-ffbe6a397e88 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:53.034213 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3a917-e79d-45c9-9119-d096c16e34d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:53.035008 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3a917-e79d-45c9-9119-d096c16e34d4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:53.035303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3a917-e79d-45c9-9119-d096c16e34d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:53.035584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3a917-e79d-45c9-9119-d096c16e34d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:53.036318 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3a917-e79d-45c9-9119-d096c16e34d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:53.036640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3a917-e79d-45c9-9119-d096c16e34d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:53.038034 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3a917-e79d-45c9-9119-d096c16e34d4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:53.046568 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e5bf0-ab4f-4168-bb80-d527be26fc56 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:53.050366 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:53.054235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 397/800] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:53.055244 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3a917-e79d-45c9-9119-d096c16e34d4 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:53.085660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083ea75-6170-4f85-849b-a2b4b897d877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:53.086455 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083ea75-6170-4f85-849b-a2b4b897d877 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:53.086743 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083ea75-6170-4f85-849b-a2b4b897d877 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:53.087019 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083ea75-6170-4f85-849b-a2b4b897d877 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:53.087735 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083ea75-6170-4f85-849b-a2b4b897d877 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:53.088053 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083ea75-6170-4f85-849b-a2b4b897d877 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:53.089408 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4083ea75-6170-4f85-849b-a2b4b897d877 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:53.101671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 404/801] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:53.103031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff081d94-a6d5-4d88-ac3e-9c515a16d825 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:53.103319 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff081d94-a6d5-4d88-ac3e-9c515a16d825 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:53.103592 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff081d94-a6d5-4d88-ac3e-9c515a16d825 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:53.105001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 405/802] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:53.109524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff081d94-a6d5-4d88-ac3e-9c515a16d825 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:53.182595 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3a917-e79d-45c9-9119-d096c16e34d4 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:53.216178 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:53.223819 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7bc35-644c-464f-848e-e18273234553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:53.224486 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7bc35-644c-464f-848e-e18273234553 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:53.224767 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7bc35-644c-464f-848e-e18273234553 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:53.225038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7bc35-644c-464f-848e-e18273234553 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:53.225854 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7bc35-644c-464f-848e-e18273234553 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:53.226214 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7bc35-644c-464f-848e-e18273234553 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:53.227186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff081d94-a6d5-4d88-ac3e-9c515a16d825 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:53.227572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7bc35-644c-464f-848e-e18273234553 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:53.246588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 398/803] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:53.247962 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7bc35-644c-464f-848e-e18273234553 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:53.269294 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da88a7-d2b0-40ec-9037-9aa6c2898d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:53.270294 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da88a7-d2b0-40ec-9037-9aa6c2898d5d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:53.270649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da88a7-d2b0-40ec-9037-9aa6c2898d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:53.271115 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da88a7-d2b0-40ec-9037-9aa6c2898d5d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:53.278513 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da88a7-d2b0-40ec-9037-9aa6c2898d5d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:53.279950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da88a7-d2b0-40ec-9037-9aa6c2898d5d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:53.295798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-d7da88a7-d2b0-40ec-9037-9aa6c2898d5d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:53.295798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:53.295798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:53.295798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:53.295798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:53.295798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:53.295798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:53.295798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:53.295798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:53.295798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:53.295798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:53.295798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:53.295798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:53.295798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:53.295798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:53.295798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:53.296988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:53.296988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:53.296988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:53.296988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:53.296988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:53.296988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:53.296988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:53.296988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:53.296988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:53.296988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:53.296988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:53.296988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:53.296988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:53.296988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:53.296988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:53.296988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:53.296988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:53.296988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:53.298279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:53.298279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:53.298279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:53.298279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:53.298279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:53.298279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:53.298279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:53.298279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:53.298279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:24:53.298279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:53.298279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 406/804] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jul 14 15:24:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:53.299752 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a6d78-ee74-4143-af6c-93b74eca2ced None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:53.300103 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a6d78-ee74-4143-af6c-93b74eca2ced None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:53.300549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a6d78-ee74-4143-af6c-93b74eca2ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:53.319849 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ef9a6d78-ee74-4143-af6c-93b74eca2ced None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:53.321051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ef9a6d78-ee74-4143-af6c-93b74eca2ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:53.338624 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:53.365976 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7bc35-644c-464f-848e-e18273234553 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:53.397352 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 407/805] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:53.398733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4740826-9022-4830-9fb3-c0e2365dd0ec None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:53.399034 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4740826-9022-4830-9fb3-c0e2365dd0ec None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:53.399314 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4740826-9022-4830-9fb3-c0e2365dd0ec None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:53.400737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 408/806] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:53.401280 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4740826-9022-4830-9fb3-c0e2365dd0ec None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:53.432388 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577347c-9f3b-4a14-be96-c33025c45d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:53.433347 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577347c-9f3b-4a14-be96-c33025c45d57 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:53.433656 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577347c-9f3b-4a14-be96-c33025c45d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:53.433940 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577347c-9f3b-4a14-be96-c33025c45d57 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:53.441785 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577347c-9f3b-4a14-be96-c33025c45d57 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:53.443258 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577347c-9f3b-4a14-be96-c33025c45d57 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:53.459454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-5577347c-9f3b-4a14-be96-c33025c45d57 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:24:53.459454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:53.459454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:53.459454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:53.459454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:53.459454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:53.459454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:53.459454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:53.459454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:53.459454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:53.459454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:53.459454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:53.459454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:53.459454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:53.459454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:53.459454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:53.460618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:53.460618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:53.460618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:53.460618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:53.460618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:53.460618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:53.460618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:53.460618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:53.460618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:53.460618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:53.460618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:53.460618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:53.460618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:53.460618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:53.460618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:53.460618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:53.460618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:53.460618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:53.461567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:53.461567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:53.461567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:53.461567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:53.461567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:53.461567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:53.461567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:53.461567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:53.461567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:24:53.461567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:53.461567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 399/807] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jul 14 15:24:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:53.461567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577347c-9f3b-4a14-be96-c33025c45d57 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:53.513536 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:53.520507 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4740826-9022-4830-9fb3-c0e2365dd0ec None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:53.556521 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f802e9-6aa2-40c4-992b-de303b5f24e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:53.557675 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f802e9-6aa2-40c4-992b-de303b5f24e1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:53.558148 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f802e9-6aa2-40c4-992b-de303b5f24e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:53.558429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f802e9-6aa2-40c4-992b-de303b5f24e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:53.561384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577347c-9f3b-4a14-be96-c33025c45d57 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:53.565313 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f802e9-6aa2-40c4-992b-de303b5f24e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:53.566881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f802e9-6aa2-40c4-992b-de303b5f24e1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:53.581057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-10f802e9-6aa2-40c4-992b-de303b5f24e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:53.581057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:53.581057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:53.581057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:53.581057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:53.581057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:53.581057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:53.581057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:53.581057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:53.581057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:53.581057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:53.581057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:53.581057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:53.581057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:53.581057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:53.582218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:53.582218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:53.582218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:53.582218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:53.582218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:53.582218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:53.582218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:53.582218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:53.582218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:53.582218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:53.582218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:53.582218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:53.582218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:53.582218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:53.582218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:53.582218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:53.582218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:53.583141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:53.583141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:53.583141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:53.583141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:53.583141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:53.583141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:53.583141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:53.583141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:53.583141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 409/808] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:53.583657 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb799c9f-3691-48b9-8135-4c41624964f5 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:53.583735 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb799c9f-3691-48b9-8135-4c41624964f5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:53.583954 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb799c9f-3691-48b9-8135-4c41624964f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:53.598688 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834205a-764e-4388-ac9d-66899c26741c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:53.599364 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834205a-764e-4388-ac9d-66899c26741c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:53.599653 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834205a-764e-4388-ac9d-66899c26741c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:53.599934 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834205a-764e-4388-ac9d-66899c26741c None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:53.600767 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834205a-764e-4388-ac9d-66899c26741c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:53.601003 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-bb799c9f-3691-48b9-8135-4c41624964f5 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:53.601099 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834205a-764e-4388-ac9d-66899c26741c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:53.602480 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-bb799c9f-3691-48b9-8135-4c41624964f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:53.602824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834205a-764e-4388-ac9d-66899c26741c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:53.613714 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:53.623839 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 400/809] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jul 14 15:24:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:53.624706 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834205a-764e-4388-ac9d-66899c26741c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:53.679037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 410/810] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:53.679896 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb799c9f-3691-48b9-8135-4c41624964f5 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:53.754711 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834205a-764e-4388-ac9d-66899c26741c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:53.766110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:53.791605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36097c30-275b-421c-b1ac-51da4f7190ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:53.792409 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36097c30-275b-421c-b1ac-51da4f7190ef None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:53.792694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36097c30-275b-421c-b1ac-51da4f7190ef None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:53.792970 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36097c30-275b-421c-b1ac-51da4f7190ef None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:53.793624 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36097c30-275b-421c-b1ac-51da4f7190ef None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:53.795034 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36097c30-275b-421c-b1ac-51da4f7190ef None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:53.796759 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb799c9f-3691-48b9-8135-4c41624964f5 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:53.808535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-36097c30-275b-421c-b1ac-51da4f7190ef None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:24:53.808535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:53.808535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:53.808535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:53.808535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:53.808535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:53.808535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:53.808535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:53.808535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:24:53.808535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:53.808535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:53.808535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:53.808535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:53.808535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:53.808535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:53.808535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:53.809663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:53.809663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:53.809663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:53.809663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:53.809663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:53.809663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:53.809663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:53.809663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:53.809663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:53.809663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:53.809663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:53.809663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:53.809663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:53.809663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:53.809663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:53.809663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:53.810597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:53.810597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:53.810597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:53.810597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:53.810597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:53.810597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:53.810597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:53.810597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:53.810597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:53.810597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:53.810597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:53.810597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:53.810597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:53.810597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 15:24:53.810597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:53.810597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 401/811] 10.222.0.39 () {56 vars in 1129 bytes} [Thu Jul 14 15:24:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:53.811737 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36097c30-275b-421c-b1ac-51da4f7190ef None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:53.838845 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474d713-a6ca-4e84-b393-6e8dd23581cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:53.839524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474d713-a6ca-4e84-b393-6e8dd23581cd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:53.839810 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474d713-a6ca-4e84-b393-6e8dd23581cd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:53.840089 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474d713-a6ca-4e84-b393-6e8dd23581cd None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:53.840931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474d713-a6ca-4e84-b393-6e8dd23581cd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:53.841248 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474d713-a6ca-4e84-b393-6e8dd23581cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:53.842916 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474d713-a6ca-4e84-b393-6e8dd23581cd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:53.863067 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 411/812] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jul 14 15:24:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:53.863912 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474d713-a6ca-4e84-b393-6e8dd23581cd None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:53.866628 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:53.916099 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36097c30-275b-421c-b1ac-51da4f7190ef None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:53.953356 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ecba6-0a51-41ed-b0cc-38db1b707ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:53.954236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ecba6-0a51-41ed-b0cc-38db1b707ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:53.954533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ecba6-0a51-41ed-b0cc-38db1b707ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:53.954806 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ecba6-0a51-41ed-b0cc-38db1b707ef5 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:53.955610 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ecba6-0a51-41ed-b0cc-38db1b707ef5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:53.955922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ecba6-0a51-41ed-b0cc-38db1b707ef5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:53.957385 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ecba6-0a51-41ed-b0cc-38db1b707ef5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:53.971478 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 402/813] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:24:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:53.972455 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ecba6-0a51-41ed-b0cc-38db1b707ef5 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:53.978593 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474d713-a6ca-4e84-b393-6e8dd23581cd None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:54.013107 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:54.016857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678df852-5231-4c6e-9413-9c1e83f8b8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:54.017634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678df852-5231-4c6e-9413-9c1e83f8b8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:54.017922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678df852-5231-4c6e-9413-9c1e83f8b8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:54.018250 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678df852-5231-4c6e-9413-9c1e83f8b8c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:54.085490 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ecba6-0a51-41ed-b0cc-38db1b707ef5 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:54.091526 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678df852-5231-4c6e-9413-9c1e83f8b8c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:54.092996 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678df852-5231-4c6e-9413-9c1e83f8b8c6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:54.095897 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:54.126674 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49537a3a-fff0-4731-8dd8-2e2ec6926384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:54.127469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49537a3a-fff0-4731-8dd8-2e2ec6926384 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:54.127761 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49537a3a-fff0-4731-8dd8-2e2ec6926384 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:54.128034 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49537a3a-fff0-4731-8dd8-2e2ec6926384 None admin] PATH_INFO: `/v3/services/network` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:54.128689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49537a3a-fff0-4731-8dd8-2e2ec6926384 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:54.130112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49537a3a-fff0-4731-8dd8-2e2ec6926384 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:54.142869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-49537a3a-fff0-4731-8dd8-2e2ec6926384 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:24:54.142869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:54.142869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:54.142869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:54.142869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:54.142869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:54.142869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:54.142869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:54.142869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:24:54.142869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:54.142869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:54.142869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:54.142869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:54.142869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:54.142869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:54.142869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:54.142869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:54.144205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:54.144205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:54.144205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:54.144205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:54.144205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:54.144205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:54.144205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:54.144205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:54.144205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:54.144205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:54.144205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:54.144205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:54.144205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:54.144205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:54.144205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:54.144205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:54.145101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:54.145101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:54.145101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:54.145101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:54.145101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:54.145101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:54.145101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:54.145101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:54.145101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:54.145101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:54.145101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:54.145101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:54.145101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 15:24:54.145101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:54.145101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 403/814] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:53 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:54.145931 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49537a3a-fff0-4731-8dd8-2e2ec6926384 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:54.208992 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 412/815] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:24:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:24:54.209916 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678df852-5231-4c6e-9413-9c1e83f8b8c6 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:54.247169 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:54.251970 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49537a3a-fff0-4731-8dd8-2e2ec6926384 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:54.287138 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2ec71-87a2-4565-9075-87fc7c723bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:54.287711 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2ec71-87a2-4565-9075-87fc7c723bbf None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:54.288000 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2ec71-87a2-4565-9075-87fc7c723bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:54.288278 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2ec71-87a2-4565-9075-87fc7c723bbf None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:54.288984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2ec71-87a2-4565-9075-87fc7c723bbf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:54.289295 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2ec71-87a2-4565-9075-87fc7c723bbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:54.290743 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2ec71-87a2-4565-9075-87fc7c723bbf None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:54.295314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 404/816] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jul 14 15:24:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:54.296084 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2ec71-87a2-4565-9075-87fc7c723bbf None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:54.317168 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678df852-5231-4c6e-9413-9c1e83f8b8c6 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:54.318783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:54.355269 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1715f-6367-4fdc-8edc-e650842e969b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:54.356079 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1715f-6367-4fdc-8edc-e650842e969b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:54.356361 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1715f-6367-4fdc-8edc-e650842e969b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:54.356640 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1715f-6367-4fdc-8edc-e650842e969b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:54.368249 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1715f-6367-4fdc-8edc-e650842e969b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:54.369735 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1715f-6367-4fdc-8edc-e650842e969b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:54.389364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-b3e1715f-6367-4fdc-8edc-e650842e969b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:54.389364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:54.389364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:54.389364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:54.389364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:54.389364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:54.389364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:54.389364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:54.389364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:54.389364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:54.389364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:54.389364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:54.389364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:54.389364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:54.389364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:54.390399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:54.390399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:54.390399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:54.390399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:54.390399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:54.390399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:54.390399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:54.390399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:54.390399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:54.390399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:54.390399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:54.390399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:54.390399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:54.390399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:54.390399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:54.390399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:54.390399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:54.391856 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:54.391856 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:54.391856 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:54.391856 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:54.391856 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 413/817] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:54.392150 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1715f-6367-4fdc-8edc-e650842e969b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:54.405339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2ec71-87a2-4565-9075-87fc7c723bbf None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:54.441463 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e22c4-dedb-41a3-91dc-0bbb26567fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:54.442390 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e22c4-dedb-41a3-91dc-0bbb26567fae None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:54.442675 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e22c4-dedb-41a3-91dc-0bbb26567fae None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:54.442957 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e22c4-dedb-41a3-91dc-0bbb26567fae None admin] PATH_INFO: `/v3/projects/ba19b660ef1442289fb322231ce26f07/users/edbbc94ca71c42c0aac562c8c2ec83db/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:54.444925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e22c4-dedb-41a3-91dc-0bbb26567fae None admin] RBAC: Authorizing `identity:create_grant(project_id=ba19b660ef1442289fb322231ce26f07, user_id=edbbc94ca71c42c0aac562c8c2ec83db, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:54.446406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e22c4-dedb-41a3-91dc-0bbb26567fae None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:54.459881 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 405/818] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:24:54 2022] PUT /identity/v3/projects/ba19b660ef1442289fb322231ce26f07/users/edbbc94ca71c42c0aac562c8c2ec83db/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:24:54.460693 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e22c4-dedb-41a3-91dc-0bbb26567fae None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:54.491395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:54.504177 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1715f-6367-4fdc-8edc-e650842e969b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:54.549096 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e48b20-f4f0-407b-8978-998298292ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:54.549836 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e48b20-f4f0-407b-8978-998298292ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:54.550214 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e48b20-f4f0-407b-8978-998298292ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:54.551499 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e48b20-f4f0-407b-8978-998298292ef7 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:54.553748 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e48b20-f4f0-407b-8978-998298292ef7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:54.555161 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e48b20-f4f0-407b-8978-998298292ef7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:54.556620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e48b20-f4f0-407b-8978-998298292ef7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:54.567713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 414/819] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jul 14 15:24:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:54.567713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e48b20-f4f0-407b-8978-998298292ef7 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:54.587388 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e22c4-dedb-41a3-91dc-0bbb26567fae None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:54.590914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:54.632535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a947a5-cf82-4e4e-b7be-415d27226139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:54.633483 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a947a5-cf82-4e4e-b7be-415d27226139 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:54.633771 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a947a5-cf82-4e4e-b7be-415d27226139 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:54.634191 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a947a5-cf82-4e4e-b7be-415d27226139 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:54.646965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a947a5-cf82-4e4e-b7be-415d27226139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:54.648449 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a947a5-cf82-4e4e-b7be-415d27226139 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:54.668840 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-c8a947a5-cf82-4e4e-b7be-415d27226139 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:54.668840 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:54.668840 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:54.668840 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:54.668840 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:54.668840 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:54.668840 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:54.668840 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:54.668840 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:54.668840 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:54.668840 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:54.668840 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:54.668840 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:54.668840 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:54.668840 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:54.669815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:54.669815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:54.669815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:54.669815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:54.669815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:54.669815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:54.669815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:54.669815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:54.669815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:54.669815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:54.669815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:54.669815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:54.669815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:54.669815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:54.669815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:54.669815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:54.669815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:54.670809 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:54.670809 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:54.670809 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:54.670809 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:54.670809 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 406/820] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:54.671097 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a947a5-cf82-4e4e-b7be-415d27226139 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:54.687037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e48b20-f4f0-407b-8978-998298292ef7 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:54.730147 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94098c4-7a7f-4117-b7e6-7d55f5528352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:54.730825 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94098c4-7a7f-4117-b7e6-7d55f5528352 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:54.731111 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94098c4-7a7f-4117-b7e6-7d55f5528352 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:54.731686 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94098c4-7a7f-4117-b7e6-7d55f5528352 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:54.732218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94098c4-7a7f-4117-b7e6-7d55f5528352 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:54.732523 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94098c4-7a7f-4117-b7e6-7d55f5528352 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:54.733929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94098c4-7a7f-4117-b7e6-7d55f5528352 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:54.744816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 415/821] 10.222.0.39 () {56 vars in 1124 bytes} [Thu Jul 14 15:24:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:54.744816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94098c4-7a7f-4117-b7e6-7d55f5528352 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:54.762633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:54.791517 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a947a5-cf82-4e4e-b7be-415d27226139 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:54.834109 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c096731-896a-40c8-85aa-9beb4f2cfbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:54.834724 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c096731-896a-40c8-85aa-9beb4f2cfbae None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:54.835009 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c096731-896a-40c8-85aa-9beb4f2cfbae None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:54.835361 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c096731-896a-40c8-85aa-9beb4f2cfbae None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:54.836091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c096731-896a-40c8-85aa-9beb4f2cfbae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:54.836400 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c096731-896a-40c8-85aa-9beb4f2cfbae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:54.836688 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:54.837787 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c096731-896a-40c8-85aa-9beb4f2cfbae None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:54.852025 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 407/822] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:54.852866 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c096731-896a-40c8-85aa-9beb4f2cfbae None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:54.863678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94098c4-7a7f-4117-b7e6-7d55f5528352 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:54.898414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9084e9a-4d7a-41a4-9b52-889b46ee55e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:54.899074 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9084e9a-4d7a-41a4-9b52-889b46ee55e9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:54.899356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9084e9a-4d7a-41a4-9b52-889b46ee55e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:54.899630 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9084e9a-4d7a-41a4-9b52-889b46ee55e9 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:54.900331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9084e9a-4d7a-41a4-9b52-889b46ee55e9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:54.900634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9084e9a-4d7a-41a4-9b52-889b46ee55e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:54.902024 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9084e9a-4d7a-41a4-9b52-889b46ee55e9 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:54.911862 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 416/823] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jul 14 15:24:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:54.911862 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9084e9a-4d7a-41a4-9b52-889b46ee55e9 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:54.972290 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c096731-896a-40c8-85aa-9beb4f2cfbae None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:55.012258 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097de350-dd2b-46c4-b93d-d2ac88972811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:55.013398 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097de350-dd2b-46c4-b93d-d2ac88972811 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:55.013690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097de350-dd2b-46c4-b93d-d2ac88972811 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:55.013968 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097de350-dd2b-46c4-b93d-d2ac88972811 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:55.014727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097de350-dd2b-46c4-b93d-d2ac88972811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:55.015040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097de350-dd2b-46c4-b93d-d2ac88972811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:55.017742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097de350-dd2b-46c4-b93d-d2ac88972811 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:55.019676 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:55.023352 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9084e9a-4d7a-41a4-9b52-889b46ee55e9 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:55.038246 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 408/824] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:55.039138 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097de350-dd2b-46c4-b93d-d2ac88972811 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:55.068310 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a4363-679d-418c-91cc-264da58933a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:55.069125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a4363-679d-418c-91cc-264da58933a1 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:55.069470 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a4363-679d-418c-91cc-264da58933a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:55.069820 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a4363-679d-418c-91cc-264da58933a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:55.070677 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a4363-679d-418c-91cc-264da58933a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:55.072120 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a4363-679d-418c-91cc-264da58933a1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:55.093958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 417/825] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jul 14 15:24:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:55.095606 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a4363-679d-418c-91cc-264da58933a1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:55.098681 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:55.195269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097de350-dd2b-46c4-b93d-d2ac88972811 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:55.249930 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a4363-679d-418c-91cc-264da58933a1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:55.274133 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61a671-8b06-44eb-be62-f2fef9e1e325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:55.275290 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61a671-8b06-44eb-be62-f2fef9e1e325 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:55.275760 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61a671-8b06-44eb-be62-f2fef9e1e325 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:55.276233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61a671-8b06-44eb-be62-f2fef9e1e325 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:55.284448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61a671-8b06-44eb-be62-f2fef9e1e325 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:55.286006 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61a671-8b06-44eb-be62-f2fef9e1e325 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:55.299036 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e606aa-d222-46d1-9523-bc1c54f12ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:55.299702 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e606aa-d222-46d1-9523-bc1c54f12ac7 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:55.299988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e606aa-d222-46d1-9523-bc1c54f12ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:55.300266 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e606aa-d222-46d1-9523-bc1c54f12ac7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:55.301006 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e606aa-d222-46d1-9523-bc1c54f12ac7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:55.302422 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e606aa-d222-46d1-9523-bc1c54f12ac7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:55.303790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-be61a671-8b06-44eb-be62-f2fef9e1e325 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:55.303790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:55.303790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:55.303790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:55.303790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:55.303790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:55.303790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:55.303790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:55.303790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:55.303790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:55.303790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:55.303790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:55.303790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:55.303790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:55.303790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:55.304713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:55.304713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:55.304713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:55.304713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:55.304713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:55.304713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:55.304713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:55.304713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:55.304713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:55.304713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:55.304713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:55.304713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:55.304713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:55.304713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:55.304713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:55.304713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:55.304713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:55.305618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:55.305618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:55.305618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:55.305618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:55.305618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:55.305618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:55.305618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:55.305618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:55.305618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 409/826] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:55.306735 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61a671-8b06-44eb-be62-f2fef9e1e325 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:55.329748 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 418/827] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jul 14 15:24:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:24:55.331808 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e606aa-d222-46d1-9523-bc1c54f12ac7 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:55.386170 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:55.431316 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:55.468236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61a671-8b06-44eb-be62-f2fef9e1e325 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:55.501395 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e606aa-d222-46d1-9523-bc1c54f12ac7 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:55.546867 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2fc0a-279f-45d2-b8fb-b071951726d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:55.548929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2fc0a-279f-45d2-b8fb-b071951726d3 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:55.549466 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2fc0a-279f-45d2-b8fb-b071951726d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:55.549946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2fc0a-279f-45d2-b8fb-b071951726d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:55.551046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2fc0a-279f-45d2-b8fb-b071951726d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:55.551577 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2fc0a-279f-45d2-b8fb-b071951726d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:55.553297 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2fc0a-279f-45d2-b8fb-b071951726d3 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:55.574480 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 419/828] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:24:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:55.576842 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2fc0a-279f-45d2-b8fb-b071951726d3 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:55.590088 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2796f-78ab-449a-8b3c-5af6290a46f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:55.591260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2796f-78ab-449a-8b3c-5af6290a46f2 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:55.592263 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2796f-78ab-449a-8b3c-5af6290a46f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:55.592760 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2796f-78ab-449a-8b3c-5af6290a46f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:55.602182 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2796f-78ab-449a-8b3c-5af6290a46f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:55.604225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2796f-78ab-449a-8b3c-5af6290a46f2 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:55.622153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-38b2796f-78ab-449a-8b3c-5af6290a46f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:55.622153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:55.622153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:55.622153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:55.622153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:55.622153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:55.622153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:55.622153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:55.622153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:55.622153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:55.622153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:55.622153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:55.622153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:55.622153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:55.622153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:55.623458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:55.623458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:55.623458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:55.623458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:55.623458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:55.623458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:55.623458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:55.623458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:55.623458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:55.623458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:55.623458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:55.623458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:55.623458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:55.623458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:55.623458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:55.623458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:55.623458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:55.624429 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:55.624429 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:55.624429 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:55.624429 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:55.624429 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:55.624429 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:55.624429 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:55.624429 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:55.627906 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 410/829] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:55.633412 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2796f-78ab-449a-8b3c-5af6290a46f2 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:55.751814 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2fc0a-279f-45d2-b8fb-b071951726d3 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:55.763408 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:55.780924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2796f-78ab-449a-8b3c-5af6290a46f2 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:55.795457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43eebd-944f-4e25-806c-666f8bfe4087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:55.797000 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43eebd-944f-4e25-806c-666f8bfe4087 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:55.798034 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43eebd-944f-4e25-806c-666f8bfe4087 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:55.798580 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43eebd-944f-4e25-806c-666f8bfe4087 None admin] PATH_INFO: `/v3/projects/ba19b660ef1442289fb322231ce26f07/users/8103402ac83c4b4191a3ec4d55038e1b/roles/1d73a20858554285862ec7d933eb6149` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:55.800169 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:55.821243 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43eebd-944f-4e25-806c-666f8bfe4087 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba19b660ef1442289fb322231ce26f07, user_id=8103402ac83c4b4191a3ec4d55038e1b, role_id=1d73a20858554285862ec7d933eb6149)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:55.825293 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43eebd-944f-4e25-806c-666f8bfe4087 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:55.830434 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3bb83-28b3-4492-8d24-1966b6902bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:55.831442 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3bb83-28b3-4492-8d24-1966b6902bcd None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:55.831955 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3bb83-28b3-4492-8d24-1966b6902bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:55.832385 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3bb83-28b3-4492-8d24-1966b6902bcd None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:55.833361 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3bb83-28b3-4492-8d24-1966b6902bcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:55.833661 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3bb83-28b3-4492-8d24-1966b6902bcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:55.835307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3bb83-28b3-4492-8d24-1966b6902bcd None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:55.850792 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 420/830] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:24:55 2022] PUT /identity/v3/projects/ba19b660ef1442289fb322231ce26f07/users/8103402ac83c4b4191a3ec4d55038e1b/roles/1d73a20858554285862ec7d933eb6149 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:24:55.856958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 411/831] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:24:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:55.867284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43eebd-944f-4e25-806c-666f8bfe4087 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:55.993787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43eebd-944f-4e25-806c-666f8bfe4087 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:56.035480 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce97520-a8c4-434d-bad8-285c434298e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:56.035480 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce97520-a8c4-434d-bad8-285c434298e7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:56.035742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce97520-a8c4-434d-bad8-285c434298e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:56.035996 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce97520-a8c4-434d-bad8-285c434298e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:56.036783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce97520-a8c4-434d-bad8-285c434298e7 None admin] RBAC: Adding query filter params (role.id=87f040877bfa47bda56305eb022af09e, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=64f6b597a47c4a0eb08d1eabc4c0305c) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:56.037099 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce97520-a8c4-434d-bad8-285c434298e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:56.038635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce97520-a8c4-434d-bad8-285c434298e7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:56.046691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 421/832] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:24:55 2022] GET /identity/v3/role_assignments?user.id=64f6b597a47c4a0eb08d1eabc4c0305c&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=87f040877bfa47bda56305eb022af09e => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:56.822376 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd11f17-42fe-424a-88b9-5e6cd2046837 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:56.822926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd11f17-42fe-424a-88b9-5e6cd2046837 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:56.822926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd11f17-42fe-424a-88b9-5e6cd2046837 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:56.824641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 412/833] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:56.831030 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a5689-da92-46d2-bcde-49ec5a4dc6de None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:56.831562 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a5689-da92-46d2-bcde-49ec5a4dc6de None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:56.831562 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a5689-da92-46d2-bcde-49ec5a4dc6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:56.850313 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-760a5689-da92-46d2-bcde-49ec5a4dc6de None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:56.851896 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-760a5689-da92-46d2-bcde-49ec5a4dc6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:56.871681 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:56.935018 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 422/834] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:56.960346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd11f17-42fe-424a-88b9-5e6cd2046837 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:57.085564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd11f17-42fe-424a-88b9-5e6cd2046837 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:57.130088 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84672424-c5dd-4003-a618-b075fd49342b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:57.131178 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84672424-c5dd-4003-a618-b075fd49342b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:57.131634 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84672424-c5dd-4003-a618-b075fd49342b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:57.132053 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84672424-c5dd-4003-a618-b075fd49342b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:57.144849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84672424-c5dd-4003-a618-b075fd49342b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:57.152967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-84672424-c5dd-4003-a618-b075fd49342b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:57.152967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:57.152967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:57.152967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:57.152967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:57.152967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:57.152967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:57.152967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:57.152967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:57.152967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:57.152967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:57.152967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:57.152967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:57.152967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:57.152967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:57.152967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:57.154164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:57.154164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:57.154164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:57.154164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:57.154164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:57.154164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:57.154164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:57.154164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:57.154164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:57.154164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:57.154164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:57.154164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:57.154164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:57.154164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:57.154164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:57.154164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:57.155332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:57.155332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:57.155332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:57.155332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:57.155332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:57.155332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:57.155332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:57.155332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:57.155332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:57.155332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:57.155332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:24:57.155332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:57.157949 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 413/835] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:24:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:57.163913 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a5689-da92-46d2-bcde-49ec5a4dc6de None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:57.276163 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a5689-da92-46d2-bcde-49ec5a4dc6de None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:57.316367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f650e2-9b70-4228-a585-7a7d21831884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:57.317049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f650e2-9b70-4228-a585-7a7d21831884 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:57.317336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f650e2-9b70-4228-a585-7a7d21831884 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:57.317615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f650e2-9b70-4228-a585-7a7d21831884 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:57.318473 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f650e2-9b70-4228-a585-7a7d21831884 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:57.318788 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f650e2-9b70-4228-a585-7a7d21831884 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:57.320246 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f650e2-9b70-4228-a585-7a7d21831884 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:57.330841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 423/836] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:24:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:57.336386 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84672424-c5dd-4003-a618-b075fd49342b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:57.374373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:57.459547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84672424-c5dd-4003-a618-b075fd49342b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:57.476374 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361caa7-9779-497f-9a4d-b7d54ea5343a None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:57.476670 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361caa7-9779-497f-9a4d-b7d54ea5343a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:57.476991 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361caa7-9779-497f-9a4d-b7d54ea5343a None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:57.478557 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 424/837] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:57.483802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9215e-a2ef-4b9a-a0df-00889d4f3907 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:57.484122 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9215e-a2ef-4b9a-a0df-00889d4f3907 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:57.484446 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9215e-a2ef-4b9a-a0df-00889d4f3907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:57.502811 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c71764-3dca-4c51-84e8-a522dee112b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:57.503790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c71764-3dca-4c51-84e8-a522dee112b9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:57.504134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c71764-3dca-4c51-84e8-a522dee112b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:57.504489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c71764-3dca-4c51-84e8-a522dee112b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:57.510336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-dda9215e-a2ef-4b9a-a0df-00889d4f3907 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:57.512160 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dda9215e-a2ef-4b9a-a0df-00889d4f3907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:57.517472 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c71764-3dca-4c51-84e8-a522dee112b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:57.519168 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c71764-3dca-4c51-84e8-a522dee112b9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:57.525000 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:57.543926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-48c71764-3dca-4c51-84e8-a522dee112b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:57.543926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:57.543926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:57.543926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:57.543926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:57.543926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:57.543926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:57.543926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:57.543926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:57.543926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:57.543926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:57.543926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:57.543926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:57.543926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:57.543926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:57.544925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:57.544925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:57.544925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:57.544925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:57.544925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:57.544925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:57.544925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:57.544925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:57.544925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:57.544925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:57.544925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:57.544925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:57.544925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:57.544925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:57.544925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:57.544925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:57.544925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:57.545846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:57.545846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:57.545846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:57.545846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:57.545846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 414/838] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:57.552437 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c71764-3dca-4c51-84e8-a522dee112b9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:57.614835 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 425/839] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:24:57.636169 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9215e-a2ef-4b9a-a0df-00889d4f3907 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:57.670520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:57.693034 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c71764-3dca-4c51-84e8-a522dee112b9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:57.734211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094c099-446e-4bf8-ad23-051da7f0fdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:57.735554 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094c099-446e-4bf8-ad23-051da7f0fdf9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:57.736081 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094c099-446e-4bf8-ad23-051da7f0fdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:57.736567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094c099-446e-4bf8-ad23-051da7f0fdf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:57.737513 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094c099-446e-4bf8-ad23-051da7f0fdf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:57.738123 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094c099-446e-4bf8-ad23-051da7f0fdf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:57.740318 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094c099-446e-4bf8-ad23-051da7f0fdf9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:57.756427 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9215e-a2ef-4b9a-a0df-00889d4f3907 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:57.758528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 415/840] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:57.767626 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094c099-446e-4bf8-ad23-051da7f0fdf9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:57.802717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f2279-014c-442c-959b-ea3f67a36e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:57.803801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f2279-014c-442c-959b-ea3f67a36e76 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:57.804090 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f2279-014c-442c-959b-ea3f67a36e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:57.804371 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f2279-014c-442c-959b-ea3f67a36e76 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:57.805043 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f2279-014c-442c-959b-ea3f67a36e76 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:57.806817 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f2279-014c-442c-959b-ea3f67a36e76 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:57.821058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-711f2279-014c-442c-959b-ea3f67a36e76 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:24:57.821058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:57.821058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:57.821058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:57.821058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:57.821058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:57.821058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:57.821058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:57.821058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:24:57.821058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:57.821058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:57.821058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:57.821058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:57.821058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:57.821058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:57.821058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:57.821058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:57.822245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:57.822245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:57.822245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:57.822245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:57.822245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:57.822245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:57.822245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:57.822245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:57.822245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:57.822245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:57.822245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:57.822245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:57.822245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:57.822245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:57.822245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:57.822245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:57.823125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:57.823125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:57.823125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:57.823125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:57.823125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:57.823125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:57.823125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:57.823125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:57.823125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:57.823125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:57.823125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:57.823125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:57.823125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:24:57.823125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:57.827136 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 426/841] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:57.828869 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f2279-014c-442c-959b-ea3f67a36e76 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:57.845426 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:57.888943 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094c099-446e-4bf8-ad23-051da7f0fdf9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:57.934106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc16d8-bae0-4191-abee-12dd157dd93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:57.934362 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc16d8-bae0-4191-abee-12dd157dd93b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:57.934469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc16d8-bae0-4191-abee-12dd157dd93b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:57.936656 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc16d8-bae0-4191-abee-12dd157dd93b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:57.943190 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc16d8-bae0-4191-abee-12dd157dd93b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:57.944882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc16d8-bae0-4191-abee-12dd157dd93b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:57.961467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-a5cc16d8-bae0-4191-abee-12dd157dd93b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:24:57.961467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:57.961467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:57.961467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:57.961467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:57.961467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:57.961467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:57.961467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:57.961467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:57.961467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:57.961467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:57.961467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:57.961467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:57.961467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:57.961467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:57.961467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:57.963015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:57.963015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:57.963015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:57.963015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:57.963015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:57.963015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:57.963015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:57.963015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:57.963015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:57.963015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:57.963015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:57.963015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:57.963015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:57.963015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:57.963015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:57.963015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:57.963015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:57.963015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:57.964339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:57.964339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:57.964339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:57.964339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:57.964339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:57.964339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:57.964339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:57.964339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:57.964339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 14 15:24:57.964339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:57.967355 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 416/842] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:24:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:57.974218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc16d8-bae0-4191-abee-12dd157dd93b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:57.983093 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:58.029421 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f2279-014c-442c-959b-ea3f67a36e76 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:58.084589 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0366f-6741-4e82-90a7-a8fefa4be250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:58.084589 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0366f-6741-4e82-90a7-a8fefa4be250 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:58.084589 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0366f-6741-4e82-90a7-a8fefa4be250 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:58.084589 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0366f-6741-4e82-90a7-a8fefa4be250 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:58.085103 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0366f-6741-4e82-90a7-a8fefa4be250 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:58.085103 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0366f-6741-4e82-90a7-a8fefa4be250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:58.085498 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0366f-6741-4e82-90a7-a8fefa4be250 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:58.098927 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 427/843] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:58.104539 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0366f-6741-4e82-90a7-a8fefa4be250 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:58.127594 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc16d8-bae0-4191-abee-12dd157dd93b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:58.185559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daef495-91d1-44ab-bb20-23f70431b23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:58.186617 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daef495-91d1-44ab-bb20-23f70431b23b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:58.187156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daef495-91d1-44ab-bb20-23f70431b23b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:58.187654 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daef495-91d1-44ab-bb20-23f70431b23b None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:58.188983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daef495-91d1-44ab-bb20-23f70431b23b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:58.189492 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daef495-91d1-44ab-bb20-23f70431b23b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:58.191366 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daef495-91d1-44ab-bb20-23f70431b23b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:58.201328 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:58.216316 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 417/844] 10.222.0.39 () {56 vars in 1135 bytes} [Thu Jul 14 15:24:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:58.217716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6efe26-434a-49ea-adab-916e16b520a2 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:58.218007 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6efe26-434a-49ea-adab-916e16b520a2 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:58.218652 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6efe26-434a-49ea-adab-916e16b520a2 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:58.222202 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 418/845] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:58.222202 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6efe26-434a-49ea-adab-916e16b520a2 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:58.236772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0366f-6741-4e82-90a7-a8fefa4be250 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:58.277300 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fa132-d3bd-454e-a662-7b186afe2001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:58.278268 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fa132-d3bd-454e-a662-7b186afe2001 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:58.278570 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fa132-d3bd-454e-a662-7b186afe2001 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:58.278852 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fa132-d3bd-454e-a662-7b186afe2001 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:58.279985 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fa132-d3bd-454e-a662-7b186afe2001 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:58.280706 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fa132-d3bd-454e-a662-7b186afe2001 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:58.282788 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fa132-d3bd-454e-a662-7b186afe2001 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:58.288769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 428/846] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jul 14 15:24:58 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:58.288769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fabdd2-9f0d-4fcb-9ba9-4c701d028e74 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:58.288769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fabdd2-9f0d-4fcb-9ba9-4c701d028e74 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:58.288769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fabdd2-9f0d-4fcb-9ba9-4c701d028e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:58.307541 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:58.315135 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-96fabdd2-9f0d-4fcb-9ba9-4c701d028e74 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:58.316805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-96fabdd2-9f0d-4fcb-9ba9-4c701d028e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:58.358818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6efe26-434a-49ea-adab-916e16b520a2 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:58.408493 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aeefea-c93c-495f-a300-b770fd4048ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:58.409469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeefea-c93c-495f-a300-b770fd4048ab None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:58.409765 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeefea-c93c-495f-a300-b770fd4048ab None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:58.410056 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aeefea-c93c-495f-a300-b770fd4048ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:58.463253 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 429/847] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:58.464425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45445a7-6e0b-4ac6-9e4d-2663fff6b50d None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:58.464637 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45445a7-6e0b-4ac6-9e4d-2663fff6b50d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:58.464912 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45445a7-6e0b-4ac6-9e4d-2663fff6b50d None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:58.476709 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 430/848] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:24:58.481713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa8fa7-6576-448d-a495-26045fd4d0ad None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:58.481713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa8fa7-6576-448d-a495-26045fd4d0ad None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:58.481713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa8fa7-6576-448d-a495-26045fd4d0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:58.498696 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-0eaa8fa7-6576-448d-a495-26045fd4d0ad None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:24:58.499909 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0eaa8fa7-6576-448d-a495-26045fd4d0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:24:58.529474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aeefea-c93c-495f-a300-b770fd4048ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:58.531107 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aeefea-c93c-495f-a300-b770fd4048ab None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:58.583074 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:58.590240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 431/849] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:24:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:24:58.591180 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa8fa7-6576-448d-a495-26045fd4d0ad None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:58.614603 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:58.656018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 419/850] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:24:58 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:24:58.657308 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aeefea-c93c-495f-a300-b770fd4048ab None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:58.716805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa8fa7-6576-448d-a495-26045fd4d0ad None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:58.754006 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b581d-e261-4d31-8cd3-1a1b7f32aa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:58.754838 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b581d-e261-4d31-8cd3-1a1b7f32aa3a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:58.755123 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b581d-e261-4d31-8cd3-1a1b7f32aa3a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:58.755481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b581d-e261-4d31-8cd3-1a1b7f32aa3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:58.768161 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b581d-e261-4d31-8cd3-1a1b7f32aa3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:24:58.775963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-c26b581d-e261-4d31-8cd3-1a1b7f32aa3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:58.775963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:58.775963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:58.775963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:58.775963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:58.775963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:58.775963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:58.775963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:58.775963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:58.775963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:58.775963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:58.775963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:58.775963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:24:58.775963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:24:58.775963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:24:58.775963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:24:58.776940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:24:58.776940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:24:58.776940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:24:58.776940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:24:58.776940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:58.776940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:58.776940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:58.776940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:58.776940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:58.776940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:58.776940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:58.776940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:58.776940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:58.776940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:58.776940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:58.776940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:58.777797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:58.777797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:58.777797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:58.777797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:58.777797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:24:58.777797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:24:58.777797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:24:58.777797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:24:58.777797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:24:58.777797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:24:58.777797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:24:58.777797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:58.777797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 432/851] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:24:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:58.779341 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b581d-e261-4d31-8cd3-1a1b7f32aa3a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:58.804185 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aeefea-c93c-495f-a300-b770fd4048ab None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:58.846732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:58.847998 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94564399-4c5a-4380-9222-b084561e01f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:58.848858 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94564399-4c5a-4380-9222-b084561e01f8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:58.849206 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94564399-4c5a-4380-9222-b084561e01f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:58.849530 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94564399-4c5a-4380-9222-b084561e01f8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:58.850424 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94564399-4c5a-4380-9222-b084561e01f8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:58.851920 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94564399-4c5a-4380-9222-b084561e01f8 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:58.865288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-94564399-4c5a-4380-9222-b084561e01f8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:24:58.865288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:58.865288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:24:58.865288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:24:58.865288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:24:58.865288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:24:58.865288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:24:58.865288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:58.865288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:24:58.865288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:58.865288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:24:58.865288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:58.865288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:58.865288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:58.865288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:58.865288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:58.866420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:58.866420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:58.866420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:58.866420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:58.866420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:58.866420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:58.866420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:58.866420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:24:58.866420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:24:58.866420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:24:58.866420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:24:58.866420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:58.866420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:58.866420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:58.866420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:58.866420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:58.867287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:58.867287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:58.867287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:58.867287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:58.867287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:58.867287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:58.867287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:58.867287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:58.867287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:58.867287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:58.867287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:58.867287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:24:58.867287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:24:58.867287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:24:58.867287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:58.867287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 420/852] 10.222.0.39 () {56 vars in 1132 bytes} [Thu Jul 14 15:24:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:58.868283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94564399-4c5a-4380-9222-b084561e01f8 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:58.897741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b581d-e261-4d31-8cd3-1a1b7f32aa3a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:58.902361 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:58.941164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c2f7b-b0da-409f-94c4-bc684c6b0842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:58.941962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c2f7b-b0da-409f-94c4-bc684c6b0842 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:58.942280 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c2f7b-b0da-409f-94c4-bc684c6b0842 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:58.942565 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c2f7b-b0da-409f-94c4-bc684c6b0842 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:58.954903 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c2f7b-b0da-409f-94c4-bc684c6b0842 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:58.956382 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c2f7b-b0da-409f-94c4-bc684c6b0842 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:58.974298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-157c2f7b-b0da-409f-94c4-bc684c6b0842 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:58.974298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:58.974298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:58.974298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:58.974298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:58.974298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:58.974298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:58.974298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:58.974298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:58.974298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:58.974298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:58.974298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:58.974298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:58.974298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:58.974298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:58.975259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:58.975259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:58.975259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:58.975259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:58.975259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:58.975259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:58.975259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:58.975259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:58.975259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:58.975259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:58.975259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:58.975259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:58.975259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:58.975259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:58.975259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:58.975259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:58.975259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:58.976186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:58.976186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:58.976186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:58.976186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:58.976186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 433/853] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:58.976487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c2f7b-b0da-409f-94c4-bc684c6b0842 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:58.992612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94564399-4c5a-4380-9222-b084561e01f8 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:59.029885 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b2e0c-e048-414c-9d59-0a1723c60713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:59.030725 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b2e0c-e048-414c-9d59-0a1723c60713 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:59.031014 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b2e0c-e048-414c-9d59-0a1723c60713 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:59.031294 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b2e0c-e048-414c-9d59-0a1723c60713 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:59.032866 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b2e0c-e048-414c-9d59-0a1723c60713 None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:59.033198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b2e0c-e048-414c-9d59-0a1723c60713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:59.034713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b2e0c-e048-414c-9d59-0a1723c60713 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:59.047616 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 421/854] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jul 14 15:24:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:59.047616 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b2e0c-e048-414c-9d59-0a1723c60713 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:59.103181 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c2f7b-b0da-409f-94c4-bc684c6b0842 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:59.116442 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:59.142209 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb64114-61e4-474d-b20d-62aff4449993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:59.142886 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb64114-61e4-474d-b20d-62aff4449993 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:59.143174 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb64114-61e4-474d-b20d-62aff4449993 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:59.143456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb64114-61e4-474d-b20d-62aff4449993 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:59.144162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb64114-61e4-474d-b20d-62aff4449993 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:59.144472 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb64114-61e4-474d-b20d-62aff4449993 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:59.145867 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb64114-61e4-474d-b20d-62aff4449993 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:59.148649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:59.150990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 434/855] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jul 14 15:24:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:59.154967 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb64114-61e4-474d-b20d-62aff4449993 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:59.162337 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b2e0c-e048-414c-9d59-0a1723c60713 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:59.198704 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bd2d4-e7ba-4175-b4f0-58944c9476b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:59.199371 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bd2d4-e7ba-4175-b4f0-58944c9476b1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:59.199658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bd2d4-e7ba-4175-b4f0-58944c9476b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:59.199936 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2bd2d4-e7ba-4175-b4f0-58944c9476b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:59.200662 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bd2d4-e7ba-4175-b4f0-58944c9476b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:59.200974 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bd2d4-e7ba-4175-b4f0-58944c9476b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:59.202388 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2bd2d4-e7ba-4175-b4f0-58944c9476b1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:59.219903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 422/856] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:59.219903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bd2d4-e7ba-4175-b4f0-58944c9476b1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:59.283951 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb64114-61e4-474d-b20d-62aff4449993 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:59.321709 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb96104-809e-41d9-88cd-25092a4c858e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:59.322537 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb96104-809e-41d9-88cd-25092a4c858e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:59.322827 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb96104-809e-41d9-88cd-25092a4c858e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:59.323106 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb96104-809e-41d9-88cd-25092a4c858e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:59.335958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb96104-809e-41d9-88cd-25092a4c858e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:59.337440 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb96104-809e-41d9-88cd-25092a4c858e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:59.350704 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2bd2d4-e7ba-4175-b4f0-58944c9476b1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:59.361197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-cbb96104-809e-41d9-88cd-25092a4c858e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:59.361197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:59.361197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:59.361197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:59.361197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:59.361197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:59.361197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:59.361197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:59.361197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:59.361197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:59.361197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:59.361197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:59.361197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:24:59.361197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:24:59.361197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:24:59.362230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:24:59.362230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:59.362230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:59.362230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:59.362230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:59.362230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:59.362230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:59.362230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:59.362230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:59.362230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:59.362230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:59.362230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:59.362230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:59.362230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:59.362230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:59.362230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:59.362230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:59.366698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:24:59.366698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:24:59.366698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:24:59.366698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:59.366698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 435/857] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:24:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:59.366698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb96104-809e-41d9-88cd-25092a4c858e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:59.396970 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:59.397944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604137b-15a9-4d37-84df-559fa44a3089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:59.398395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604137b-15a9-4d37-84df-559fa44a3089 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:59.398689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604137b-15a9-4d37-84df-559fa44a3089 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:59.398972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604137b-15a9-4d37-84df-559fa44a3089 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:59.399787 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604137b-15a9-4d37-84df-559fa44a3089 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:59.400271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604137b-15a9-4d37-84df-559fa44a3089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:59.401926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604137b-15a9-4d37-84df-559fa44a3089 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:59.410641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 423/858] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jul 14 15:24:59 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:59.412013 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604137b-15a9-4d37-84df-559fa44a3089 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:59.458715 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:59.526260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb96104-809e-41d9-88cd-25092a4c858e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:59.569399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cc916-ed53-457d-9cb0-5aaf80cc9830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:59.570161 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cc916-ed53-457d-9cb0-5aaf80cc9830 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:59.570561 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cc916-ed53-457d-9cb0-5aaf80cc9830 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:59.571004 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cc916-ed53-457d-9cb0-5aaf80cc9830 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:59.579855 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7cc916-ed53-457d-9cb0-5aaf80cc9830 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:59.581618 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7cc916-ed53-457d-9cb0-5aaf80cc9830 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:59.593956 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604137b-15a9-4d37-84df-559fa44a3089 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:59.601567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-cc7cc916-ed53-457d-9cb0-5aaf80cc9830 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:59.601567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:59.601567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:59.601567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:59.601567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:59.601567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:59.601567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:59.601567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:59.601567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:59.601567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:59.601567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:59.601567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:59.601567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:24:59.601567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:24:59.601567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:24:59.602583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:24:59.602583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:59.602583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:59.602583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:59.602583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:59.602583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:59.602583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:59.602583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:59.602583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:59.602583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:59.602583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:59.602583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:59.602583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:59.602583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:59.602583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:59.602583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:59.602583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:59.603487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:24:59.603487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:24:59.603487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:24:59.603487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:24:59.603487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:24:59.603487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:24:59.603487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:24:59.603487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:24:59.604411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 436/859] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:24:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:24:59.612789 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cc916-ed53-457d-9cb0-5aaf80cc9830 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:59.642674 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5637c-fe4a-43b4-af2b-d0f956648508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:59.643886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5637c-fe4a-43b4-af2b-d0f956648508 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:59.644235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5637c-fe4a-43b4-af2b-d0f956648508 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:59.644517 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5637c-fe4a-43b4-af2b-d0f956648508 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:59.645570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5637c-fe4a-43b4-af2b-d0f956648508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:59.645885 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5637c-fe4a-43b4-af2b-d0f956648508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:59.647736 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5637c-fe4a-43b4-af2b-d0f956648508 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:59.663956 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 424/860] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:24:59.669546 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5637c-fe4a-43b4-af2b-d0f956648508 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:59.732834 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:59.749805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:59.753948 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cc916-ed53-457d-9cb0-5aaf80cc9830 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:59.776053 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5637c-fe4a-43b4-af2b-d0f956648508 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:59.795196 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc694b83-d6d2-442e-abab-d13f8f69ab95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:59.796437 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc694b83-d6d2-442e-abab-d13f8f69ab95 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:59.796946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc694b83-d6d2-442e-abab-d13f8f69ab95 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:59.797524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc694b83-d6d2-442e-abab-d13f8f69ab95 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:59.799101 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc694b83-d6d2-442e-abab-d13f8f69ab95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:59.799419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc694b83-d6d2-442e-abab-d13f8f69ab95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:59.800871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc694b83-d6d2-442e-abab-d13f8f69ab95 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:59.813455 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8b10a-0fd0-416d-b9b7-8823f4a30854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:59.814309 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8b10a-0fd0-416d-b9b7-8823f4a30854 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:59.814586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8b10a-0fd0-416d-b9b7-8823f4a30854 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:59.814852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8b10a-0fd0-416d-b9b7-8823f4a30854 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:59.815951 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 437/861] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:24:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:24:59.823670 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc694b83-d6d2-442e-abab-d13f8f69ab95 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:59.835459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8b10a-0fd0-416d-b9b7-8823f4a30854 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:59.837051 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8b10a-0fd0-416d-b9b7-8823f4a30854 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:59.855457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-b4e8b10a-0fd0-416d-b9b7-8823f4a30854 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:24:59.855457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:24:59.855457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:24:59.855457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:24:59.855457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:24:59.855457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:24:59.855457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:24:59.855457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:24:59.855457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:24:59.855457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:24:59.855457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:24:59.855457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:24:59.855457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:24:59.855457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:24:59.855457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:24:59.855457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:24:59.857791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:24:59.857791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:24:59.857791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:24:59.857791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:59.857791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:24:59.857791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:24:59.857791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:24:59.857791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:24:59.857791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:24:59.857791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:24:59.857791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:24:59.857791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:24:59.857791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:24:59.857791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:24:59.857791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:24:59.857791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:24:59.857791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:24:59.857791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:24:59.860404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:24:59.860404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:24:59.860404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:24:59.860404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:24:59.860404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:24:59.860404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:24:59.860404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:24:59.860404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:24:59.860404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:24:59.860404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:24:59.870206 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 425/862] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jul 14 15:24:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:24:59.870206 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8b10a-0fd0-416d-b9b7-8823f4a30854 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:24:59.938298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc694b83-d6d2-442e-abab-d13f8f69ab95 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:59.975458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8b10a-0fd0-416d-b9b7-8823f4a30854 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:24:59.976139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc7c3a-2164-4b9f-b945-d1541ecef97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:24:59.976679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc7c3a-2164-4b9f-b945-d1541ecef97c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:24:59.977072 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc7c3a-2164-4b9f-b945-d1541ecef97c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:24:59.977362 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc7c3a-2164-4b9f-b945-d1541ecef97c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:24:59.978349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc7c3a-2164-4b9f-b945-d1541ecef97c None admin] RBAC: Adding query filter params (role.id=87f040877bfa47bda56305eb022af09e, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=edbbc94ca71c42c0aac562c8c2ec83db) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:24:59.978671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc7c3a-2164-4b9f-b945-d1541ecef97c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:24:59.980136 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc7c3a-2164-4b9f-b945-d1541ecef97c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:24:59.987283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 438/863] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:24:59 2022] GET /identity/v3/role_assignments?user.id=edbbc94ca71c42c0aac562c8c2ec83db&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=87f040877bfa47bda56305eb022af09e => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:00.021985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cd840-300f-4a32-86c2-03f84c9115bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:00.022715 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cd840-300f-4a32-86c2-03f84c9115bf None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:00.023000 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cd840-300f-4a32-86c2-03f84c9115bf None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:00.023284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cd840-300f-4a32-86c2-03f84c9115bf None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:00.024158 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1cd840-300f-4a32-86c2-03f84c9115bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:00.024474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1cd840-300f-4a32-86c2-03f84c9115bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:00.025970 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1cd840-300f-4a32-86c2-03f84c9115bf None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:00.027964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:00.049343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 426/864] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jul 14 15:24:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:00.055319 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc7c3a-2164-4b9f-b945-d1541ecef97c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:00.090568 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:00.179654 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc7c3a-2164-4b9f-b945-d1541ecef97c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:00.216822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc23fa-2a40-4ec4-a016-0b6d960904a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:00.217487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc23fa-2a40-4ec4-a016-0b6d960904a4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:00.217822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc23fa-2a40-4ec4-a016-0b6d960904a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:00.218131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc23fa-2a40-4ec4-a016-0b6d960904a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:00.292382 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc23fa-2a40-4ec4-a016-0b6d960904a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:00.293955 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc23fa-2a40-4ec4-a016-0b6d960904a4 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:00.306998 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:00.408842 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 439/865] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:25:00 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:25:00.419347 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cd840-300f-4a32-86c2-03f84c9115bf None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:00.555320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77027758-3eaf-4fdd-9c77-771494c0ffa9 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:00.555687 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77027758-3eaf-4fdd-9c77-771494c0ffa9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:00.555934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77027758-3eaf-4fdd-9c77-771494c0ffa9 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:00.562122 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 440/866] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:00.563682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd6ede-698e-4697-bcf5-eafc4cb1fd27 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:00.563975 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd6ede-698e-4697-bcf5-eafc4cb1fd27 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:00.564254 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd6ede-698e-4697-bcf5-eafc4cb1fd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:00.599969 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-92dd6ede-698e-4697-bcf5-eafc4cb1fd27 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:00.601488 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-92dd6ede-698e-4697-bcf5-eafc4cb1fd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:00.668683 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cd840-300f-4a32-86c2-03f84c9115bf None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:00.774102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437459d4-6a14-4f4c-a1a6-f42784cfe212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:00.774102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437459d4-6a14-4f4c-a1a6-f42784cfe212 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:00.774102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437459d4-6a14-4f4c-a1a6-f42784cfe212 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:00.774102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437459d4-6a14-4f4c-a1a6-f42784cfe212 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:00.794104 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 441/867] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:00.804180 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437459d4-6a14-4f4c-a1a6-f42784cfe212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:00.806402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437459d4-6a14-4f4c-a1a6-f42784cfe212 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:00.825131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd6ede-698e-4697-bcf5-eafc4cb1fd27 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:00.853198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-437459d4-6a14-4f4c-a1a6-f42784cfe212 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:00.853198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:00.853198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:00.853198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:00.853198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:00.853198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:00.853198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:00.853198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:00.853198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:00.853198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:00.853198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:00.853198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:00.853198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:25:00.853198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:25:00.853198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:25:00.854226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:25:00.854226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:00.854226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:00.854226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:00.854226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:00.854226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:00.854226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:00.854226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:00.854226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:00.854226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:00.854226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:00.854226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:00.854226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:00.854226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:00.854226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:00.854226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:00.854226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:00.855164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:25:00.855164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:25:00.855164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:00.855164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:00.866104 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 427/868] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 446 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:00.874092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437459d4-6a14-4f4c-a1a6-f42784cfe212 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:00.902510 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:00.970181 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:01.038485 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd6ede-698e-4697-bcf5-eafc4cb1fd27 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:01.090367 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437459d4-6a14-4f4c-a1a6-f42784cfe212 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:01.103139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849f2a2-10c3-46cf-94be-08e7998add7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:01.103820 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849f2a2-10c3-46cf-94be-08e7998add7e None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:01.105717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849f2a2-10c3-46cf-94be-08e7998add7e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:01.105717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849f2a2-10c3-46cf-94be-08e7998add7e None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:01.110101 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849f2a2-10c3-46cf-94be-08e7998add7e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:01.111113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849f2a2-10c3-46cf-94be-08e7998add7e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:01.136014 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 442/869] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jul 14 15:25:00 2022] POST /identity/v3/services => generated 251 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:25:01.181917 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa8995-59a1-4575-949f-c48c77230df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:01.186120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa8995-59a1-4575-949f-c48c77230df2 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:01.186120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa8995-59a1-4575-949f-c48c77230df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:01.186120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa8995-59a1-4575-949f-c48c77230df2 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:01.186120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa8995-59a1-4575-949f-c48c77230df2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:01.186120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa8995-59a1-4575-949f-c48c77230df2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:01.186120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa8995-59a1-4575-949f-c48c77230df2 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:01.200096 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 428/870] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:01.210124 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849f2a2-10c3-46cf-94be-08e7998add7e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:01.343822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849f2a2-10c3-46cf-94be-08e7998add7e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:01.349415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:01.387394 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f67df-d0f8-4cdd-ba95-7bc2ab5a48ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:01.388196 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f67df-d0f8-4cdd-ba95-7bc2ab5a48ca None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:01.388476 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f67df-d0f8-4cdd-ba95-7bc2ab5a48ca None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:01.388748 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f67df-d0f8-4cdd-ba95-7bc2ab5a48ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:01.396875 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f67df-d0f8-4cdd-ba95-7bc2ab5a48ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:01.398364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f67df-d0f8-4cdd-ba95-7bc2ab5a48ca None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:01.413812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-785f67df-d0f8-4cdd-ba95-7bc2ab5a48ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:25:01.413812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:01.413812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:01.413812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:01.413812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:01.413812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:01.413812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:01.413812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:01.413812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:01.413812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:01.413812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:01.413812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:01.413812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:25:01.413812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:25:01.413812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:25:01.414805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:25:01.414805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:01.414805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:01.414805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:01.414805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:01.414805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:01.414805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:01.414805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:01.414805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:01.414805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:01.414805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:01.414805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:01.414805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:01.414805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:01.414805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:01.414805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:01.414805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:01.415718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:25:01.415718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:25:01.415718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:25:01.415718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:25:01.415718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:25:01.415718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:25:01.415718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:25:01.415718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:01.429736 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 443/871] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:25:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:01.432667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa8995-59a1-4575-949f-c48c77230df2 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:01.543579 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:01.547403 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa8995-59a1-4575-949f-c48c77230df2 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:01.584486 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64044d-e1a6-4c35-ae59-fd04f3d61295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:01.585142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64044d-e1a6-4c35-ae59-fd04f3d61295 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:01.585425 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64044d-e1a6-4c35-ae59-fd04f3d61295 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:01.585694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64044d-e1a6-4c35-ae59-fd04f3d61295 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:01.586510 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64044d-e1a6-4c35-ae59-fd04f3d61295 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:01.586816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64044d-e1a6-4c35-ae59-fd04f3d61295 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:01.588243 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64044d-e1a6-4c35-ae59-fd04f3d61295 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:01.608919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 429/872] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:25:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:01.610744 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f67df-d0f8-4cdd-ba95-7bc2ab5a48ca None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:01.721619 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f67df-d0f8-4cdd-ba95-7bc2ab5a48ca None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:01.760471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa07a2-2b6a-4ef6-a7df-4a81ac3b2669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:01.761136 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa07a2-2b6a-4ef6-a7df-4a81ac3b2669 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:01.761423 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa07a2-2b6a-4ef6-a7df-4a81ac3b2669 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:01.761710 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa07a2-2b6a-4ef6-a7df-4a81ac3b2669 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:01.762578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa07a2-2b6a-4ef6-a7df-4a81ac3b2669 None admin] RBAC: Adding query filter params (role.id=1d73a20858554285862ec7d933eb6149, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=8103402ac83c4b4191a3ec4d55038e1b) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:01.762899 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa07a2-2b6a-4ef6-a7df-4a81ac3b2669 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:01.764351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa07a2-2b6a-4ef6-a7df-4a81ac3b2669 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:01.771961 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 444/873] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:25:01 2022] GET /identity/v3/role_assignments?user.id=8103402ac83c4b4191a3ec4d55038e1b&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=1d73a20858554285862ec7d933eb6149 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:01.824650 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7484b0-0840-494b-bacd-946f6c7420fd None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:01.824650 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7484b0-0840-494b-bacd-946f6c7420fd None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:01.824650 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7484b0-0840-494b-bacd-946f6c7420fd None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:01.824650 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 430/874] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:01.834627 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44dc197-c5eb-4514-a3fe-ad8d4c43a08b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:01.834627 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44dc197-c5eb-4514-a3fe-ad8d4c43a08b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:01.834627 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44dc197-c5eb-4514-a3fe-ad8d4c43a08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:01.854388 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a44dc197-c5eb-4514-a3fe-ad8d4c43a08b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:01.856083 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a44dc197-c5eb-4514-a3fe-ad8d4c43a08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:01.879387 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:01.940941 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 445/875] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:01 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:01.965253 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7484b0-0840-494b-bacd-946f6c7420fd None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:02.075854 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7484b0-0840-494b-bacd-946f6c7420fd None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:02.114538 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ddfcb-0ab7-41e5-bbbf-0c00c3da1089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:02.115917 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ddfcb-0ab7-41e5-bbbf-0c00c3da1089 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:02.116373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ddfcb-0ab7-41e5-bbbf-0c00c3da1089 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:02.116802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ddfcb-0ab7-41e5-bbbf-0c00c3da1089 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:02.117700 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ddfcb-0ab7-41e5-bbbf-0c00c3da1089 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:02.119271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4ddfcb-0ab7-41e5-bbbf-0c00c3da1089 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:02.138372 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 431/876] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jul 14 15:25:01 2022] POST /identity/v3/services => generated 269 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:25:02.344463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325852c8-95d6-4e6d-b10d-fc94046ed695 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:02.345018 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325852c8-95d6-4e6d-b10d-fc94046ed695 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:02.345115 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325852c8-95d6-4e6d-b10d-fc94046ed695 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:02.346833 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 446/877] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:02.352274 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4f359-fd1a-4f44-a31f-349243708d71 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:02.352572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4f359-fd1a-4f44-a31f-349243708d71 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:02.352853 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4f359-fd1a-4f44-a31f-349243708d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:02.370713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-99b4f359-fd1a-4f44-a31f-349243708d71 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:02.371915 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-99b4f359-fd1a-4f44-a31f-349243708d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:02.387623 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:02.463424 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 432/878] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:02.486326 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325852c8-95d6-4e6d-b10d-fc94046ed695 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:02.606202 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325852c8-95d6-4e6d-b10d-fc94046ed695 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:02.645463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d00792-7d8f-4d44-98cd-ac046b011176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:02.646305 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d00792-7d8f-4d44-98cd-ac046b011176 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:02.646591 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d00792-7d8f-4d44-98cd-ac046b011176 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:02.646867 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d00792-7d8f-4d44-98cd-ac046b011176 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:02.647531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d00792-7d8f-4d44-98cd-ac046b011176 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:02.648919 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d00792-7d8f-4d44-98cd-ac046b011176 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:02.661958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-15d00792-7d8f-4d44-98cd-ac046b011176 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:25:02.661958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:02.661958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:25:02.661958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:25:02.661958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:25:02.661958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:25:02.661958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:25:02.661958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:02.661958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:25:02.661958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:02.661958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:25:02.661958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:02.661958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:02.661958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:02.661958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:02.661958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:02.661958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:02.663050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:02.663050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:02.663050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:02.663050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:02.663050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:02.663050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:02.663050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:25:02.663050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:25:02.663050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:25:02.663050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:25:02.663050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:02.663050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:02.663050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:02.663050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:02.663050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:02.663050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:02.663890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:02.663890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:02.663890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:02.663890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:02.663890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:02.663890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:02.663890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:02.663890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:02.663890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:02.663890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:02.663890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:25:02.663890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:02.663890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:25:02.663890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:02.663890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 447/879] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jul 14 15:25:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:02.671752 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4f359-fd1a-4f44-a31f-349243708d71 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:02.781158 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4f359-fd1a-4f44-a31f-349243708d71 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:02.822514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb574a92-22cd-492c-b3f0-71725dc1defb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:02.823191 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb574a92-22cd-492c-b3f0-71725dc1defb None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:02.823472 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb574a92-22cd-492c-b3f0-71725dc1defb None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:02.823749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb574a92-22cd-492c-b3f0-71725dc1defb None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:02.824457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb574a92-22cd-492c-b3f0-71725dc1defb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:02.824761 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb574a92-22cd-492c-b3f0-71725dc1defb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:02.826201 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb574a92-22cd-492c-b3f0-71725dc1defb None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:02.831979 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 433/880] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jul 14 15:25:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:02.837528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d00792-7d8f-4d44-98cd-ac046b011176 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:02.862530 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:02.956524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d00792-7d8f-4d44-98cd-ac046b011176 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:02.993782 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c601a-5041-4035-a557-8add69b60d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:02.994499 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c601a-5041-4035-a557-8add69b60d25 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:02.994783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c601a-5041-4035-a557-8add69b60d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:02.995065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c601a-5041-4035-a557-8add69b60d25 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:02.995780 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c601a-5041-4035-a557-8add69b60d25 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:02.996088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c601a-5041-4035-a557-8add69b60d25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:02.997466 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c601a-5041-4035-a557-8add69b60d25 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:03.003858 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 448/881] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jul 14 15:25:02 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:03.509021 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c53f36-69a7-4fec-b647-b095055bdbde None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:03.509916 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c53f36-69a7-4fec-b647-b095055bdbde None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:03.510399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c53f36-69a7-4fec-b647-b095055bdbde None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:03.512132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 434/882] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:03.518158 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ccdab-6ac4-4e4d-ae80-d2d6d55edea0 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:03.519074 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ccdab-6ac4-4e4d-ae80-d2d6d55edea0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:03.519557 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ccdab-6ac4-4e4d-ae80-d2d6d55edea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:03.543994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2d1ccdab-6ac4-4e4d-ae80-d2d6d55edea0 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:03.545580 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2d1ccdab-6ac4-4e4d-ae80-d2d6d55edea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:03.619515 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 449/883] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:03.643410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c53f36-69a7-4fec-b647-b095055bdbde None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:03.658512 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:03.767082 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c53f36-69a7-4fec-b647-b095055bdbde None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:03.803677 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982e7af-4d50-431b-8011-2934b82b22d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:03.804483 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982e7af-4d50-431b-8011-2934b82b22d6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:03.804766 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982e7af-4d50-431b-8011-2934b82b22d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:03.805040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982e7af-4d50-431b-8011-2934b82b22d6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:03.805696 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982e7af-4d50-431b-8011-2934b82b22d6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:03.807132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982e7af-4d50-431b-8011-2934b82b22d6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:03.826447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-4982e7af-4d50-431b-8011-2934b82b22d6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:25:03.826447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:03.826447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:25:03.826447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:25:03.826447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:25:03.826447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:25:03.826447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:25:03.826447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:03.826447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:25:03.826447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:03.826447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:25:03.826447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:03.826447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:03.826447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:03.826447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:03.826447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:03.826447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:03.829519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:03.829519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:03.829519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:03.829519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:03.829519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:03.829519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:03.829519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:25:03.829519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:25:03.829519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:25:03.829519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:25:03.829519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:03.829519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:03.829519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:03.829519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:03.829519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:03.829519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:03.830730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:03.830730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:03.830730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:03.830730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:03.830730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:03.830730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:03.830730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:03.830730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:03.830730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:03.830730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:03.830730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:25:03.830730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:03.830730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:25:03.830730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:03.830730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 435/884] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jul 14 15:25:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:03.838175 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ccdab-6ac4-4e4d-ae80-d2d6d55edea0 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:03.850494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:03.942773 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ccdab-6ac4-4e4d-ae80-d2d6d55edea0 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:03.979158 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bec47a-d7f0-4718-a392-39c3e1b0d843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:03.979830 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bec47a-d7f0-4718-a392-39c3e1b0d843 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:03.980114 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bec47a-d7f0-4718-a392-39c3e1b0d843 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:03.980390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bec47a-d7f0-4718-a392-39c3e1b0d843 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:03.981102 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bec47a-d7f0-4718-a392-39c3e1b0d843 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:03.981411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bec47a-d7f0-4718-a392-39c3e1b0d843 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:03.982837 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bec47a-d7f0-4718-a392-39c3e1b0d843 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:03.988880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 450/885] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jul 14 15:25:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:03.994567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982e7af-4d50-431b-8011-2934b82b22d6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:04.076083 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:04.102870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982e7af-4d50-431b-8011-2934b82b22d6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:04.139239 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d4d2d-eff5-4fa7-9efb-76cd9a08db73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:04.139952 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d4d2d-eff5-4fa7-9efb-76cd9a08db73 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:04.140236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d4d2d-eff5-4fa7-9efb-76cd9a08db73 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:04.140513 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d4d2d-eff5-4fa7-9efb-76cd9a08db73 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:04.142452 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d4d2d-eff5-4fa7-9efb-76cd9a08db73 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:04.142814 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d4d2d-eff5-4fa7-9efb-76cd9a08db73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:04.144207 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d4d2d-eff5-4fa7-9efb-76cd9a08db73 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:04.149702 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 436/886] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jul 14 15:25:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:04.155481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bec47a-d7f0-4718-a392-39c3e1b0d843 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:04.216383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac84c3-916e-4aea-bd7c-eea028876c55 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:04.216726 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac84c3-916e-4aea-bd7c-eea028876c55 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:04.216923 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac84c3-916e-4aea-bd7c-eea028876c55 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:04.218728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 437/887] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:04.224273 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5e6be-2241-4e86-97a1-2af985a7d5bc None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:04.224560 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5e6be-2241-4e86-97a1-2af985a7d5bc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:04.224840 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5e6be-2241-4e86-97a1-2af985a7d5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:04.256008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:04.256258 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-14f5e6be-2241-4e86-97a1-2af985a7d5bc None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:04.256258 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-14f5e6be-2241-4e86-97a1-2af985a7d5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:04.275812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bec47a-d7f0-4718-a392-39c3e1b0d843 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:04.316337 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b7932-f473-4c1e-9ab5-a2130e475963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:04.317436 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b7932-f473-4c1e-9ab5-a2130e475963 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:04.318024 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b7932-f473-4c1e-9ab5-a2130e475963 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:04.318476 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b7932-f473-4c1e-9ab5-a2130e475963 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:04.319440 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b7932-f473-4c1e-9ab5-a2130e475963 None admin] RBAC: Adding query filter params (interface=public, service_id=d62b6af886ee4a83b5bdb0f4282c11f8, region_id=RegionOne) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:04.319918 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b7932-f473-4c1e-9ab5-a2130e475963 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:04.321712 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b7932-f473-4c1e-9ab5-a2130e475963 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:04.329925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 451/888] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jul 14 15:25:04 2022] GET /identity/v3/endpoints?service_id=d62b6af886ee4a83b5bdb0f4282c11f8&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:04.335601 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b7932-f473-4c1e-9ab5-a2130e475963 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:04.344801 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 438/889] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:25:04.358724 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845beb4f-8bab-4aed-80de-e0903fd8a817 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:04.359305 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845beb4f-8bab-4aed-80de-e0903fd8a817 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:04.359936 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845beb4f-8bab-4aed-80de-e0903fd8a817 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:04.361881 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 439/890] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:25:04.366865 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d34f7-8608-49ac-b171-6c316c270b63 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:04.367397 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d34f7-8608-49ac-b171-6c316c270b63 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:04.367936 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d34f7-8608-49ac-b171-6c316c270b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:04.385829 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-da5d34f7-8608-49ac-b171-6c316c270b63 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:04.387075 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-da5d34f7-8608-49ac-b171-6c316c270b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:04.461838 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b7932-f473-4c1e-9ab5-a2130e475963 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:04.465399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:04.472687 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 440/891] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:04.473733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d34f7-8608-49ac-b171-6c316c270b63 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:04.508534 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803631e-ad0c-4b8c-96d9-770f0b20a43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:04.509611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803631e-ad0c-4b8c-96d9-770f0b20a43c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:04.510052 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803631e-ad0c-4b8c-96d9-770f0b20a43c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:04.511266 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803631e-ad0c-4b8c-96d9-770f0b20a43c None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:04.512133 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803631e-ad0c-4b8c-96d9-770f0b20a43c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:04.513657 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803631e-ad0c-4b8c-96d9-770f0b20a43c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:04.522055 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 452/892] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jul 14 15:25:04 2022] GET /identity/v3/services => generated 1268 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:25:04.524245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803631e-ad0c-4b8c-96d9-770f0b20a43c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:04.536215 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:04.598413 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d34f7-8608-49ac-b171-6c316c270b63 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:04.652195 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ef4ce-bd56-4f21-8acf-25c0d23b306c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:04.653380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ef4ce-bd56-4f21-8acf-25c0d23b306c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:04.654499 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ef4ce-bd56-4f21-8acf-25c0d23b306c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:04.654972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ef4ce-bd56-4f21-8acf-25c0d23b306c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:04.667666 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803631e-ad0c-4b8c-96d9-770f0b20a43c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:04.674176 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ef4ce-bd56-4f21-8acf-25c0d23b306c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:25:04.685186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-bc5ef4ce-bd56-4f21-8acf-25c0d23b306c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:25:04.685186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:04.685186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:04.685186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:04.685186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:04.685186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:04.685186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:04.685186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:04.685186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:04.685186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:04.685186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:04.685186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:04.685186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:25:04.685186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:25:04.685186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:25:04.685186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:25:04.686428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:25:04.686428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:25:04.686428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:25:04.686428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:25:04.686428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:04.686428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:04.686428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:04.686428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:04.686428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:04.686428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:04.686428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:04.686428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:04.686428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:04.686428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:04.686428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:04.686428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:04.687352 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:04.687352 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:04.687352 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:04.687352 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:04.687352 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:25:04.687352 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:25:04.687352 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:25:04.687352 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:25:04.687352 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:25:04.687352 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:25:04.687352 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:25:04.687352 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:04.688136 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 441/893] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jul 14 15:25:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:04.695238 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ef4ce-bd56-4f21-8acf-25c0d23b306c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:04.717130 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a46d84-9fab-4f0a-a8a3-1b6f1aadddd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:04.718276 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a46d84-9fab-4f0a-a8a3-1b6f1aadddd5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:04.718749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a46d84-9fab-4f0a-a8a3-1b6f1aadddd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:04.719245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a46d84-9fab-4f0a-a8a3-1b6f1aadddd5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:04.720092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a46d84-9fab-4f0a-a8a3-1b6f1aadddd5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:04.722005 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a46d84-9fab-4f0a-a8a3-1b6f1aadddd5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:04.736322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-c8a46d84-9fab-4f0a-a8a3-1b6f1aadddd5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:25:04.736322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:04.736322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:25:04.736322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:25:04.736322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:25:04.736322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:25:04.736322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:25:04.736322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:04.736322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:25:04.736322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:04.736322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:25:04.736322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:04.736322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:04.736322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:04.736322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:04.736322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:04.737402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:04.737402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:04.737402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:04.737402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:04.737402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:04.737402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:04.737402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:04.737402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:25:04.737402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:25:04.737402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:25:04.737402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:25:04.737402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:04.737402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:04.737402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:04.737402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:04.737402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:04.738304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:04.738304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:04.738304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:04.738304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:04.738304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:04.738304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:04.738304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:04.738304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:04.738304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:04.738304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:04.738304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:04.738304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:25:04.738304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:04.738304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:25:04.738304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:04.738304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 453/894] 10.222.0.39 () {56 vars in 1132 bytes} [Thu Jul 14 15:25:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:04.745085 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a46d84-9fab-4f0a-a8a3-1b6f1aadddd5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:04.770171 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:04.821226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ef4ce-bd56-4f21-8acf-25c0d23b306c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:04.822556 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:04.862257 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a46d84-9fab-4f0a-a8a3-1b6f1aadddd5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:04.867128 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1fa7d-add6-447b-a5ab-287bfc8a6c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:04.868471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1fa7d-add6-447b-a5ab-287bfc8a6c4c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:04.869009 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1fa7d-add6-447b-a5ab-287bfc8a6c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:04.869592 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1fa7d-add6-447b-a5ab-287bfc8a6c4c None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:04.871122 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1fa7d-add6-447b-a5ab-287bfc8a6c4c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:04.871647 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1fa7d-add6-447b-a5ab-287bfc8a6c4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:04.873348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1fa7d-add6-447b-a5ab-287bfc8a6c4c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:04.884214 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 442/895] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jul 14 15:25:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:04.891916 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1fa7d-add6-447b-a5ab-287bfc8a6c4c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:04.906659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06633727-15a6-4439-a036-a44f0c62f234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:04.907800 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06633727-15a6-4439-a036-a44f0c62f234 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:04.908799 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06633727-15a6-4439-a036-a44f0c62f234 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:04.909234 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06633727-15a6-4439-a036-a44f0c62f234 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:04.910556 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06633727-15a6-4439-a036-a44f0c62f234 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:04.911043 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06633727-15a6-4439-a036-a44f0c62f234 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:04.912897 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06633727-15a6-4439-a036-a44f0c62f234 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:04.920511 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 454/896] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jul 14 15:25:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:04.934117 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06633727-15a6-4439-a036-a44f0c62f234 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:05.025042 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1fa7d-add6-447b-a5ab-287bfc8a6c4c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:05.063445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:05.071966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06633727-15a6-4439-a036-a44f0c62f234 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:05.081437 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344209f-308d-4123-b032-ebfeaaaffd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:05.082384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344209f-308d-4123-b032-ebfeaaaffd71 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:05.082750 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344209f-308d-4123-b032-ebfeaaaffd71 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:05.083100 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344209f-308d-4123-b032-ebfeaaaffd71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:05.095541 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344209f-308d-4123-b032-ebfeaaaffd71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:05.097154 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d344209f-308d-4123-b032-ebfeaaaffd71 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:05.110410 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:05.116272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc132e-f86e-4db0-a240-29b46e0f029d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:05.117135 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc132e-f86e-4db0-a240-29b46e0f029d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:05.117598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc132e-f86e-4db0-a240-29b46e0f029d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:05.118027 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc132e-f86e-4db0-a240-29b46e0f029d None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:05.118346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-d344209f-308d-4123-b032-ebfeaaaffd71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:05.118346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:05.118346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:05.118346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:05.118346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:05.118346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:05.118346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:05.118346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:05.118346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:05.118346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:05.118346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:05.118346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:05.118346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:25:05.118346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:25:05.118346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:25:05.119380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:25:05.119380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:05.119380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:05.119380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:05.119380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:05.119380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:05.119380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:05.119380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:05.119380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:05.119380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:05.119380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:05.119380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:05.119380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:05.119380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:05.119380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:05.119380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:05.119380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:05.120280 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:25:05.120280 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:25:05.120280 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:05.120280 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:05.120810 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 443/897] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:05.121572 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc132e-f86e-4db0-a240-29b46e0f029d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:05.121898 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc132e-f86e-4db0-a240-29b46e0f029d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:05.123312 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc132e-f86e-4db0-a240-29b46e0f029d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:05.126831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344209f-308d-4123-b032-ebfeaaaffd71 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:05.130107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 455/898] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jul 14 15:25:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:05.135824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc132e-f86e-4db0-a240-29b46e0f029d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:05.251081 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344209f-308d-4123-b032-ebfeaaaffd71 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:05.263555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc132e-f86e-4db0-a240-29b46e0f029d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:05.287245 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6885f-f080-4d89-8bed-ddd6c090ecd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:05.288157 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6885f-f080-4d89-8bed-ddd6c090ecd6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:05.288498 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6885f-f080-4d89-8bed-ddd6c090ecd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:05.288904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6885f-f080-4d89-8bed-ddd6c090ecd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:05.289716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6885f-f080-4d89-8bed-ddd6c090ecd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:05.290019 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6885f-f080-4d89-8bed-ddd6c090ecd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:05.291453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6885f-f080-4d89-8bed-ddd6c090ecd6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:05.304947 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 444/899] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:05.306672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e0ddb-e0b5-4421-a041-021bf6dba492 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:05.307129 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e0ddb-e0b5-4421-a041-021bf6dba492 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:05.307570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e0ddb-e0b5-4421-a041-021bf6dba492 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:05.309226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 445/900] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:05.310324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e0ddb-e0b5-4421-a041-021bf6dba492 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:05.315015 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b9b4d-e343-412d-8f08-2fe5e4689d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:05.315697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b9b4d-e343-412d-8f08-2fe5e4689d33 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:05.316015 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b9b4d-e343-412d-8f08-2fe5e4689d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:05.316271 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b9b4d-e343-412d-8f08-2fe5e4689d33 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:05.317068 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b9b4d-e343-412d-8f08-2fe5e4689d33 None admin] RBAC: Adding query filter params (interface=public, service_id=636a6623c8c544aa9c9ddd9b23f2f0d5, region_id=RegionOne) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:05.317388 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b9b4d-e343-412d-8f08-2fe5e4689d33 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:05.318812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b9b4d-e343-412d-8f08-2fe5e4689d33 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:05.328785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 456/901] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jul 14 15:25:05 2022] GET /identity/v3/endpoints?service_id=636a6623c8c544aa9c9ddd9b23f2f0d5&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:05.328785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1edf9-14da-458a-88b3-e0dc3d1b44b4 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:05.328785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1edf9-14da-458a-88b3-e0dc3d1b44b4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:05.328785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1edf9-14da-458a-88b3-e0dc3d1b44b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:05.345144 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2ca1edf9-14da-458a-88b3-e0dc3d1b44b4 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:05.346381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2ca1edf9-14da-458a-88b3-e0dc3d1b44b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:05.356381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:05.410134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:05.438327 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 457/902] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:05.438327 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1edf9-14da-458a-88b3-e0dc3d1b44b4 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:05.443137 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e0ddb-e0b5-4421-a041-021bf6dba492 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:05.482286 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0f3f8-448f-44d5-a126-2d710016d6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:05.483098 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0f3f8-448f-44d5-a126-2d710016d6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:05.483386 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0f3f8-448f-44d5-a126-2d710016d6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:05.483762 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0f3f8-448f-44d5-a126-2d710016d6e2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:05.492777 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0f3f8-448f-44d5-a126-2d710016d6e2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:05.494490 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0f3f8-448f-44d5-a126-2d710016d6e2 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:05.511852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-4ca0f3f8-448f-44d5-a126-2d710016d6e2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:25:05.511852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:05.511852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:05.511852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:05.511852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:05.511852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:05.511852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:05.511852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:05.511852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:05.511852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:05.511852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:05.511852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:05.511852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:25:05.511852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:25:05.511852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:25:05.511852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:25:05.512875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:05.512875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:05.512875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:25:05.512875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:25:05.512875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:25:05.512875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:25:05.512875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:05.512875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:05.512875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:05.512875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:05.512875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:05.512875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:05.512875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:05.512875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:05.512875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:05.512875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:05.512875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:05.512875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:05.513871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:05.513871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:05.513871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:25:05.513871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:25:05.513871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:25:05.513871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:25:05.513871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:25:05.513871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:25:05.513871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:25:05.513871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:05.513871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 446/903] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jul 14 15:25:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:25:05.513871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0f3f8-448f-44d5-a126-2d710016d6e2 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:05.551207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1edf9-14da-458a-88b3-e0dc3d1b44b4 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:05.588265 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0635d4-a95f-42f5-9026-ff2ec061178f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:05.588946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0635d4-a95f-42f5-9026-ff2ec061178f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:05.589232 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0635d4-a95f-42f5-9026-ff2ec061178f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:05.589511 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0635d4-a95f-42f5-9026-ff2ec061178f None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:05.590235 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0635d4-a95f-42f5-9026-ff2ec061178f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:05.591632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0635d4-a95f-42f5-9026-ff2ec061178f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:05.598775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 458/904] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jul 14 15:25:05 2022] GET /identity/v3/services => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:25:05.599640 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0635d4-a95f-42f5-9026-ff2ec061178f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:05.629537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:05.646180 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0f3f8-448f-44d5-a126-2d710016d6e2 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:05.687602 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:05.694636 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c8366-8227-4cbd-8877-783c95b34b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:05.695617 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c8366-8227-4cbd-8877-783c95b34b64 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:05.695972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c8366-8227-4cbd-8877-783c95b34b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:05.696251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c8366-8227-4cbd-8877-783c95b34b64 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:05.697497 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c8366-8227-4cbd-8877-783c95b34b64 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:05.699335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c8366-8227-4cbd-8877-783c95b34b64 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:05.719794 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 447/905] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jul 14 15:25:05 2022] POST /identity/v3/services => generated 241 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:25:05.760784 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0635d4-a95f-42f5-9026-ff2ec061178f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:05.818479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb0083-7bbc-4994-8c82-a45bc7c833a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:05.819226 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb0083-7bbc-4994-8c82-a45bc7c833a4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:05.819472 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb0083-7bbc-4994-8c82-a45bc7c833a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:05.819759 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb0083-7bbc-4994-8c82-a45bc7c833a4 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:05.820649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb0083-7bbc-4994-8c82-a45bc7c833a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:05.821082 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb0083-7bbc-4994-8c82-a45bc7c833a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:05.822831 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb0083-7bbc-4994-8c82-a45bc7c833a4 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:05.845524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 459/906] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jul 14 15:25:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:05.851497 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c8366-8227-4cbd-8877-783c95b34b64 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:05.963951 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c8366-8227-4cbd-8877-783c95b34b64 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:05.999618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b62544-9ecf-46d0-a9b1-980eea5af11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:06.000918 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b62544-9ecf-46d0-a9b1-980eea5af11c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:06.001393 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b62544-9ecf-46d0-a9b1-980eea5af11c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:06.001882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b62544-9ecf-46d0-a9b1-980eea5af11c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:06.145669 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:06.196022 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b62544-9ecf-46d0-a9b1-980eea5af11c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:06.197499 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b62544-9ecf-46d0-a9b1-980eea5af11c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:06.303960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 448/907] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:25:05 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:25:06.309335 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb0083-7bbc-4994-8c82-a45bc7c833a4 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:06.435537 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb0083-7bbc-4994-8c82-a45bc7c833a4 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:06.446114 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:06.475376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca3e15-1de7-4a55-84a0-f3ff5d848472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:06.476187 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca3e15-1de7-4a55-84a0-f3ff5d848472 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:06.476479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca3e15-1de7-4a55-84a0-f3ff5d848472 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:06.476760 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca3e15-1de7-4a55-84a0-f3ff5d848472 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:06.488298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca3e15-1de7-4a55-84a0-f3ff5d848472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:06.489760 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca3e15-1de7-4a55-84a0-f3ff5d848472 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:06.508223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-09ca3e15-1de7-4a55-84a0-f3ff5d848472 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:06.508223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:06.508223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:06.508223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:06.508223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:06.508223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:06.508223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:06.508223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:06.508223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:06.508223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:06.508223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:06.508223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:06.508223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:25:06.508223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:25:06.508223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:25:06.509198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:25:06.509198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:06.509198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:06.509198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:06.509198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:06.509198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:06.509198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:06.509198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:06.509198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:06.509198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:06.509198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:06.509198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:06.509198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:06.509198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:06.509198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:06.509198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:06.509198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:06.510156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:25:06.510156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:25:06.510156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:06.510156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:06.510156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 460/908] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:06.515410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b62544-9ecf-46d0-a9b1-980eea5af11c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:06.575705 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:06.623994 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b62544-9ecf-46d0-a9b1-980eea5af11c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:06.666348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fca087-9eac-4af5-bd36-89cfbe82b218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:06.666999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fca087-9eac-4af5-bd36-89cfbe82b218 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:06.667274 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fca087-9eac-4af5-bd36-89cfbe82b218 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:06.667547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fca087-9eac-4af5-bd36-89cfbe82b218 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:06.668265 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fca087-9eac-4af5-bd36-89cfbe82b218 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:06.668567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fca087-9eac-4af5-bd36-89cfbe82b218 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:06.669932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fca087-9eac-4af5-bd36-89cfbe82b218 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:06.687176 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 449/909] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:06.689163 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca3e15-1de7-4a55-84a0-f3ff5d848472 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:06.799675 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca3e15-1de7-4a55-84a0-f3ff5d848472 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:06.839677 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1516a3d-6d36-4b12-be2e-538cf115bb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:06.840370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1516a3d-6d36-4b12-be2e-538cf115bb09 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:06.840647 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1516a3d-6d36-4b12-be2e-538cf115bb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:06.840963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1516a3d-6d36-4b12-be2e-538cf115bb09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:06.851425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1516a3d-6d36-4b12-be2e-538cf115bb09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:06.852922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1516a3d-6d36-4b12-be2e-538cf115bb09 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:06.861404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35532fbe-cd3c-4383-ab6b-cfcfb6dcec23 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:06.862029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35532fbe-cd3c-4383-ab6b-cfcfb6dcec23 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:06.862591 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35532fbe-cd3c-4383-ab6b-cfcfb6dcec23 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:06.864455 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 450/910] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:06.868700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-e1516a3d-6d36-4b12-be2e-538cf115bb09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:25:06.868700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:06.868700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:06.868700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:06.868700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:06.868700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:06.868700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:06.868700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:06.868700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:06.868700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:06.868700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:06.868700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:06.868700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:25:06.868700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:25:06.868700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:25:06.869623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:25:06.869623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:06.869623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:06.869623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:06.869623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:06.869623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:06.869623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:06.869623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:06.869623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:06.869623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:06.869623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:06.869623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:06.869623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:06.869623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:06.869623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:06.869623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:06.869623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:06.871108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:25:06.871108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:25:06.871108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:25:06.871108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:25:06.871108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:25:06.871108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:25:06.871108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:25:06.871108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:06.871108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 461/911] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:25:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:06.873909 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9106264-94d4-4728-801c-f751a79d554d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:06.874584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9106264-94d4-4728-801c-f751a79d554d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:06.875139 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9106264-94d4-4728-801c-f751a79d554d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:06.875990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1516a3d-6d36-4b12-be2e-538cf115bb09 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:06.896901 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b9106264-94d4-4728-801c-f751a79d554d None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:06.898779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b9106264-94d4-4728-801c-f751a79d554d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:06.910569 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:07.006344 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 451/912] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:07.020705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1516a3d-6d36-4b12-be2e-538cf115bb09 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:07.027793 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9106264-94d4-4728-801c-f751a79d554d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:07.068109 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76176f-4d56-484b-9c2b-ce178c66962f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:07.068784 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76176f-4d56-484b-9c2b-ce178c66962f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:07.069081 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76176f-4d56-484b-9c2b-ce178c66962f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:07.069383 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76176f-4d56-484b-9c2b-ce178c66962f None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:07.070269 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76176f-4d56-484b-9c2b-ce178c66962f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:07.070590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76176f-4d56-484b-9c2b-ce178c66962f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:07.072059 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76176f-4d56-484b-9c2b-ce178c66962f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:07.084050 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:07.087354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 462/913] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:25:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:07.093391 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76176f-4d56-484b-9c2b-ce178c66962f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:07.156618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9106264-94d4-4728-801c-f751a79d554d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:07.197396 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:07.208991 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf2cd8-aa54-4811-9aff-83173035000c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:07.210405 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf2cd8-aa54-4811-9aff-83173035000c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:07.211229 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf2cd8-aa54-4811-9aff-83173035000c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:07.211999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf2cd8-aa54-4811-9aff-83173035000c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:07.212967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf2cd8-aa54-4811-9aff-83173035000c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:07.215418 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf2cd8-aa54-4811-9aff-83173035000c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:07.220130 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76176f-4d56-484b-9c2b-ce178c66962f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:07.230564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-e7bf2cd8-aa54-4811-9aff-83173035000c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:25:07.230564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:07.230564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:25:07.230564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:25:07.230564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:25:07.230564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:25:07.230564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:25:07.230564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:07.230564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:25:07.230564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:07.230564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:25:07.230564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:07.230564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:07.230564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:07.230564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:07.230564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:07.230564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:07.231570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:07.231570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:07.231570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:07.231570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:07.231570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:07.231570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:07.231570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:25:07.231570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:25:07.231570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:25:07.231570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:25:07.231570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:07.231570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:07.231570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:07.231570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:07.231570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:07.231570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:07.232420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:07.232420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:07.232420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:07.232420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:07.232420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:07.232420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:07.232420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:07.232420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:07.232420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:07.232420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:07.232420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:25:07.232420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:07.232420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 15:25:07.232420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:07.240868 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 452/914] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jul 14 15:25:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:25:07.242191 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf2cd8-aa54-4811-9aff-83173035000c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:07.274325 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56c9a7-78ca-4995-8c36-e9eda17589e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:07.275604 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56c9a7-78ca-4995-8c36-e9eda17589e6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:07.276478 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56c9a7-78ca-4995-8c36-e9eda17589e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:07.277204 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56c9a7-78ca-4995-8c36-e9eda17589e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:07.278284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56c9a7-78ca-4995-8c36-e9eda17589e6 None admin] RBAC: Adding query filter params (role.id=98b969f0afd54257a83a07bfcc0cd3e3, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=8103402ac83c4b4191a3ec4d55038e1b) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:07.279083 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56c9a7-78ca-4995-8c36-e9eda17589e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:07.282207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56c9a7-78ca-4995-8c36-e9eda17589e6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:07.290706 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 463/915] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:25:07 2022] GET /identity/v3/role_assignments?user.id=8103402ac83c4b4191a3ec4d55038e1b&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=98b969f0afd54257a83a07bfcc0cd3e3 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:07.382137 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf2cd8-aa54-4811-9aff-83173035000c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:07.390647 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:07.424528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae37eac-69d1-4f61-a86b-aa0db0721b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:07.427864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae37eac-69d1-4f61-a86b-aa0db0721b1c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:07.427864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae37eac-69d1-4f61-a86b-aa0db0721b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:07.427864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae37eac-69d1-4f61-a86b-aa0db0721b1c None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:07.427864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae37eac-69d1-4f61-a86b-aa0db0721b1c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:07.427864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae37eac-69d1-4f61-a86b-aa0db0721b1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:07.428269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae37eac-69d1-4f61-a86b-aa0db0721b1c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:07.434478 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 453/916] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jul 14 15:25:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:07.444112 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56c9a7-78ca-4995-8c36-e9eda17589e6 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:07.557887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56c9a7-78ca-4995-8c36-e9eda17589e6 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:07.596002 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689781a-88b7-4027-bba7-f0e8567408a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:07.597096 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689781a-88b7-4027-bba7-f0e8567408a5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:07.597585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689781a-88b7-4027-bba7-f0e8567408a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:07.598118 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689781a-88b7-4027-bba7-f0e8567408a5 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:07.599051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689781a-88b7-4027-bba7-f0e8567408a5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:07.599563 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689781a-88b7-4027-bba7-f0e8567408a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:07.601136 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689781a-88b7-4027-bba7-f0e8567408a5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:07.607145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 464/917] 10.222.0.39 () {56 vars in 1114 bytes} [Thu Jul 14 15:25:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:07.613137 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae37eac-69d1-4f61-a86b-aa0db0721b1c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:07.724064 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae37eac-69d1-4f61-a86b-aa0db0721b1c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:07.759412 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb58e82-2fab-4f0e-914b-c788b707af9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:07.760068 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb58e82-2fab-4f0e-914b-c788b707af9c None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:07.760348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb58e82-2fab-4f0e-914b-c788b707af9c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:07.760619 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb58e82-2fab-4f0e-914b-c788b707af9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:07.761380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb58e82-2fab-4f0e-914b-c788b707af9c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:07.762783 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb58e82-2fab-4f0e-914b-c788b707af9c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:07.788315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 454/918] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jul 14 15:25:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:25:07.934737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43729c9a-3764-4c16-ba45-1e2c09dfb4a6 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:07.935304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43729c9a-3764-4c16-ba45-1e2c09dfb4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:07.935304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43729c9a-3764-4c16-ba45-1e2c09dfb4a6 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:07.937048 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 465/919] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:07.943453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5456e2-0ccf-4c1d-9f9e-cf8348181f0e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:07.943773 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5456e2-0ccf-4c1d-9f9e-cf8348181f0e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:07.944015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5456e2-0ccf-4c1d-9f9e-cf8348181f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:07.956103 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c234152-dcde-4fa6-8a0d-733c81117beb None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:07.956434 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c234152-dcde-4fa6-8a0d-733c81117beb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:07.956653 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c234152-dcde-4fa6-8a0d-733c81117beb None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:07.958346 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 466/920] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:07.963771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ba3d2-9cf5-4c02-a4f1-69c9bcc4f55d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:07.964065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ba3d2-9cf5-4c02-a4f1-69c9bcc4f55d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:07.964350 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ba3d2-9cf5-4c02-a4f1-69c9bcc4f55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:07.964940 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-bc5456e2-0ccf-4c1d-9f9e-cf8348181f0e None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:07.966217 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bc5456e2-0ccf-4c1d-9f9e-cf8348181f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:07.983075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c37ba3d2-9cf5-4c02-a4f1-69c9bcc4f55d None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:07.984265 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c37ba3d2-9cf5-4c02-a4f1-69c9bcc4f55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:07.987177 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:07.988982 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:08.062526 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 455/921] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:08.073930 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 467/922] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:25:08.087279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5456e2-0ccf-4c1d-9f9e-cf8348181f0e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:08.100561 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ba3d2-9cf5-4c02-a4f1-69c9bcc4f55d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:08.200983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5456e2-0ccf-4c1d-9f9e-cf8348181f0e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:08.230694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ba3d2-9cf5-4c02-a4f1-69c9bcc4f55d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:08.244062 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bb674-1b39-4722-924d-9e876a07e0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:08.244811 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bb674-1b39-4722-924d-9e876a07e0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:08.245129 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bb674-1b39-4722-924d-9e876a07e0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:08.245828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bb674-1b39-4722-924d-9e876a07e0e9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:08.246535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bb674-1b39-4722-924d-9e876a07e0e9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:08.248239 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5bb674-1b39-4722-924d-9e876a07e0e9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:08.264993 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-4e5bb674-1b39-4722-924d-9e876a07e0e9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:25:08.264993 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:08.264993 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:25:08.264993 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:25:08.264993 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:25:08.264993 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:25:08.264993 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:25:08.264993 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:08.264993 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:25:08.264993 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:08.264993 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:25:08.264993 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:08.264993 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:08.264993 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:08.264993 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:08.264993 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:08.266303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:08.266303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:08.266303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:08.266303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:08.266303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:08.266303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:08.266303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:08.266303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:25:08.266303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:25:08.266303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:25:08.266303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:25:08.266303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:08.266303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:08.266303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:08.266303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:08.266303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:08.267194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:08.267194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:08.267194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:08.267194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:08.267194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:08.267194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:08.267194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:08.267194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:08.267194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:08.267194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:08.267194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:08.267194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:25:08.267194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:08.267194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 15:25:08.267194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:08.275078 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 456/923] 10.222.0.39 () {56 vars in 1132 bytes} [Thu Jul 14 15:25:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:08.275833 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bec1c-ac7c-4af0-9341-8cf1066962f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:08.276574 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bb674-1b39-4722-924d-9e876a07e0e9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:08.276697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bec1c-ac7c-4af0-9341-8cf1066962f8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:08.276935 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bec1c-ac7c-4af0-9341-8cf1066962f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:08.277209 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bec1c-ac7c-4af0-9341-8cf1066962f8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:08.277971 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359bec1c-ac7c-4af0-9341-8cf1066962f8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:08.279376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359bec1c-ac7c-4af0-9341-8cf1066962f8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:08.295765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-359bec1c-ac7c-4af0-9341-8cf1066962f8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:25:08.295765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:08.295765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:25:08.295765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:25:08.295765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:25:08.295765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:25:08.295765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:25:08.295765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:08.295765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:25:08.295765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:08.295765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:25:08.295765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:08.295765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:08.295765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:08.295765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:08.295765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:08.295765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:08.297089 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:08.297089 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:08.297089 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:08.297089 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:08.297089 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:08.297089 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:08.297089 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:25:08.297089 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:25:08.297089 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:25:08.297089 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:25:08.297089 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:08.297089 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:08.297089 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:08.297089 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:08.297089 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:08.297089 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:08.298432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:08.298432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:08.298432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:08.298432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:08.298432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:08.298432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:08.298432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:08.298432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:08.298432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:08.298432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:08.298432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:25:08.298432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:08.298432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:25:08.298432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:08.302157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 468/924] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jul 14 15:25:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:25:08.303708 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bec1c-ac7c-4af0-9341-8cf1066962f8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:08.307034 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:08.309089 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:08.431486 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bec1c-ac7c-4af0-9341-8cf1066962f8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:08.435091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5bb674-1b39-4722-924d-9e876a07e0e9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:08.473851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0c4fe-6609-4163-a341-cbc293003da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:08.474604 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0c4fe-6609-4163-a341-cbc293003da1 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:08.474839 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0c4fe-6609-4163-a341-cbc293003da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:08.475116 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0c4fe-6609-4163-a341-cbc293003da1 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:08.475835 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0c4fe-6609-4163-a341-cbc293003da1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:08.476143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0c4fe-6609-4163-a341-cbc293003da1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:08.477257 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06314c8-2b0d-4ae5-9035-d55e23a0ce31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:08.477623 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0c4fe-6609-4163-a341-cbc293003da1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:08.478427 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06314c8-2b0d-4ae5-9035-d55e23a0ce31 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:08.479005 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06314c8-2b0d-4ae5-9035-d55e23a0ce31 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:08.479610 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06314c8-2b0d-4ae5-9035-d55e23a0ce31 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:08.480408 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06314c8-2b0d-4ae5-9035-d55e23a0ce31 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:08.480798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06314c8-2b0d-4ae5-9035-d55e23a0ce31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:08.482425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06314c8-2b0d-4ae5-9035-d55e23a0ce31 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:08.484083 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 457/925] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jul 14 15:25:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:08.490346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0c4fe-6609-4163-a341-cbc293003da1 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:08.493703 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 469/926] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jul 14 15:25:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:08.500471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06314c8-2b0d-4ae5-9035-d55e23a0ce31 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:08.595464 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:08.602645 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:08.629257 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0c4fe-6609-4163-a341-cbc293003da1 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:08.647393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06314c8-2b0d-4ae5-9035-d55e23a0ce31 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:08.678166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab2e58-3d05-43f1-8227-5f7ed473b866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:08.679335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab2e58-3d05-43f1-8227-5f7ed473b866 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:08.680084 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab2e58-3d05-43f1-8227-5f7ed473b866 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:08.680759 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab2e58-3d05-43f1-8227-5f7ed473b866 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:08.681625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab2e58-3d05-43f1-8227-5f7ed473b866 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:08.682382 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab2e58-3d05-43f1-8227-5f7ed473b866 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:08.684536 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab2e58-3d05-43f1-8227-5f7ed473b866 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:08.691553 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 458/927] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jul 14 15:25:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:08.692355 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ecce2-39b8-4b88-8a57-3e947acef282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:08.693129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ecce2-39b8-4b88-8a57-3e947acef282 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:08.693474 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ecce2-39b8-4b88-8a57-3e947acef282 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:08.693812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ecce2-39b8-4b88-8a57-3e947acef282 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:08.698353 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ecce2-39b8-4b88-8a57-3e947acef282 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:08.698353 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ecce2-39b8-4b88-8a57-3e947acef282 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:08.698353 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ecce2-39b8-4b88-8a57-3e947acef282 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:08.698640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab2e58-3d05-43f1-8227-5f7ed473b866 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:08.706044 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 470/928] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jul 14 15:25:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:08.712920 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ecce2-39b8-4b88-8a57-3e947acef282 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:08.825717 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab2e58-3d05-43f1-8227-5f7ed473b866 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:08.849343 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ecce2-39b8-4b88-8a57-3e947acef282 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:08.876371 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950320ba-9bfc-47f1-98a4-6c1d647c0c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:08.877981 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950320ba-9bfc-47f1-98a4-6c1d647c0c64 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:08.878612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950320ba-9bfc-47f1-98a4-6c1d647c0c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:08.879106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950320ba-9bfc-47f1-98a4-6c1d647c0c64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:08.880699 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950320ba-9bfc-47f1-98a4-6c1d647c0c64 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:08.882640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950320ba-9bfc-47f1-98a4-6c1d647c0c64 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:08.883366 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:08.891156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c173120-c416-478c-b2bb-f92782e2774c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:08.891681 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c173120-c416-478c-b2bb-f92782e2774c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:08.891977 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c173120-c416-478c-b2bb-f92782e2774c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:08.892261 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c173120-c416-478c-b2bb-f92782e2774c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:08.893069 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c173120-c416-478c-b2bb-f92782e2774c None admin] RBAC: Adding query filter params (interface=public, service_id=2140cc63163547a699069879f851a8f8, region_id=RegionOne) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:08.893401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c173120-c416-478c-b2bb-f92782e2774c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:08.894934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c173120-c416-478c-b2bb-f92782e2774c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:08.906860 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 471/929] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jul 14 15:25:08 2022] GET /identity/v3/endpoints?service_id=2140cc63163547a699069879f851a8f8&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:08.909947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c173120-c416-478c-b2bb-f92782e2774c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:08.911373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:08.921229 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 459/930] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jul 14 15:25:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:25:09.042798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c173120-c416-478c-b2bb-f92782e2774c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:09.093231 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce6006-270a-4c07-84dc-d2c0d15ff34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:09.094534 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce6006-270a-4c07-84dc-d2c0d15ff34d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:09.094823 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce6006-270a-4c07-84dc-d2c0d15ff34d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:09.095098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce6006-270a-4c07-84dc-d2c0d15ff34d None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:09.095789 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce6006-270a-4c07-84dc-d2c0d15ff34d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:09.098699 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce6006-270a-4c07-84dc-d2c0d15ff34d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:09.104179 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 472/931] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jul 14 15:25:08 2022] GET /identity/v3/services => generated 1497 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:25:09.552265 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363591e-9ee1-4bb6-8464-64a4a51a43a1 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:09.552612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363591e-9ee1-4bb6-8464-64a4a51a43a1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:09.552951 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9363591e-9ee1-4bb6-8464-64a4a51a43a1 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:09.554632 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 460/932] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:09.560099 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626005e-68a6-49c7-9c60-3c0bf916cf5d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:09.560392 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626005e-68a6-49c7-9c60-3c0bf916cf5d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:09.560673 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626005e-68a6-49c7-9c60-3c0bf916cf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:09.579746 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7626005e-68a6-49c7-9c60-3c0bf916cf5d None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:09.581042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7626005e-68a6-49c7-9c60-3c0bf916cf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:09.636793 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:09.662193 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 473/933] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:09.681389 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363591e-9ee1-4bb6-8464-64a4a51a43a1 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:09.799864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9363591e-9ee1-4bb6-8464-64a4a51a43a1 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:09.837948 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81dd87-3e9b-470c-9ee0-7b3e01511ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:09.838903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81dd87-3e9b-470c-9ee0-7b3e01511ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:09.839229 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81dd87-3e9b-470c-9ee0-7b3e01511ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:09.839574 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81dd87-3e9b-470c-9ee0-7b3e01511ad6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:09.854392 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81dd87-3e9b-470c-9ee0-7b3e01511ad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:25:09.864369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ab81dd87-3e9b-470c-9ee0-7b3e01511ad6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:25:09.864369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:09.864369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:09.864369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:09.864369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:09.864369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:09.864369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:09.864369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:09.864369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:09.864369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:09.864369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:09.864369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:09.864369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:25:09.864369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:25:09.864369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:25:09.864369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:25:09.865387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:25:09.865387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:25:09.865387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:25:09.865387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:25:09.865387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:09.865387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:09.865387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:09.865387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:09.865387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:09.865387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:09.865387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:09.865387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:09.865387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:09.865387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:09.865387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:09.865387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:09.866275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:09.866275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:09.866275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:09.866275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:09.866275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:25:09.866275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:25:09.866275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:25:09.866275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:25:09.866275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:25:09.866275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:25:09.866275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:25:09.866275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:09.870184 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 461/934] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jul 14 15:25:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:09.873344 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626005e-68a6-49c7-9c60-3c0bf916cf5d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:09.980533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626005e-68a6-49c7-9c60-3c0bf916cf5d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:10.016363 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e25f7-097c-497b-a8d6-94de4d53a075 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:10.016621 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e25f7-097c-497b-a8d6-94de4d53a075 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:10.018123 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e25f7-097c-497b-a8d6-94de4d53a075 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:10.019095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 462/935] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:10.027978 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac7c7e-706d-4ef0-8d44-1f83ec078559 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:10.028455 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac7c7e-706d-4ef0-8d44-1f83ec078559 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:10.029130 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac7c7e-706d-4ef0-8d44-1f83ec078559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:10.031526 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a262403-4e4e-4863-962f-742cdd7875e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:10.032546 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a262403-4e4e-4863-962f-742cdd7875e8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:10.033011 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a262403-4e4e-4863-962f-742cdd7875e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:10.033450 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a262403-4e4e-4863-962f-742cdd7875e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:10.034781 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a262403-4e4e-4863-962f-742cdd7875e8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:10.035313 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a262403-4e4e-4863-962f-742cdd7875e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:10.037555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a262403-4e4e-4863-962f-742cdd7875e8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:10.052939 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 474/936] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jul 14 15:25:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:10.058412 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-07ac7c7e-706d-4ef0-8d44-1f83ec078559 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:10.060560 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-07ac7c7e-706d-4ef0-8d44-1f83ec078559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:10.061549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a262403-4e4e-4863-962f-742cdd7875e8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:10.132127 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:10.160097 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:10.177213 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 463/937] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:25:10.200470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac7c7e-706d-4ef0-8d44-1f83ec078559 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:10.214061 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a262403-4e4e-4863-962f-742cdd7875e8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:10.257006 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d209390-0620-451a-9002-c4c50af38ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:10.257952 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d209390-0620-451a-9002-c4c50af38ade None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:10.258341 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d209390-0620-451a-9002-c4c50af38ade None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:10.258690 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d209390-0620-451a-9002-c4c50af38ade None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:10.272645 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d209390-0620-451a-9002-c4c50af38ade None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:10.274050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d209390-0620-451a-9002-c4c50af38ade None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:10.295728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-5d209390-0620-451a-9002-c4c50af38ade None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:10.295728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:10.295728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:10.295728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:10.295728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:10.295728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:10.295728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:10.295728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:10.295728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:10.295728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:10.295728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:10.295728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:10.295728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:25:10.295728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:25:10.295728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:25:10.296705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:25:10.296705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:10.296705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:10.296705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:10.296705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:10.296705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:10.296705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:10.296705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:10.296705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:10.296705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:10.296705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:10.296705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:10.296705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:10.296705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:10.296705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:10.296705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:10.296705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:10.297941 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:25:10.297941 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:25:10.297941 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:10.297941 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:10.302474 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 475/938] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:10.303667 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d209390-0620-451a-9002-c4c50af38ade None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:10.336826 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac7c7e-706d-4ef0-8d44-1f83ec078559 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:10.377927 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9f47a-17e9-4de6-92e7-5b08d016f8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:10.378709 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9f47a-17e9-4de6-92e7-5b08d016f8c6 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:10.379122 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9f47a-17e9-4de6-92e7-5b08d016f8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:10.379373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9f47a-17e9-4de6-92e7-5b08d016f8c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:10.380164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9f47a-17e9-4de6-92e7-5b08d016f8c6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:10.382205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9f47a-17e9-4de6-92e7-5b08d016f8c6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:10.383565 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: WARNING keystone.server.flask.common [None req-94d9f47a-17e9-4de6-92e7-5b08d016f8c6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 15:25:10.404604 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.sql.core [None req-94d9f47a-17e9-4de6-92e7-5b08d016f8c6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 15:25:10.404604 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 15:25:10.404604 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [parameters: {'id': 'b45f616ed23f428c8ba202b9a7b10def', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 15:25:10.404604 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80190) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 15:25:10.426142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-94d9f47a-17e9-4de6-92e7-5b08d016f8c6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b45f616ed23f428c8ba202b9a7b10def.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b45f616ed23f428c8ba202b9a7b10def. Jul 14 15:25:10.426142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:10.426142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 15:25:10.426142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 15:25:10.426142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 15:25:10.426142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 15:25:10.426142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 15:25:10.426142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 15:25:10.426142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 15:25:10.426142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application conn.query(q) Jul 14 15:25:10.426142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 15:25:10.426142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 15:25:10.426142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 15:25:10.427067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application result.read() Jul 14 15:25:10.427067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 15:25:10.427067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 15:25:10.427067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 15:25:10.427067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 15:25:10.427067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 15:25:10.427067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 15:25:10.427067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 15:25:10.427067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 15:25:10.427067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 15:25:10.427067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:10.427067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 15:25:10.427067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:10.427067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:10.427067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 15:25:10.427067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 15:25:10.427067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 14 15:25:10.427067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 14 15:25:10.428040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:25:10.428040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:25:10.428040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 15:25:10.428040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application yield resource Jul 14 15:25:10.428040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:25:10.428040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:25:10.428040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 15:25:10.428040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 15:25:10.428040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 15:25:10.428040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 15:25:10.428040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 15:25:10.428040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise self.value Jul 14 15:25:10.428040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 15:25:10.428040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 15:25:10.428040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 15:25:10.428040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application session.commit() Jul 14 15:25:10.428040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 15:25:10.428958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 15:25:10.428958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 15:25:10.428958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 15:25:10.428958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 15:25:10.428958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self.session.flush() Jul 14 15:25:10.428958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 15:25:10.428958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 15:25:10.428958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 15:25:10.428958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 15:25:10.428958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 15:25:10.428958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application compat.raise_( Jul 14 15:25:10.428958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 15:25:10.428958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception Jul 14 15:25:10.428958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 15:25:10.428958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 15:25:10.428958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 15:25:10.428958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 15:25:10.429879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 15:25:10.429879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 15:25:10.429879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 15:25:10.429879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 15:25:10.429879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 15:25:10.429879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 15:25:10.429879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 15:25:10.429879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 15:25:10.429879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 15:25:10.429879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 15:25:10.429879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 15:25:10.429879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 15:25:10.429879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 15:25:10.429879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 15:25:10.429879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 15:25:10.430733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 15:25:10.430733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 15:25:10.430733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception Jul 14 15:25:10.430733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 15:25:10.430733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 15:25:10.430733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 15:25:10.430733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 15:25:10.430733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 15:25:10.430733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 15:25:10.430733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 15:25:10.430733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application conn.query(q) Jul 14 15:25:10.430733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 15:25:10.430733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 15:25:10.430733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 15:25:10.430733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application result.read() Jul 14 15:25:10.430733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 15:25:10.430733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 15:25:10.431622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 15:25:10.431622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 15:25:10.431622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 15:25:10.431622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 15:25:10.431622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 15:25:10.431622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 15:25:10.431622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 15:25:10.431622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 15:25:10.431622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [parameters: {'id': 'b45f616ed23f428c8ba202b9a7b10def', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 15:25:10.431622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 15:25:10.431622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:10.431622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:25:10.431622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:10.431622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:10.431622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 14 15:25:10.432416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 14 15:25:10.432416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 15:25:10.432416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 15:25:10.432416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 14 15:25:10.432416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:10.432416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:25:10.432416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:10.432416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:10.432416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:10.432416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:10.432416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:10.432416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:10.432416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:10.432416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:10.432416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:10.432416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:10.432416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:10.433377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:10.433377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 14 15:25:10.433377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 14 15:25:10.433377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:10.433377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:10.433377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 14 15:25:10.433377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 14 15:25:10.433377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b45f616ed23f428c8ba202b9a7b10def. Jul 14 15:25:10.433377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:10.433377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 464/939] 10.222.0.39 () {60 vars in 1140 bytes} [Thu Jul 14 15:25:10 2022] POST /identity/v3/projects => generated 262 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:25:10.435382 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9f47a-17e9-4de6-92e7-5b08d016f8c6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:10.441252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:10.449561 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d209390-0620-451a-9002-c4c50af38ade None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:10.489959 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c1f48-0331-4078-aea4-a7deadb77f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:10.490737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c1f48-0331-4078-aea4-a7deadb77f6e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:10.491325 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c1f48-0331-4078-aea4-a7deadb77f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:10.491325 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c1f48-0331-4078-aea4-a7deadb77f6e None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:10.492069 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c1f48-0331-4078-aea4-a7deadb77f6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:10.492384 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c1f48-0331-4078-aea4-a7deadb77f6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:10.493834 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c1f48-0331-4078-aea4-a7deadb77f6e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:10.499570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:10.508241 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 476/940] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:10.515199 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c1f48-0331-4078-aea4-a7deadb77f6e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:10.569108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9f47a-17e9-4de6-92e7-5b08d016f8c6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:10.607217 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d87a8e-4b32-4536-b97f-1698ab34789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:10.608363 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d87a8e-4b32-4536-b97f-1698ab34789e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:10.608954 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d87a8e-4b32-4536-b97f-1698ab34789e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:10.609842 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d87a8e-4b32-4536-b97f-1698ab34789e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:10.618036 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d87a8e-4b32-4536-b97f-1698ab34789e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:10.620053 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d87a8e-4b32-4536-b97f-1698ab34789e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:10.623929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c1f48-0331-4078-aea4-a7deadb77f6e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:10.637108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-a4d87a8e-4b32-4536-b97f-1698ab34789e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:25:10.637108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:10.637108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:10.637108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:10.637108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:10.637108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:10.637108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:10.637108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:10.637108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:10.637108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:10.637108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:10.637108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:10.637108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:25:10.637108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:25:10.637108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:25:10.638329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:25:10.638329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:10.638329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:10.638329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:10.638329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:10.638329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:10.638329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:10.638329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:10.638329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:10.638329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:10.638329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:10.638329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:10.638329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:10.638329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:10.638329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:10.638329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:10.638329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:10.639329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:25:10.639329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:25:10.639329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:25:10.639329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:25:10.639329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:25:10.639329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:25:10.639329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:25:10.639329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:10.647749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 465/941] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:25:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:10.649411 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d87a8e-4b32-4536-b97f-1698ab34789e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:10.663766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a0321-c24a-43b3-8f10-16776b2c68da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:10.664737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a0321-c24a-43b3-8f10-16776b2c68da None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:10.665128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a0321-c24a-43b3-8f10-16776b2c68da None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:10.665479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a0321-c24a-43b3-8f10-16776b2c68da None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:10.675023 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a0321-c24a-43b3-8f10-16776b2c68da None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:10.676745 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a0321-c24a-43b3-8f10-16776b2c68da None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:10.694277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-001a0321-c24a-43b3-8f10-16776b2c68da None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:25:10.694277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:10.694277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:10.694277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:10.694277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:10.694277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:10.694277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:10.694277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:10.694277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:10.694277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:10.694277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:10.694277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:10.694277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:25:10.694277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:25:10.694277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:25:10.694277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:25:10.695331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:10.695331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:10.695331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:25:10.695331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:25:10.695331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:25:10.695331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:25:10.695331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:10.695331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:10.695331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:10.695331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:10.695331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:10.695331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:10.695331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:10.695331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:10.695331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:10.695331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:10.695331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:10.695331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:10.696617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:10.696617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:10.696617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:25:10.696617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:25:10.696617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:25:10.696617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:25:10.696617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:25:10.696617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:25:10.696617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:25:10.696617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:10.700660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 477/942] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jul 14 15:25:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:25:10.701705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a0321-c24a-43b3-8f10-16776b2c68da None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:10.723514 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:10.769259 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d87a8e-4b32-4536-b97f-1698ab34789e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:10.778838 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:10.810975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef41d64-4cca-4fb1-9649-1dfb15ac75a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:10.811547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef41d64-4cca-4fb1-9649-1dfb15ac75a6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:10.812305 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef41d64-4cca-4fb1-9649-1dfb15ac75a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:10.812856 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef41d64-4cca-4fb1-9649-1dfb15ac75a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:10.813520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef41d64-4cca-4fb1-9649-1dfb15ac75a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:10.813834 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef41d64-4cca-4fb1-9649-1dfb15ac75a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:10.815413 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef41d64-4cca-4fb1-9649-1dfb15ac75a6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:10.822423 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a0321-c24a-43b3-8f10-16776b2c68da None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:10.846321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 466/943] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jul 14 15:25:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:10.865506 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1a265-9e3d-4c3e-a274-908ad5a4a838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:10.866705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1a265-9e3d-4c3e-a274-908ad5a4a838 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:10.867260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1a265-9e3d-4c3e-a274-908ad5a4a838 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:10.867765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1a265-9e3d-4c3e-a274-908ad5a4a838 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:10.868870 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1a265-9e3d-4c3e-a274-908ad5a4a838 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:10.869418 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1a265-9e3d-4c3e-a274-908ad5a4a838 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:10.871182 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b1a265-9e3d-4c3e-a274-908ad5a4a838 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:10.895471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 478/944] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jul 14 15:25:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:10.901688 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef41d64-4cca-4fb1-9649-1dfb15ac75a6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:11.033021 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef41d64-4cca-4fb1-9649-1dfb15ac75a6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:11.074703 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304d671-219d-4fde-8403-5d1a2b248610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:11.075508 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304d671-219d-4fde-8403-5d1a2b248610 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:11.075861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304d671-219d-4fde-8403-5d1a2b248610 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:11.076136 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304d671-219d-4fde-8403-5d1a2b248610 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:11.090719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304d671-219d-4fde-8403-5d1a2b248610 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:11.092581 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304d671-219d-4fde-8403-5d1a2b248610 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:11.116725 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-7304d671-219d-4fde-8403-5d1a2b248610 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:11.116725 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:11.116725 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:11.116725 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:11.116725 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:11.116725 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:11.116725 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:11.116725 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:11.116725 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:11.116725 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:11.116725 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:11.116725 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:11.116725 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:25:11.116725 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:25:11.116725 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:25:11.118445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:25:11.118445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:11.118445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:11.118445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:11.118445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:11.118445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:11.118445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:11.118445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:11.118445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:11.118445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:11.118445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:11.118445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:11.118445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:11.118445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:11.118445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:11.118445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:11.118445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:11.119818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:25:11.119818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:25:11.119818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:11.119818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:11.119818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 467/945] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:11.127751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1a265-9e3d-4c3e-a274-908ad5a4a838 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:11.220364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:11.245511 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02573c57-34a9-4781-870a-cd8e77df79c5 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:11.245868 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02573c57-34a9-4781-870a-cd8e77df79c5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:11.246178 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02573c57-34a9-4781-870a-cd8e77df79c5 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:11.246287 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b1a265-9e3d-4c3e-a274-908ad5a4a838 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:11.247965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 468/946] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:11.254548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7353a-8851-40d3-afaf-7ceae9bff4fa None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:11.254894 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7353a-8851-40d3-afaf-7ceae9bff4fa None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:11.255176 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7353a-8851-40d3-afaf-7ceae9bff4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:11.274717 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-afe7353a-8851-40d3-afaf-7ceae9bff4fa None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:11.276432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-afe7353a-8851-40d3-afaf-7ceae9bff4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:11.286437 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe42a6-f94f-46a1-82c3-ffb17591318a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:11.287032 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe42a6-f94f-46a1-82c3-ffb17591318a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:11.287317 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe42a6-f94f-46a1-82c3-ffb17591318a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:11.287595 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe42a6-f94f-46a1-82c3-ffb17591318a None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:11.288320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe42a6-f94f-46a1-82c3-ffb17591318a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:11.288630 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe42a6-f94f-46a1-82c3-ffb17591318a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:11.290007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe42a6-f94f-46a1-82c3-ffb17591318a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:11.292521 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:11.308647 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 479/947] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:11.310097 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe42a6-f94f-46a1-82c3-ffb17591318a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:11.366095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 469/948] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:25:11.366095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662b10f-c578-497e-9f34-bf52bbd77200 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:11.366095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662b10f-c578-497e-9f34-bf52bbd77200 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:11.366095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662b10f-c578-497e-9f34-bf52bbd77200 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:11.367478 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 470/949] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:11.372995 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a3fdf-63ac-45a2-984c-047b1a5ac80b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:11.373287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a3fdf-63ac-45a2-984c-047b1a5ac80b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:11.373569 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a3fdf-63ac-45a2-984c-047b1a5ac80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:11.392528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8f2a3fdf-63ac-45a2-984c-047b1a5ac80b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:11.393794 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8f2a3fdf-63ac-45a2-984c-047b1a5ac80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:11.424155 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe42a6-f94f-46a1-82c3-ffb17591318a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:11.463600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e29eb-ceb2-4a48-b53b-458ba38535fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:11.464366 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e29eb-ceb2-4a48-b53b-458ba38535fc None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:11.464655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e29eb-ceb2-4a48-b53b-458ba38535fc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:11.464938 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e29eb-ceb2-4a48-b53b-458ba38535fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:11.469533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:11.475506 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e29eb-ceb2-4a48-b53b-458ba38535fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:11.477239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e29eb-ceb2-4a48-b53b-458ba38535fc None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:11.486387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 471/950] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:11.486387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a3fdf-63ac-45a2-984c-047b1a5ac80b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:11.496865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-871e29eb-ceb2-4a48-b53b-458ba38535fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:25:11.496865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:11.496865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:11.496865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:11.496865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:11.496865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:11.496865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:11.496865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:11.496865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:11.496865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:11.496865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:11.496865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:11.496865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:25:11.496865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:25:11.496865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:25:11.497786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:25:11.497786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:11.497786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:11.497786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:11.497786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:11.497786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:11.497786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:11.497786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:11.497786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:11.497786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:11.497786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:11.497786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:11.497786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:11.497786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:11.497786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:11.497786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:11.497786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:11.498725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:25:11.498725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:25:11.498725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:25:11.498725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:25:11.498725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:25:11.498725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:25:11.498725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:25:11.498725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:11.501395 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 480/951] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:25:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:25:11.508173 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e29eb-ceb2-4a48-b53b-458ba38535fc None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:11.576594 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:11.603624 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a3fdf-63ac-45a2-984c-047b1a5ac80b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:11.620406 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e29eb-ceb2-4a48-b53b-458ba38535fc None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:11.647055 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48aec8-4775-40c6-a289-25e367971945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:11.647861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48aec8-4775-40c6-a289-25e367971945 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:11.648144 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48aec8-4775-40c6-a289-25e367971945 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:11.648419 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48aec8-4775-40c6-a289-25e367971945 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:11.649074 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48aec8-4775-40c6-a289-25e367971945 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:11.650503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48aec8-4775-40c6-a289-25e367971945 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:11.660098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3264d-917e-4cfd-8867-df6c5a1865d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:11.660899 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3264d-917e-4cfd-8867-df6c5a1865d8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:11.661178 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3264d-917e-4cfd-8867-df6c5a1865d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:11.661453 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3264d-917e-4cfd-8867-df6c5a1865d8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:11.662130 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3264d-917e-4cfd-8867-df6c5a1865d8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:11.663487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3264d-917e-4cfd-8867-df6c5a1865d8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:11.663852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ca48aec8-4775-40c6-a289-25e367971945 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:25:11.663852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:11.663852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:25:11.663852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:25:11.663852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:25:11.663852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:25:11.663852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:25:11.663852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:11.663852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:25:11.663852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:11.663852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:25:11.663852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:11.663852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:11.663852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:11.663852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:11.663852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:11.663852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:11.664822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:11.664822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:11.664822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:11.664822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:11.664822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:11.664822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:11.664822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:25:11.664822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:25:11.664822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:25:11.664822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:25:11.664822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:11.664822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:11.664822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:11.664822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:11.664822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:11.664822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:11.665975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:11.665975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:11.665975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:11.665975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:11.665975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:11.665975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:11.665975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:11.665975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:11.665975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:11.665975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:11.665975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:25:11.665975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:11.665975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:25:11.665975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:11.665975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 472/952] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:25:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:11.666905 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48aec8-4775-40c6-a289-25e367971945 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:11.681881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-5de3264d-917e-4cfd-8867-df6c5a1865d8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:25:11.681881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:11.681881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:25:11.681881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:25:11.681881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:25:11.681881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:25:11.681881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:25:11.681881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:11.681881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:25:11.681881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:11.681881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:25:11.681881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:11.681881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:11.681881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:11.681881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:11.681881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:11.681881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:11.683457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:11.683457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:11.683457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:11.683457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:11.683457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:11.683457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:11.683457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:25:11.683457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:25:11.683457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:25:11.683457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:25:11.683457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:11.683457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:11.683457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:11.683457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:11.683457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:11.683457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:11.684390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:11.684390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:11.684390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:11.684390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:11.684390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:11.684390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:11.684390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:11.684390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:11.684390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:11.684390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:11.684390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:25:11.684390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:11.684390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:25:11.684390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:11.684390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 481/953] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jul 14 15:25:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:25:11.685300 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3264d-917e-4cfd-8867-df6c5a1865d8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:11.757876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:11.789365 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48aec8-4775-40c6-a289-25e367971945 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:11.808689 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3264d-917e-4cfd-8867-df6c5a1865d8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:11.824486 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc932e7-5a30-449e-a609-3c8eb921d40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:11.825152 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc932e7-5a30-449e-a609-3c8eb921d40f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:11.825440 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc932e7-5a30-449e-a609-3c8eb921d40f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:11.825718 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc932e7-5a30-449e-a609-3c8eb921d40f None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:11.826540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc932e7-5a30-449e-a609-3c8eb921d40f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:11.826915 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc932e7-5a30-449e-a609-3c8eb921d40f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:11.828368 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc932e7-5a30-449e-a609-3c8eb921d40f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:11.847090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 473/954] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:25:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:11.847090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc932e7-5a30-449e-a609-3c8eb921d40f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:11.851339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:11.855394 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57abff-8af4-4d39-a357-02817a9312c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:11.856085 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57abff-8af4-4d39-a357-02817a9312c7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:11.856432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57abff-8af4-4d39-a357-02817a9312c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:11.856791 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57abff-8af4-4d39-a357-02817a9312c7 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:11.857584 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57abff-8af4-4d39-a357-02817a9312c7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:11.857953 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57abff-8af4-4d39-a357-02817a9312c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:11.860141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57abff-8af4-4d39-a357-02817a9312c7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:11.866247 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 482/955] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jul 14 15:25:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:11.871562 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57abff-8af4-4d39-a357-02817a9312c7 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:11.973392 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc932e7-5a30-449e-a609-3c8eb921d40f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:11.986324 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57abff-8af4-4d39-a357-02817a9312c7 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:12.013580 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:12.015259 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8a626-f8ff-4738-8d11-33fb9665e7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:12.016348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8a626-f8ff-4738-8d11-33fb9665e7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:12.016792 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8a626-f8ff-4738-8d11-33fb9665e7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:12.017072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8a626-f8ff-4738-8d11-33fb9665e7e0 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:12.017844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8a626-f8ff-4738-8d11-33fb9665e7e0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:12.018191 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8a626-f8ff-4738-8d11-33fb9665e7e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:12.019606 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8a626-f8ff-4738-8d11-33fb9665e7e0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:12.025780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 474/956] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jul 14 15:25:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:12.026663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8a626-f8ff-4738-8d11-33fb9665e7e0 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:12.034155 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44874841-6fc8-4971-942f-192cabd76d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:12.035080 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44874841-6fc8-4971-942f-192cabd76d7d None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:12.035492 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44874841-6fc8-4971-942f-192cabd76d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:12.035785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44874841-6fc8-4971-942f-192cabd76d7d None admin] PATH_INFO: `/v3/projects/ba19b660ef1442289fb322231ce26f07/users/8103402ac83c4b4191a3ec4d55038e1b/roles/98b969f0afd54257a83a07bfcc0cd3e3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:12.038157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44874841-6fc8-4971-942f-192cabd76d7d None admin] RBAC: Authorizing `identity:create_grant(project_id=ba19b660ef1442289fb322231ce26f07, user_id=8103402ac83c4b4191a3ec4d55038e1b, role_id=98b969f0afd54257a83a07bfcc0cd3e3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:12.039718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44874841-6fc8-4971-942f-192cabd76d7d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:12.057200 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 483/957] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:25:11 2022] PUT /identity/v3/projects/ba19b660ef1442289fb322231ce26f07/users/8103402ac83c4b4191a3ec4d55038e1b/roles/98b969f0afd54257a83a07bfcc0cd3e3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:25:12.058419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44874841-6fc8-4971-942f-192cabd76d7d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:12.119830 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:12.176757 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8a626-f8ff-4738-8d11-33fb9665e7e0 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:12.221211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44874841-6fc8-4971-942f-192cabd76d7d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:12.243341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b7135-cb8c-4c49-9ca7-b38029e894ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:12.244215 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b7135-cb8c-4c49-9ca7-b38029e894ed None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:12.244496 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b7135-cb8c-4c49-9ca7-b38029e894ed None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:12.244841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b7135-cb8c-4c49-9ca7-b38029e894ed None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:12.245723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b7135-cb8c-4c49-9ca7-b38029e894ed None admin] RBAC: Adding query filter params (type=compute) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:12.246039 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b7135-cb8c-4c49-9ca7-b38029e894ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:12.249467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b7135-cb8c-4c49-9ca7-b38029e894ed None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:12.257241 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 475/958] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jul 14 15:25:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:12.276362 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a975d2-dd40-41c7-bf98-ef06ec99348d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:12.277125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a975d2-dd40-41c7-bf98-ef06ec99348d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:12.277418 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a975d2-dd40-41c7-bf98-ef06ec99348d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:12.277699 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a975d2-dd40-41c7-bf98-ef06ec99348d None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:12.278499 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a975d2-dd40-41c7-bf98-ef06ec99348d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:12.279105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a975d2-dd40-41c7-bf98-ef06ec99348d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:12.280609 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a975d2-dd40-41c7-bf98-ef06ec99348d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:12.288811 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 484/959] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jul 14 15:25:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:12.294353 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b7135-cb8c-4c49-9ca7-b38029e894ed None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:12.420205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b7135-cb8c-4c49-9ca7-b38029e894ed None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:12.456262 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:12.465004 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfa1f9-6056-4d35-83e7-f35b3703ed31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:12.465678 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfa1f9-6056-4d35-83e7-f35b3703ed31 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:12.465964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfa1f9-6056-4d35-83e7-f35b3703ed31 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:12.466274 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfa1f9-6056-4d35-83e7-f35b3703ed31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:12.467039 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfa1f9-6056-4d35-83e7-f35b3703ed31 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:12.468421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfa1f9-6056-4d35-83e7-f35b3703ed31 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:12.495444 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 476/960] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jul 14 15:25:12 2022] POST /identity/v3/endpoints => generated 349 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:25:13.167670 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92c805-f1b7-43e8-bd30-373e725f12ca None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:13.168052 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92c805-f1b7-43e8-bd30-373e725f12ca None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:13.168232 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92c805-f1b7-43e8-bd30-373e725f12ca None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:13.169747 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 485/961] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:13.177601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fec31-228f-4955-a797-77cbe346c878 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:13.178146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fec31-228f-4955-a797-77cbe346c878 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:13.178256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fec31-228f-4955-a797-77cbe346c878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:13.195467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-761fec31-228f-4955-a797-77cbe346c878 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:13.196843 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-761fec31-228f-4955-a797-77cbe346c878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:13.276637 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 477/962] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:13.302788 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92c805-f1b7-43e8-bd30-373e725f12ca None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:13.370307 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:13.434098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92c805-f1b7-43e8-bd30-373e725f12ca None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:13.471793 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fe6e7-8ab3-48a9-8b75-40a0d3f8d823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:13.472486 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fe6e7-8ab3-48a9-8b75-40a0d3f8d823 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:13.472776 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fe6e7-8ab3-48a9-8b75-40a0d3f8d823 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:13.473058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fe6e7-8ab3-48a9-8b75-40a0d3f8d823 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:13.473780 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fe6e7-8ab3-48a9-8b75-40a0d3f8d823 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:13.475285 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fe6e7-8ab3-48a9-8b75-40a0d3f8d823 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:13.476627 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: WARNING keystone.server.flask.common [None req-668fe6e7-8ab3-48a9-8b75-40a0d3f8d823 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 15:25:13.489900 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.sql.core [None req-668fe6e7-8ab3-48a9-8b75-40a0d3f8d823 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 15:25:13.489900 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 15:25:13.489900 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [parameters: {'user_id': 'c8f073d2b186419cab6196c632774033', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 15:25:13.489900 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80191) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 15:25:13.498224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-668fe6e7-8ab3-48a9-8b75-40a0d3f8d823 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 15:25:13.498224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:13.498224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 15:25:13.498224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 15:25:13.498224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 15:25:13.498224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 15:25:13.498224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 15:25:13.498224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 15:25:13.498224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 15:25:13.498224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application conn.query(q) Jul 14 15:25:13.498224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 15:25:13.498224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 15:25:13.498224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 15:25:13.498224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application result.read() Jul 14 15:25:13.498224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 15:25:13.499191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 15:25:13.499191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 15:25:13.499191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 15:25:13.499191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 15:25:13.499191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 15:25:13.499191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 15:25:13.499191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 15:25:13.499191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 15:25:13.499191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:13.499191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 15:25:13.499191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:13.499191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:13.499191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 15:25:13.499191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 15:25:13.499191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 14 15:25:13.499191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 14 15:25:13.499191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:25:13.499191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:25:13.501367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 15:25:13.501367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application yield resource Jul 14 15:25:13.501367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 15:25:13.501367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application next(self.gen) Jul 14 15:25:13.501367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 15:25:13.501367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 15:25:13.501367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 15:25:13.501367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 15:25:13.501367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 15:25:13.501367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise self.value Jul 14 15:25:13.501367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 15:25:13.501367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 15:25:13.501367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 15:25:13.501367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application session.commit() Jul 14 15:25:13.501367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 15:25:13.501367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 15:25:13.501367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 15:25:13.502340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 15:25:13.502340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 15:25:13.502340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.session.flush() Jul 14 15:25:13.502340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 15:25:13.502340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 15:25:13.502340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 15:25:13.502340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 15:25:13.502340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 15:25:13.502340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application compat.raise_( Jul 14 15:25:13.502340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 15:25:13.502340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception Jul 14 15:25:13.502340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 15:25:13.502340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 15:25:13.502340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 15:25:13.502340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 15:25:13.502340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 15:25:13.502340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 15:25:13.503336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 15:25:13.503336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 15:25:13.503336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 14 15:25:13.503336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 14 15:25:13.503336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 15:25:13.503336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 15:25:13.503336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 15:25:13.503336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 15:25:13.503336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 15:25:13.503336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 15:25:13.503336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 15:25:13.503336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 15:25:13.503336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 15:25:13.503336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 15:25:13.503336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 15:25:13.503336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception Jul 14 15:25:13.504216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 15:25:13.504216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 15:25:13.504216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 15:25:13.504216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 15:25:13.504216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 15:25:13.504216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 15:25:13.504216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 15:25:13.504216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application conn.query(q) Jul 14 15:25:13.504216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 15:25:13.504216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 15:25:13.504216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 15:25:13.504216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application result.read() Jul 14 15:25:13.504216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 15:25:13.504216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 15:25:13.504216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 15:25:13.504216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 15:25:13.505092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 15:25:13.505092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 15:25:13.505092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 15:25:13.505092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 15:25:13.505092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 15:25:13.505092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 15:25:13.505092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c8f073d2b186419cab6196c632774033', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 15:25:13.505092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 15:25:13.505092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:13.505092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:25:13.505092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:13.505092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:13.505092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:13.505092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:13.505092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:13.505908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:13.505908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:13.505908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:13.505908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:13.505908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:13.505908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:13.505908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:13.505908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 14 15:25:13.505908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 14 15:25:13.505908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:13.505908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:13.505908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:25:13.505908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:25:13.505908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:25:13.505908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:25:13.505908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 14 15:25:13.505908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 14 15:25:13.513279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 14 15:25:13.513279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 14 15:25:13.513279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 15:25:13.513279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 15:25:13.513279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 15:25:13.513279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:13.513279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 486/963] 10.222.0.39 () {60 vars in 1131 bytes} [Thu Jul 14 15:25:13 2022] POST /identity/v3/users => generated 160 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:13.517098 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fec31-228f-4955-a797-77cbe346c878 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:13.641683 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fec31-228f-4955-a797-77cbe346c878 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:13.660925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:13.691277 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7908e6c-3650-47f6-ac41-e8f14fac89f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:13.692067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7908e6c-3650-47f6-ac41-e8f14fac89f0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:13.692355 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7908e6c-3650-47f6-ac41-e8f14fac89f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:13.692633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7908e6c-3650-47f6-ac41-e8f14fac89f0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:13.705617 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7908e6c-3650-47f6-ac41-e8f14fac89f0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:13.707267 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7908e6c-3650-47f6-ac41-e8f14fac89f0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:13.725260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-d7908e6c-3650-47f6-ac41-e8f14fac89f0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:25:13.725260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:13.725260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:13.725260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:13.725260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:13.725260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:13.725260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:13.725260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:13.725260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:13.725260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:13.725260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:13.725260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:13.725260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:25:13.725260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:25:13.725260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:25:13.725260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:25:13.728357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:13.728357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:13.728357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:25:13.728357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:25:13.728357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:25:13.728357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:25:13.728357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:13.728357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:13.728357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:13.728357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:13.728357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:13.728357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:13.728357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:13.728357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:13.728357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:13.728357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:13.728357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:13.728357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:13.730297 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:13.730297 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:13.730297 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:25:13.730297 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:25:13.730297 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:25:13.730297 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:25:13.730297 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:25:13.730297 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:25:13.730297 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 15:25:13.730297 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:13.730297 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 478/964] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:25:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:13.741104 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fe6e7-8ab3-48a9-8b75-40a0d3f8d823 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:13.873825 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fe6e7-8ab3-48a9-8b75-40a0d3f8d823 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:13.891887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:13.919488 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7a8ec-c172-44f6-8b74-ba1350bd7ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:13.920178 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7a8ec-c172-44f6-8b74-ba1350bd7ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:13.920466 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7a8ec-c172-44f6-8b74-ba1350bd7ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:13.920747 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7a8ec-c172-44f6-8b74-ba1350bd7ab0 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:13.921641 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7a8ec-c172-44f6-8b74-ba1350bd7ab0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:13.923109 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7a8ec-c172-44f6-8b74-ba1350bd7ab0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:13.925031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7a8ec-c172-44f6-8b74-ba1350bd7ab0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:13.970662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 487/965] 10.222.0.39 () {56 vars in 1101 bytes} [Thu Jul 14 15:25:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:14.427137 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462794b6-26df-4dc4-b273-a5dea117fc02 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:14.427137 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462794b6-26df-4dc4-b273-a5dea117fc02 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:14.427137 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462794b6-26df-4dc4-b273-a5dea117fc02 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:14.427810 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 479/966] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:14.432829 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad92f76-377e-4fe5-9153-bf7340bf12a5 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:14.433228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad92f76-377e-4fe5-9153-bf7340bf12a5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:14.433401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad92f76-377e-4fe5-9153-bf7340bf12a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:14.452086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-dad92f76-377e-4fe5-9153-bf7340bf12a5 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:14.453918 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dad92f76-377e-4fe5-9153-bf7340bf12a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:14.529160 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 488/967] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:14.535675 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad1df9-56e3-4d49-82fc-4d1141c1139e None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:14.535969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad1df9-56e3-4d49-82fc-4d1141c1139e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:14.536252 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad1df9-56e3-4d49-82fc-4d1141c1139e None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:14.537626 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 480/968] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:14.543146 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e24b5-34e8-4ac0-ba1e-aa5cf091bfd4 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:14.543446 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e24b5-34e8-4ac0-ba1e-aa5cf091bfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:14.543732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e24b5-34e8-4ac0-ba1e-aa5cf091bfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:14.555328 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad1df9-56e3-4d49-82fc-4d1141c1139e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:14.564991 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-996e24b5-34e8-4ac0-ba1e-aa5cf091bfd4 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:14.566251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-996e24b5-34e8-4ac0-ba1e-aa5cf091bfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:14.646644 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 489/969] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:14.669184 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e24b5-34e8-4ac0-ba1e-aa5cf091bfd4 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:14.681213 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad1df9-56e3-4d49-82fc-4d1141c1139e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:14.702005 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:14.721790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7ec6c-0e9c-4542-85a4-c6ae57c8af94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:14.722646 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7ec6c-0e9c-4542-85a4-c6ae57c8af94 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:14.722929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7ec6c-0e9c-4542-85a4-c6ae57c8af94 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:14.723208 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7ec6c-0e9c-4542-85a4-c6ae57c8af94 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:14.734043 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7ec6c-0e9c-4542-85a4-c6ae57c8af94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:25:14.743468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-eaa7ec6c-0e9c-4542-85a4-c6ae57c8af94 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:25:14.743468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:14.743468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:14.743468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:14.743468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:14.743468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:14.743468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:14.743468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:14.743468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:14.743468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:14.743468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:14.743468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:14.743468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:25:14.743468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:25:14.743468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:25:14.743468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:25:14.744453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:25:14.744453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:25:14.744453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:25:14.744453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:25:14.744453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:14.744453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:14.744453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:14.744453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:14.744453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:14.744453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:14.744453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:14.744453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:14.744453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:14.744453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:14.744453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:14.744453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:14.745293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:14.745293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:14.745293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:14.745293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:14.745293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:25:14.745293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:25:14.745293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:25:14.745293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:25:14.745293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:25:14.745293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:25:14.745293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:25:14.745293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:14.745293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 481/970] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jul 14 15:25:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:25:14.748144 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500e12a-46cb-4776-8eba-df05f20bdcce None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:14.748438 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500e12a-46cb-4776-8eba-df05f20bdcce None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:14.748871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500e12a-46cb-4776-8eba-df05f20bdcce None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:14.752875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 482/971] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:14.753743 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500e12a-46cb-4776-8eba-df05f20bdcce None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:14.786541 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e24b5-34e8-4ac0-ba1e-aa5cf091bfd4 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:14.787905 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:14.827279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337ed84-2882-4627-af5a-6b2e4ae9960f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:14.827962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337ed84-2882-4627-af5a-6b2e4ae9960f None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:14.828310 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337ed84-2882-4627-af5a-6b2e4ae9960f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:14.828585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337ed84-2882-4627-af5a-6b2e4ae9960f None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:14.829539 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337ed84-2882-4627-af5a-6b2e4ae9960f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:14.830996 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337ed84-2882-4627-af5a-6b2e4ae9960f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:14.852267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 490/972] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jul 14 15:25:14 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:25:14.853695 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf79674-a2af-47ae-8d64-0da403d869aa None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:14.853992 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf79674-a2af-47ae-8d64-0da403d869aa None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:14.854460 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf79674-a2af-47ae-8d64-0da403d869aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:14.874042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-edf79674-a2af-47ae-8d64-0da403d869aa None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:14.875618 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-edf79674-a2af-47ae-8d64-0da403d869aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:14.897223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500e12a-46cb-4776-8eba-df05f20bdcce None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:14.943391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a437eb-271b-4a32-8fe3-666c2644df4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:14.944000 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a437eb-271b-4a32-8fe3-666c2644df4f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:14.944289 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a437eb-271b-4a32-8fe3-666c2644df4f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:14.944571 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a437eb-271b-4a32-8fe3-666c2644df4f None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:14.945356 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a437eb-271b-4a32-8fe3-666c2644df4f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:14.945672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a437eb-271b-4a32-8fe3-666c2644df4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:14.947142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a437eb-271b-4a32-8fe3-666c2644df4f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:14.957690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 483/973] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jul 14 15:25:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:14.963378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a437eb-271b-4a32-8fe3-666c2644df4f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:14.971146 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 491/974] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:14.995865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf79674-a2af-47ae-8d64-0da403d869aa None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:15.021257 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:15.079540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:15.091528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a437eb-271b-4a32-8fe3-666c2644df4f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:15.119159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf79674-a2af-47ae-8d64-0da403d869aa None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:15.130925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742bd93-90ee-4ce1-901a-dbf66b1764c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:15.131726 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742bd93-90ee-4ce1-901a-dbf66b1764c9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:15.132014 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742bd93-90ee-4ce1-901a-dbf66b1764c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:15.132295 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742bd93-90ee-4ce1-901a-dbf66b1764c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:15.145761 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742bd93-90ee-4ce1-901a-dbf66b1764c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:15.147646 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742bd93-90ee-4ce1-901a-dbf66b1764c9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:15.155188 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004294a6-cea5-4126-996b-37da8a5f56dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:15.156084 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004294a6-cea5-4126-996b-37da8a5f56dc None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:15.156526 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004294a6-cea5-4126-996b-37da8a5f56dc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:15.157258 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004294a6-cea5-4126-996b-37da8a5f56dc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:15.158213 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004294a6-cea5-4126-996b-37da8a5f56dc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:15.160448 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004294a6-cea5-4126-996b-37da8a5f56dc None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:15.169039 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-7742bd93-90ee-4ce1-901a-dbf66b1764c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:15.169039 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:15.169039 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:15.169039 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:15.169039 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:15.169039 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:15.169039 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:15.169039 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:15.169039 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:15.169039 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:15.169039 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:15.169039 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:15.169039 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:25:15.169039 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:25:15.169039 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:25:15.169965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:25:15.169965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:15.169965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:15.169965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:15.169965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:15.169965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:15.169965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:15.169965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:15.169965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:15.169965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:15.169965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:15.169965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:15.169965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:15.169965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:15.169965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:15.169965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:15.169965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:15.170949 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:25:15.170949 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:25:15.170949 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:15.170949 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:15.174583 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 484/975] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:25:15.175711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-004294a6-cea5-4126-996b-37da8a5f56dc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:25:15.175711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:15.175711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:25:15.175711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:25:15.175711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:25:15.175711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:25:15.175711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:25:15.175711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:15.175711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:25:15.175711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:15.175711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:25:15.175711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:15.175711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:15.175711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:15.175711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:15.175711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:15.175711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:15.179683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:15.179683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:15.179683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:15.179683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:15.179683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:15.179683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:15.179683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:25:15.179683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:25:15.179683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:25:15.179683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:25:15.179683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:15.179683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:15.179683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:15.179683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:15.179683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:15.179683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:15.184924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:15.184924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:15.184924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:15.184924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:15.184924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:15.184924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:15.184924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:15.184924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:15.184924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:15.184924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:15.184924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:25:15.184924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:15.184924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:25:15.184924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:15.192346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742bd93-90ee-4ce1-901a-dbf66b1764c9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:15.192605 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 492/976] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jul 14 15:25:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:25:15.192605 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004294a6-cea5-4126-996b-37da8a5f56dc None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:15.274816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:15.296097 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004294a6-cea5-4126-996b-37da8a5f56dc None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:15.302136 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742bd93-90ee-4ce1-901a-dbf66b1764c9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:15.335035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972bcc0-28d3-4a01-a923-7f6ec2abe936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:15.336060 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972bcc0-28d3-4a01-a923-7f6ec2abe936 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:15.336518 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972bcc0-28d3-4a01-a923-7f6ec2abe936 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:15.336810 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972bcc0-28d3-4a01-a923-7f6ec2abe936 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:15.337549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972bcc0-28d3-4a01-a923-7f6ec2abe936 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:15.337814 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972bcc0-28d3-4a01-a923-7f6ec2abe936 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:15.339238 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972bcc0-28d3-4a01-a923-7f6ec2abe936 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:15.341275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92271f-4842-4f59-9ea0-9de8bc39eefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:15.341939 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92271f-4842-4f59-9ea0-9de8bc39eefa None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:15.342259 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92271f-4842-4f59-9ea0-9de8bc39eefa None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:15.342540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92271f-4842-4f59-9ea0-9de8bc39eefa None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:15.343323 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92271f-4842-4f59-9ea0-9de8bc39eefa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:15.343769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92271f-4842-4f59-9ea0-9de8bc39eefa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:15.345229 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 493/977] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jul 14 15:25:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:15.345578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92271f-4842-4f59-9ea0-9de8bc39eefa None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:15.350997 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972bcc0-28d3-4a01-a923-7f6ec2abe936 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:15.364371 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 485/978] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:15.365261 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92271f-4842-4f59-9ea0-9de8bc39eefa None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:15.368223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:15.484668 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92271f-4842-4f59-9ea0-9de8bc39eefa None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:15.492781 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972bcc0-28d3-4a01-a923-7f6ec2abe936 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:15.527888 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88108e5-1d01-4516-a003-9cfda30677b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:15.528604 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88108e5-1d01-4516-a003-9cfda30677b9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:15.528919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88108e5-1d01-4516-a003-9cfda30677b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:15.529152 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88108e5-1d01-4516-a003-9cfda30677b9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:15.532441 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec2659-c49e-4ecc-83c1-b72eca6700b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:15.533209 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec2659-c49e-4ecc-83c1-b72eca6700b5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:15.533495 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec2659-c49e-4ecc-83c1-b72eca6700b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:15.533776 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec2659-c49e-4ecc-83c1-b72eca6700b5 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:15.534517 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec2659-c49e-4ecc-83c1-b72eca6700b5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:15.534826 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec2659-c49e-4ecc-83c1-b72eca6700b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:15.536208 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec2659-c49e-4ecc-83c1-b72eca6700b5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:15.539143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88108e5-1d01-4516-a003-9cfda30677b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:15.540805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88108e5-1d01-4516-a003-9cfda30677b9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:15.541315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 494/979] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jul 14 15:25:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:15.547740 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec2659-c49e-4ecc-83c1-b72eca6700b5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:15.558160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f88108e5-1d01-4516-a003-9cfda30677b9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:25:15.558160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:15.558160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:15.558160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:15.558160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:15.558160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:15.558160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:15.558160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:15.558160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:15.558160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:15.558160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:15.558160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:15.558160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:25:15.558160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:25:15.558160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:25:15.558160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:25:15.559287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:15.559287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:15.559287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:25:15.559287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:25:15.559287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:25:15.559287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:25:15.559287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:15.559287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:15.559287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:15.559287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:15.559287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:15.559287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:15.559287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:15.559287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:15.559287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:15.559287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:15.559287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:15.559287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:15.566197 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:15.566197 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:15.566197 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:25:15.566197 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:25:15.566197 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:25:15.566197 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:25:15.566197 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:25:15.566197 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:25:15.566197 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 14 15:25:15.566197 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:15.566197 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 486/980] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jul 14 15:25:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:25:15.566850 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88108e5-1d01-4516-a003-9cfda30677b9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:15.569535 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:15.636209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:15.679722 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88108e5-1d01-4516-a003-9cfda30677b9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:15.699361 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec2659-c49e-4ecc-83c1-b72eca6700b5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:15.717543 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0400ce-4378-4d1e-b72a-04eaa2c24f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:15.718249 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0400ce-4378-4d1e-b72a-04eaa2c24f22 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:15.718536 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0400ce-4378-4d1e-b72a-04eaa2c24f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:15.719510 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0400ce-4378-4d1e-b72a-04eaa2c24f22 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:15.720154 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0400ce-4378-4d1e-b72a-04eaa2c24f22 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:15.720461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0400ce-4378-4d1e-b72a-04eaa2c24f22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:15.721883 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0400ce-4378-4d1e-b72a-04eaa2c24f22 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:15.738796 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52715d-611d-4155-8e5d-002d405b9a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:15.739459 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52715d-611d-4155-8e5d-002d405b9a5b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:15.739745 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52715d-611d-4155-8e5d-002d405b9a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:15.740029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52715d-611d-4155-8e5d-002d405b9a5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:15.740827 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52715d-611d-4155-8e5d-002d405b9a5b None admin] RBAC: Adding query filter params (interface=admin, service_id=2140cc63163547a699069879f851a8f8, region_id=RegionOne) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:15.745661 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52715d-611d-4155-8e5d-002d405b9a5b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:15.745813 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 487/981] 10.222.0.39 () {56 vars in 1149 bytes} [Thu Jul 14 15:25:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:15.745899 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52715d-611d-4155-8e5d-002d405b9a5b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:15.746864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0400ce-4378-4d1e-b72a-04eaa2c24f22 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:15.750291 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 495/982] 10.222.0.39 () {56 vars in 1249 bytes} [Thu Jul 14 15:25:15 2022] GET /identity/v3/endpoints?service_id=2140cc63163547a699069879f851a8f8&interface=admin®ion_id=RegionOne => generated 193 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:15.755886 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52715d-611d-4155-8e5d-002d405b9a5b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:15.838548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:15.865840 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52715d-611d-4155-8e5d-002d405b9a5b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:15.868910 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0400ce-4378-4d1e-b72a-04eaa2c24f22 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:15.892644 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:15.907360 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13f599-f569-42e1-b3b3-26ecb507ee09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:15.908035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13f599-f569-42e1-b3b3-26ecb507ee09 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:15.908323 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13f599-f569-42e1-b3b3-26ecb507ee09 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:15.908598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13f599-f569-42e1-b3b3-26ecb507ee09 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:15.909279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13f599-f569-42e1-b3b3-26ecb507ee09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:15.910381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a465ff-7fbe-4648-8b43-124cbb7b8db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:15.910695 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13f599-f569-42e1-b3b3-26ecb507ee09 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:15.911033 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a465ff-7fbe-4648-8b43-124cbb7b8db7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:15.911322 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a465ff-7fbe-4648-8b43-124cbb7b8db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:15.911600 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a465ff-7fbe-4648-8b43-124cbb7b8db7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:15.926347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 496/983] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jul 14 15:25:15 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:25:15.994812 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a465ff-7fbe-4648-8b43-124cbb7b8db7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:15.996739 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a465ff-7fbe-4648-8b43-124cbb7b8db7 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:16.122327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 488/984] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:25:15 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 15:25:16.128496 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13f599-f569-42e1-b3b3-26ecb507ee09 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:16.234821 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13f599-f569-42e1-b3b3-26ecb507ee09 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:16.269564 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944297f1-96d4-4085-918c-fd84ff8d9efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:16.270382 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944297f1-96d4-4085-918c-fd84ff8d9efe None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:16.270663 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944297f1-96d4-4085-918c-fd84ff8d9efe None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:16.270933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944297f1-96d4-4085-918c-fd84ff8d9efe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:16.278305 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:16.284843 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944297f1-96d4-4085-918c-fd84ff8d9efe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:16.286342 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944297f1-96d4-4085-918c-fd84ff8d9efe None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:16.304176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-944297f1-96d4-4085-918c-fd84ff8d9efe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:16.304176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:16.304176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:16.304176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:16.304176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:16.304176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:16.304176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:16.304176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:16.304176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:16.304176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:16.304176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:16.304176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:16.304176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:25:16.304176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:25:16.304176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:25:16.305145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:25:16.305145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:16.305145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:16.305145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:16.305145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:16.305145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:16.305145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:16.305145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:16.305145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:16.305145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:16.305145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:16.305145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:16.305145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:16.305145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:16.305145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:16.305145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:16.305145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:16.306131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:25:16.306131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:25:16.306131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:16.306131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:16.306131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 497/985] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:16.313660 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a465ff-7fbe-4648-8b43-124cbb7b8db7 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:16.345055 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:16.440307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a465ff-7fbe-4648-8b43-124cbb7b8db7 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:16.476442 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d2530-8200-49d7-a93e-7ba694227545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:16.477475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d2530-8200-49d7-a93e-7ba694227545 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:16.477991 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d2530-8200-49d7-a93e-7ba694227545 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:16.478501 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d2530-8200-49d7-a93e-7ba694227545 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:16.479424 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d2530-8200-49d7-a93e-7ba694227545 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:16.479947 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d2530-8200-49d7-a93e-7ba694227545 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:16.481512 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d2530-8200-49d7-a93e-7ba694227545 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:16.494744 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 489/986] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:16.500232 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944297f1-96d4-4085-918c-fd84ff8d9efe None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:16.606383 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944297f1-96d4-4085-918c-fd84ff8d9efe None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:16.642514 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88901346-5953-4599-a671-df669ba5d2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:16.643403 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88901346-5953-4599-a671-df669ba5d2bd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:16.643683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88901346-5953-4599-a671-df669ba5d2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:16.643956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88901346-5953-4599-a671-df669ba5d2bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:16.651181 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88901346-5953-4599-a671-df669ba5d2bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:16.652641 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88901346-5953-4599-a671-df669ba5d2bd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:16.668575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-88901346-5953-4599-a671-df669ba5d2bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:25:16.668575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:16.668575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:16.668575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:16.668575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:16.668575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:16.668575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:16.668575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:16.668575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:16.668575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:16.668575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:16.668575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:16.668575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:25:16.668575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:25:16.668575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:25:16.669603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:25:16.669603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:16.669603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:16.669603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:16.669603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:16.669603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:16.669603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:16.669603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:16.669603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:16.669603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:16.669603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:16.669603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:16.669603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:16.669603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:16.669603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:16.669603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:16.669603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:16.675165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:25:16.675165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:25:16.675165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:25:16.675165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:25:16.675165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:25:16.675165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:25:16.675165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:25:16.675165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:16.675165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 498/987] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:25:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:16.678641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d2530-8200-49d7-a93e-7ba694227545 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:16.766824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:16.786953 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d2530-8200-49d7-a93e-7ba694227545 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:16.822217 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b69a5a-916c-45b4-acdb-a64da008f6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:16.823138 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b69a5a-916c-45b4-acdb-a64da008f6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:16.823595 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b69a5a-916c-45b4-acdb-a64da008f6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:16.824020 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b69a5a-916c-45b4-acdb-a64da008f6b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:16.824989 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b69a5a-916c-45b4-acdb-a64da008f6b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:16.825452 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b69a5a-916c-45b4-acdb-a64da008f6b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:16.827235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b69a5a-916c-45b4-acdb-a64da008f6b3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:16.840938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 490/988] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:25:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:16.848822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88901346-5953-4599-a671-df669ba5d2bd None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:16.903239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:16.961126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88901346-5953-4599-a671-df669ba5d2bd None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:16.998314 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e96ed-7e2e-4bfe-bdfc-10ca042ba27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:16.998975 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e96ed-7e2e-4bfe-bdfc-10ca042ba27a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:16.999260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e96ed-7e2e-4bfe-bdfc-10ca042ba27a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:16.999543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e96ed-7e2e-4bfe-bdfc-10ca042ba27a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:17.000591 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e96ed-7e2e-4bfe-bdfc-10ca042ba27a None admin] RBAC: Adding query filter params (role.id=98b969f0afd54257a83a07bfcc0cd3e3, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=8103402ac83c4b4191a3ec4d55038e1b) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:17.000909 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e96ed-7e2e-4bfe-bdfc-10ca042ba27a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:17.002380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e96ed-7e2e-4bfe-bdfc-10ca042ba27a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:17.014322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 499/989] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:25:16 2022] GET /identity/v3/role_assignments?user.id=8103402ac83c4b4191a3ec4d55038e1b&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=98b969f0afd54257a83a07bfcc0cd3e3 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:17.082419 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a4d04-7209-4e9f-88ee-463e65212bc9 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:17.082610 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a4d04-7209-4e9f-88ee-463e65212bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:17.082899 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a4d04-7209-4e9f-88ee-463e65212bc9 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:17.084341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 491/990] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:17.090637 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce3720-4311-43e8-ba4b-9e37e73a5016 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:17.090977 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce3720-4311-43e8-ba4b-9e37e73a5016 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:17.091222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce3720-4311-43e8-ba4b-9e37e73a5016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:17.111268 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-bcce3720-4311-43e8-ba4b-9e37e73a5016 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:17.112514 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-bcce3720-4311-43e8-ba4b-9e37e73a5016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:17.195127 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 500/991] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:17.219786 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a4d04-7209-4e9f-88ee-463e65212bc9 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:17.329040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a4d04-7209-4e9f-88ee-463e65212bc9 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:17.364594 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06224fe-30e8-4e1a-a7b3-cc5b8c894b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:17.365307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06224fe-30e8-4e1a-a7b3-cc5b8c894b88 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:17.365592 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06224fe-30e8-4e1a-a7b3-cc5b8c894b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:17.365867 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06224fe-30e8-4e1a-a7b3-cc5b8c894b88 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:17.366558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06224fe-30e8-4e1a-a7b3-cc5b8c894b88 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:17.367931 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06224fe-30e8-4e1a-a7b3-cc5b8c894b88 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:17.379933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-d06224fe-30e8-4e1a-a7b3-cc5b8c894b88 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:25:17.379933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:17.379933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:25:17.379933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:25:17.379933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:25:17.379933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:25:17.379933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:25:17.379933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:17.379933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:25:17.379933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:17.379933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:25:17.379933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:17.379933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:17.379933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:17.379933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:17.379933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:17.379933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:17.380977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:17.380977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:17.380977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:17.380977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:17.380977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:17.380977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:17.380977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:25:17.380977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:25:17.380977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:25:17.380977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:25:17.380977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:17.380977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:17.380977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:17.380977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:17.380977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:17.380977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:17.381873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:17.381873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:17.381873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:17.381873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:17.381873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:17.381873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:17.381873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:17.381873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:17.381873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:17.381873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:17.381873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:25:17.381873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:17.381873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:25:17.381873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:17.381873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 492/992] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:25:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:17.389052 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce3720-4311-43e8-ba4b-9e37e73a5016 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:17.442600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:17.499669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce3720-4311-43e8-ba4b-9e37e73a5016 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:17.534903 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736b771-f19b-4d16-a6de-23e2d0e6b93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:17.535576 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736b771-f19b-4d16-a6de-23e2d0e6b93f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:17.535868 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736b771-f19b-4d16-a6de-23e2d0e6b93f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:17.536119 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736b771-f19b-4d16-a6de-23e2d0e6b93f None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:17.536827 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736b771-f19b-4d16-a6de-23e2d0e6b93f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:17.537138 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736b771-f19b-4d16-a6de-23e2d0e6b93f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:17.540244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736b771-f19b-4d16-a6de-23e2d0e6b93f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:17.546537 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 501/993] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jul 14 15:25:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:17.553665 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06224fe-30e8-4e1a-a7b3-cc5b8c894b88 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:17.558965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:17.659149 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06224fe-30e8-4e1a-a7b3-cc5b8c894b88 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:17.694204 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429c031-7486-461c-9109-016457876023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:17.694868 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429c031-7486-461c-9109-016457876023 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:17.695154 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429c031-7486-461c-9109-016457876023 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:17.695430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429c031-7486-461c-9109-016457876023 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:17.696171 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429c031-7486-461c-9109-016457876023 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:17.696477 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429c031-7486-461c-9109-016457876023 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:17.697918 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429c031-7486-461c-9109-016457876023 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:17.703546 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 493/994] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jul 14 15:25:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:17.709474 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736b771-f19b-4d16-a6de-23e2d0e6b93f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:17.815318 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736b771-f19b-4d16-a6de-23e2d0e6b93f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:17.825418 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:17.853210 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4784bc9-d16c-41f2-bae7-d40f70b06ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:17.853874 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4784bc9-d16c-41f2-bae7-d40f70b06ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:17.854195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4784bc9-d16c-41f2-bae7-d40f70b06ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:17.854476 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4784bc9-d16c-41f2-bae7-d40f70b06ca6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:17.855264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4784bc9-d16c-41f2-bae7-d40f70b06ca6 None admin] RBAC: Adding query filter params (interface=public, service_id=8680bb5c850d4f51897eae571ed8d27d, region_id=RegionOne) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:17.855579 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4784bc9-d16c-41f2-bae7-d40f70b06ca6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:17.856949 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4784bc9-d16c-41f2-bae7-d40f70b06ca6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:17.867688 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 502/995] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jul 14 15:25:17 2022] GET /identity/v3/endpoints?service_id=8680bb5c850d4f51897eae571ed8d27d&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:17.868831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429c031-7486-461c-9109-016457876023 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:17.947045 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:17.989101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429c031-7486-461c-9109-016457876023 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:18.027978 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71527e1e-4921-4a91-93aa-4f6b508583b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:18.028653 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71527e1e-4921-4a91-93aa-4f6b508583b2 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:18.028934 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71527e1e-4921-4a91-93aa-4f6b508583b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:18.029216 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71527e1e-4921-4a91-93aa-4f6b508583b2 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:18.029905 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71527e1e-4921-4a91-93aa-4f6b508583b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:18.031946 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71527e1e-4921-4a91-93aa-4f6b508583b2 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:18.039731 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 494/996] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jul 14 15:25:17 2022] GET /identity/v3/services => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:25:18.096751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f4b40-23d1-436b-aaa0-4ea054148bde None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:18.097505 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f4b40-23d1-436b-aaa0-4ea054148bde None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:18.097505 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f4b40-23d1-436b-aaa0-4ea054148bde None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:18.100000 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 503/997] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:18.108755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf88965-3ef1-42d3-80fd-635924a192b0 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:18.109184 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf88965-3ef1-42d3-80fd-635924a192b0 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:18.110534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf88965-3ef1-42d3-80fd-635924a192b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:18.138328 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2bf88965-3ef1-42d3-80fd-635924a192b0 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:18.140260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2bf88965-3ef1-42d3-80fd-635924a192b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:18.244627 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 495/998] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:18.268748 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f4b40-23d1-436b-aaa0-4ea054148bde None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:18.382189 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f4b40-23d1-436b-aaa0-4ea054148bde None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:18.418114 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea61bbb-7f83-4626-bce1-5dc3b38d27e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:18.418932 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea61bbb-7f83-4626-bce1-5dc3b38d27e1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:18.419218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea61bbb-7f83-4626-bce1-5dc3b38d27e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:18.419497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea61bbb-7f83-4626-bce1-5dc3b38d27e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:18.420185 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea61bbb-7f83-4626-bce1-5dc3b38d27e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:18.421571 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea61bbb-7f83-4626-bce1-5dc3b38d27e1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:18.435049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-6ea61bbb-7f83-4626-bce1-5dc3b38d27e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:25:18.435049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:18.435049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:25:18.435049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:25:18.435049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:25:18.435049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:25:18.435049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:25:18.435049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:18.435049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:25:18.435049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:18.435049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:25:18.435049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:18.435049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:18.435049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:18.435049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:18.435049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:18.435049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:18.436031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:18.436031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:18.436031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:18.436031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:18.436031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:18.436031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:18.436031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:25:18.436031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:25:18.436031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:25:18.436031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:25:18.436031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:18.436031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:18.436031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:18.436031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:18.436031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:18.436031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:18.437186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:18.437186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:18.437186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:18.437186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:18.437186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:18.437186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:18.437186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:18.437186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:18.437186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:18.437186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:18.437186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:25:18.437186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:18.437186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 14 15:25:18.437186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:18.438978 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 504/999] 10.222.0.39 () {56 vars in 1126 bytes} [Thu Jul 14 15:25:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:18.442937 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf88965-3ef1-42d3-80fd-635924a192b0 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:18.508176 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:18.550095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf88965-3ef1-42d3-80fd-635924a192b0 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:18.586400 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec7a66-e7f4-4555-8b1f-b73af94e99d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:18.587195 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec7a66-e7f4-4555-8b1f-b73af94e99d6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:18.587365 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec7a66-e7f4-4555-8b1f-b73af94e99d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:18.587633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec7a66-e7f4-4555-8b1f-b73af94e99d6 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:18.588340 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec7a66-e7f4-4555-8b1f-b73af94e99d6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:18.588649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec7a66-e7f4-4555-8b1f-b73af94e99d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:18.590020 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec7a66-e7f4-4555-8b1f-b73af94e99d6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:18.600925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 496/1000] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jul 14 15:25:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:18.601741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea61bbb-7f83-4626-bce1-5dc3b38d27e1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:18.639086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:18.710052 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea61bbb-7f83-4626-bce1-5dc3b38d27e1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:18.752253 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dca11b-c774-4ba3-8d6a-883705206c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:18.752939 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dca11b-c774-4ba3-8d6a-883705206c6f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:18.753290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dca11b-c774-4ba3-8d6a-883705206c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:18.753577 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dca11b-c774-4ba3-8d6a-883705206c6f None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:18.754321 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dca11b-c774-4ba3-8d6a-883705206c6f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:18.754636 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dca11b-c774-4ba3-8d6a-883705206c6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:18.756018 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dca11b-c774-4ba3-8d6a-883705206c6f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:18.766416 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 505/1001] 10.222.0.39 () {56 vars in 1122 bytes} [Thu Jul 14 15:25:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:18.767368 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec7a66-e7f4-4555-8b1f-b73af94e99d6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:18.877157 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec7a66-e7f4-4555-8b1f-b73af94e99d6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:18.911939 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:18.924892 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c675750-85ab-4e5c-9ed4-de3abbfbc0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:18.925570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c675750-85ab-4e5c-9ed4-de3abbfbc0b5 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:18.925856 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c675750-85ab-4e5c-9ed4-de3abbfbc0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:18.926163 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c675750-85ab-4e5c-9ed4-de3abbfbc0b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:18.926916 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c675750-85ab-4e5c-9ed4-de3abbfbc0b5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:18.928299 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c675750-85ab-4e5c-9ed4-de3abbfbc0b5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:18.950189 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 497/1002] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jul 14 15:25:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:25:19.208355 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14aaa0-97e3-4c3f-9992-e2377254d1e9 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:19.208545 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14aaa0-97e3-4c3f-9992-e2377254d1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:19.208820 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14aaa0-97e3-4c3f-9992-e2377254d1e9 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:19.210252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 506/1003] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:19.215659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e82523-757e-4d71-896b-a9018a708032 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:19.215957 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e82523-757e-4d71-896b-a9018a708032 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:19.216237 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e82523-757e-4d71-896b-a9018a708032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:19.235390 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b7e82523-757e-4d71-896b-a9018a708032 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:19.236714 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b7e82523-757e-4d71-896b-a9018a708032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:19.317333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 498/1004] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:19 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:19.339855 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14aaa0-97e3-4c3f-9992-e2377254d1e9 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:19.464524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:19.471027 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14aaa0-97e3-4c3f-9992-e2377254d1e9 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:19.507592 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33821d18-4eaf-4923-8ae0-233bfbc5d06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:19.508387 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33821d18-4eaf-4923-8ae0-233bfbc5d06c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:19.508676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33821d18-4eaf-4923-8ae0-233bfbc5d06c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:19.508954 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33821d18-4eaf-4923-8ae0-233bfbc5d06c None admin] PATH_INFO: `/v3/services/image` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:19.509602 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33821d18-4eaf-4923-8ae0-233bfbc5d06c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:19.511044 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33821d18-4eaf-4923-8ae0-233bfbc5d06c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:19.524065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-33821d18-4eaf-4923-8ae0-233bfbc5d06c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:25:19.524065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:19.524065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:25:19.524065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:25:19.524065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:25:19.524065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:25:19.524065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:25:19.524065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:19.524065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:25:19.524065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:19.524065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:25:19.524065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:19.524065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:19.524065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:19.524065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:19.524065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:19.524065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:19.525091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:19.525091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:19.525091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:19.525091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:19.525091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:19.525091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:19.525091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:25:19.525091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:25:19.525091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:25:19.525091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:25:19.525091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:19.525091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:19.525091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:19.525091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:19.525091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:19.525091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:19.531364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:19.531364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:19.531364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:19.531364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:19.531364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:19.531364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:19.531364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:19.531364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:19.531364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:19.531364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:19.531364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:25:19.531364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:19.531364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:25:19.531364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:19.531364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 507/1005] 10.222.0.39 () {56 vars in 1105 bytes} [Thu Jul 14 15:25:19 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:19.533812 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e82523-757e-4d71-896b-a9018a708032 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:19.639461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e82523-757e-4d71-896b-a9018a708032 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:19.652972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:19.679180 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091cc2d-7209-4f5b-af9c-883a90b5aaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:19.679850 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091cc2d-7209-4f5b-af9c-883a90b5aaab None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:19.680138 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091cc2d-7209-4f5b-af9c-883a90b5aaab None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:19.680415 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091cc2d-7209-4f5b-af9c-883a90b5aaab None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:19.681119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091cc2d-7209-4f5b-af9c-883a90b5aaab None admin] RBAC: Adding query filter params (name=image) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:19.681430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091cc2d-7209-4f5b-af9c-883a90b5aaab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:19.682839 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091cc2d-7209-4f5b-af9c-883a90b5aaab None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:19.692784 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 499/1006] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:19.694529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33821d18-4eaf-4923-8ae0-233bfbc5d06c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:19.800973 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33821d18-4eaf-4923-8ae0-233bfbc5d06c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:19.836197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4100a-3d4c-45ef-ba82-5f50934c4a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:19.836860 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4100a-3d4c-45ef-ba82-5f50934c4a28 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:19.837141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4100a-3d4c-45ef-ba82-5f50934c4a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:19.837413 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4100a-3d4c-45ef-ba82-5f50934c4a28 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:19.838132 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4100a-3d4c-45ef-ba82-5f50934c4a28 None admin] RBAC: Adding query filter params (type=image) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:19.838439 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4100a-3d4c-45ef-ba82-5f50934c4a28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:19.839797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4100a-3d4c-45ef-ba82-5f50934c4a28 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:19.848113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 508/1007] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:19 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:20.238644 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645411ff-869f-45c2-b73f-37f26e68df97 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:20.238831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645411ff-869f-45c2-b73f-37f26e68df97 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:20.239115 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645411ff-869f-45c2-b73f-37f26e68df97 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:20.240503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 500/1008] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:20.245745 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5006528-92b8-4ad1-b4ac-33ce387dfa26 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:20.246044 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5006528-92b8-4ad1-b4ac-33ce387dfa26 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:20.246363 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5006528-92b8-4ad1-b4ac-33ce387dfa26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:20.264832 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a5006528-92b8-4ad1-b4ac-33ce387dfa26 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:20.266693 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a5006528-92b8-4ad1-b4ac-33ce387dfa26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:20.290577 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:20.339765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 509/1009] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:20 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:20.363722 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645411ff-869f-45c2-b73f-37f26e68df97 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:20.485262 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645411ff-869f-45c2-b73f-37f26e68df97 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:20.525313 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f7ea1-097b-4cf7-a76b-8a2438eca248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:20.526290 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f7ea1-097b-4cf7-a76b-8a2438eca248 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:20.526512 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f7ea1-097b-4cf7-a76b-8a2438eca248 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:20.526791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f7ea1-097b-4cf7-a76b-8a2438eca248 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:20.527457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f7ea1-097b-4cf7-a76b-8a2438eca248 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:20.528864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0f7ea1-097b-4cf7-a76b-8a2438eca248 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:20.541874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-7a0f7ea1-097b-4cf7-a76b-8a2438eca248 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:25:20.541874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:20.541874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:25:20.541874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:25:20.541874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:25:20.541874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:25:20.541874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:25:20.541874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:20.541874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:25:20.541874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:20.541874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:25:20.541874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:20.541874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:20.541874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:20.541874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:20.541874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:20.541874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:20.543028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:20.543028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:20.543028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:20.543028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:20.543028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:20.543028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:20.543028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:25:20.543028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:25:20.543028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:25:20.543028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:25:20.543028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:20.543028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:20.543028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:20.543028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:20.543028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:20.543028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:20.543969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:20.543969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:20.543969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:20.543969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:20.543969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:20.543969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:20.543969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:20.543969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:20.543969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:20.543969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:20.543969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:25:20.543969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:20.543969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 15:25:20.543969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:20.546697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 501/1010] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:25:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:20.550625 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5006528-92b8-4ad1-b4ac-33ce387dfa26 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:20.717827 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5006528-92b8-4ad1-b4ac-33ce387dfa26 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:20.776994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082441c3-5833-49bd-bfdc-97b3626d2786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:20.777911 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082441c3-5833-49bd-bfdc-97b3626d2786 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:20.778390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082441c3-5833-49bd-bfdc-97b3626d2786 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:20.778812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082441c3-5833-49bd-bfdc-97b3626d2786 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:20.779918 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082441c3-5833-49bd-bfdc-97b3626d2786 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:20.780671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082441c3-5833-49bd-bfdc-97b3626d2786 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:20.783153 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082441c3-5833-49bd-bfdc-97b3626d2786 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:20.795983 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 510/1011] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jul 14 15:25:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:20.798185 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f7ea1-097b-4cf7-a76b-8a2438eca248 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:20.846467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:20.914686 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0f7ea1-097b-4cf7-a76b-8a2438eca248 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:20.952870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6244c7-883b-47a9-a2ac-79a170c1bb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:20.953182 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6244c7-883b-47a9-a2ac-79a170c1bb94 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:20.953535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6244c7-883b-47a9-a2ac-79a170c1bb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:20.953811 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6244c7-883b-47a9-a2ac-79a170c1bb94 None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:20.954550 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6244c7-883b-47a9-a2ac-79a170c1bb94 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:20.954873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6244c7-883b-47a9-a2ac-79a170c1bb94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:20.956340 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6244c7-883b-47a9-a2ac-79a170c1bb94 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:20.961896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 502/1012] 10.222.0.39 () {56 vars in 1112 bytes} [Thu Jul 14 15:25:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:20.967683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082441c3-5833-49bd-bfdc-97b3626d2786 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:21.006102 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:21.095490 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c7896-f7d7-4157-bec7-8e3316182d57 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:21.095787 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c7896-f7d7-4157-bec7-8e3316182d57 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:21.095979 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c7896-f7d7-4157-bec7-8e3316182d57 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:21.097786 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 503/1013] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:21.103975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34a2dd-9097-43bd-9b7f-7c2cc53fa1b5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:21.104273 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34a2dd-9097-43bd-9b7f-7c2cc53fa1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:21.104628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34a2dd-9097-43bd-9b7f-7c2cc53fa1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:21.112618 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082441c3-5833-49bd-bfdc-97b3626d2786 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:21.124447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3a34a2dd-9097-43bd-9b7f-7c2cc53fa1b5 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:21.126151 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3a34a2dd-9097-43bd-9b7f-7c2cc53fa1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:21.168159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cee11c-15cb-4116-825d-1478ed7d4a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:21.169143 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cee11c-15cb-4116-825d-1478ed7d4a01 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:21.172777 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cee11c-15cb-4116-825d-1478ed7d4a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:21.172777 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cee11c-15cb-4116-825d-1478ed7d4a01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:21.172777 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cee11c-15cb-4116-825d-1478ed7d4a01 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:21.175583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cee11c-15cb-4116-825d-1478ed7d4a01 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:21.205403 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 511/1014] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jul 14 15:25:20 2022] POST /identity/v3/endpoints => generated 334 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:25:21.253689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 504/1015] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:21 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:25:21.276722 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cee11c-15cb-4116-825d-1478ed7d4a01 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:21.383035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:21.411639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cee11c-15cb-4116-825d-1478ed7d4a01 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:21.456932 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d03bb-800c-474c-9d8a-afd1494380c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:21.457741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d03bb-800c-474c-9d8a-afd1494380c5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:21.458031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d03bb-800c-474c-9d8a-afd1494380c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:21.458336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d03bb-800c-474c-9d8a-afd1494380c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:21.459524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d03bb-800c-474c-9d8a-afd1494380c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:21.460969 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d03bb-800c-474c-9d8a-afd1494380c5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:21.462629 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 512/1016] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:21.470194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34a2dd-9097-43bd-9b7f-7c2cc53fa1b5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:21.510269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:21.608109 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34a2dd-9097-43bd-9b7f-7c2cc53fa1b5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:21.647722 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef646529-3047-4b70-be51-2de6a3df4d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:21.648779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef646529-3047-4b70-be51-2de6a3df4d43 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:21.649287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef646529-3047-4b70-be51-2de6a3df4d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:21.649822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef646529-3047-4b70-be51-2de6a3df4d43 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:21.650787 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef646529-3047-4b70-be51-2de6a3df4d43 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:21.652537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef646529-3047-4b70-be51-2de6a3df4d43 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:21.685259 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 505/1017] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jul 14 15:25:21 2022] POST /identity/v3/projects => generated 311 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:25:22.109060 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fcd55-cfc3-41b1-9e5f-02ad8d949d11 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:22.111154 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fcd55-cfc3-41b1-9e5f-02ad8d949d11 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:22.111769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2fcd55-cfc3-41b1-9e5f-02ad8d949d11 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:22.114053 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 513/1018] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:22.121013 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a3ebc-59cf-440f-8a8a-ab239a5e3032 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:22.121910 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a3ebc-59cf-440f-8a8a-ab239a5e3032 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:22.122422 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a3ebc-59cf-440f-8a8a-ab239a5e3032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:22.144736 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d03a3ebc-59cf-440f-8a8a-ab239a5e3032 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:22.147157 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d03a3ebc-59cf-440f-8a8a-ab239a5e3032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:22.240503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 506/1019] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:22 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:22.269991 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fcd55-cfc3-41b1-9e5f-02ad8d949d11 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:22.398813 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2fcd55-cfc3-41b1-9e5f-02ad8d949d11 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:22.455413 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5db4e4-099b-4ea8-a1eb-a2713618b84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:22.456085 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5db4e4-099b-4ea8-a1eb-a2713618b84d None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:22.456373 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5db4e4-099b-4ea8-a1eb-a2713618b84d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:22.456658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5db4e4-099b-4ea8-a1eb-a2713618b84d None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:22.457431 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5db4e4-099b-4ea8-a1eb-a2713618b84d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:22.458841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5db4e4-099b-4ea8-a1eb-a2713618b84d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:22.482106 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 514/1020] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jul 14 15:25:22 2022] POST /identity/v3/services => generated 242 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:25:23.755826 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab293910-2262-42d2-8243-a57c2c04c017 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:23.756406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab293910-2262-42d2-8243-a57c2c04c017 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:23.756406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab293910-2262-42d2-8243-a57c2c04c017 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:23.757802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 507/1021] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:23.763178 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968df650-91cd-438f-9509-65b13776c3f8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:23.763631 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968df650-91cd-438f-9509-65b13776c3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:23.763722 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968df650-91cd-438f-9509-65b13776c3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:23.776534 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:23.783191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-968df650-91cd-438f-9509-65b13776c3f8 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:23.785385 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-968df650-91cd-438f-9509-65b13776c3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:23.874456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 515/1022] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:23.898779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab293910-2262-42d2-8243-a57c2c04c017 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:23.915075 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:23.932308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46efecb-9331-4f6f-b5cb-fe90eb76569c None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:23.932686 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46efecb-9331-4f6f-b5cb-fe90eb76569c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:23.933136 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46efecb-9331-4f6f-b5cb-fe90eb76569c None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:23.935595 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 516/1023] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:25:23.941911 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf1e4b-a840-419c-9b48-710780f7c7b6 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:23.942348 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf1e4b-a840-419c-9b48-710780f7c7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:23.942753 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf1e4b-a840-419c-9b48-710780f7c7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:23.964975 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-02cf1e4b-a840-419c-9b48-710780f7c7b6 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:23.966426 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-02cf1e4b-a840-419c-9b48-710780f7c7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:24.032522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab293910-2262-42d2-8243-a57c2c04c017 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:24.057311 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 517/1024] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:24.082597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf1e4b-a840-419c-9b48-710780f7c7b6 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:24.085602 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd930b82-c6e6-4271-b50c-f1308ae85c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:24.086521 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd930b82-c6e6-4271-b50c-f1308ae85c84 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:24.086806 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd930b82-c6e6-4271-b50c-f1308ae85c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:24.087077 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd930b82-c6e6-4271-b50c-f1308ae85c84 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:24.098986 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd930b82-c6e6-4271-b50c-f1308ae85c84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:25:24.107234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-fd930b82-c6e6-4271-b50c-f1308ae85c84 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:25:24.107234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:24.107234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:24.107234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:24.107234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:24.107234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:24.107234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:24.107234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:24.107234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:24.107234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:24.107234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:24.107234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:24.107234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:25:24.107234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:25:24.107234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:25:24.107234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:25:24.108310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:25:24.108310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:25:24.108310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:25:24.108310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:25:24.108310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:24.108310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:24.108310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:24.108310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:24.108310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:24.108310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:24.108310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:24.108310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:24.108310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:24.108310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:24.108310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:24.108310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:24.109890 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:24.109890 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:24.109890 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:24.109890 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:24.109890 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:25:24.109890 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:25:24.109890 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:25:24.109890 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:25:24.109890 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:25:24.109890 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:25:24.109890 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:25:24.109890 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:24.114036 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 508/1025] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jul 14 15:25:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:24.114931 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd930b82-c6e6-4271-b50c-f1308ae85c84 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:24.152356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:24.194742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:24.199495 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf1e4b-a840-419c-9b48-710780f7c7b6 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:24.229785 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd930b82-c6e6-4271-b50c-f1308ae85c84 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:24.244295 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c6ce9-2749-48c5-8a58-57bd619ab731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:24.245093 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c6ce9-2749-48c5-8a58-57bd619ab731 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:24.245380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c6ce9-2749-48c5-8a58-57bd619ab731 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:24.245663 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c6ce9-2749-48c5-8a58-57bd619ab731 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:24.246891 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c6ce9-2749-48c5-8a58-57bd619ab731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:24.248358 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c6ce9-2749-48c5-8a58-57bd619ab731 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:24.250230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 518/1026] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:24.256159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c6ce9-2749-48c5-8a58-57bd619ab731 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:24.271299 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b451cc-aa2b-44bb-b25c-efa57842fb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:24.271974 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b451cc-aa2b-44bb-b25c-efa57842fb50 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:24.272260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b451cc-aa2b-44bb-b25c-efa57842fb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:24.272522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b451cc-aa2b-44bb-b25c-efa57842fb50 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:24.273271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b451cc-aa2b-44bb-b25c-efa57842fb50 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:24.273581 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b451cc-aa2b-44bb-b25c-efa57842fb50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:24.274986 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b451cc-aa2b-44bb-b25c-efa57842fb50 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:24.288522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 509/1027] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jul 14 15:25:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:24.289512 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b451cc-aa2b-44bb-b25c-efa57842fb50 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:24.373790 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c6ce9-2749-48c5-8a58-57bd619ab731 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:24.400946 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b451cc-aa2b-44bb-b25c-efa57842fb50 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:24.403960 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:24.412163 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0e509-da90-48f6-adf0-b86e8ce2772c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:24.412843 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0e509-da90-48f6-adf0-b86e8ce2772c None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:24.413134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0e509-da90-48f6-adf0-b86e8ce2772c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:24.413417 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0e509-da90-48f6-adf0-b86e8ce2772c None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:24.414263 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0e509-da90-48f6-adf0-b86e8ce2772c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:24.417452 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0e509-da90-48f6-adf0-b86e8ce2772c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:24.438879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 519/1028] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jul 14 15:25:24 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:25:24.466889 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caaa1d6-2c23-49c1-bfac-a9cf6b7f1759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:24.467718 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caaa1d6-2c23-49c1-bfac-a9cf6b7f1759 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:24.468064 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caaa1d6-2c23-49c1-bfac-a9cf6b7f1759 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:24.468480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caaa1d6-2c23-49c1-bfac-a9cf6b7f1759 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:24.471587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:24.483846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caaa1d6-2c23-49c1-bfac-a9cf6b7f1759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:24.486209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caaa1d6-2c23-49c1-bfac-a9cf6b7f1759 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:24.507255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-7caaa1d6-2c23-49c1-bfac-a9cf6b7f1759 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:24.507255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:24.507255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:24.507255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:24.507255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:24.507255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:24.507255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:24.507255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:24.507255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:24.507255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:24.507255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:24.507255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:24.507255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:25:24.507255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:25:24.507255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:25:24.508320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:25:24.508320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:24.508320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:24.508320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:24.508320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:24.508320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:24.508320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:24.508320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:24.508320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:24.508320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:24.508320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:24.508320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:24.508320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:24.508320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:24.508320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:24.508320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:24.508320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:24.509286 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:25:24.509286 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:25:24.509286 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:24.509286 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:24.509286 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 510/1029] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:25:24.514584 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0e509-da90-48f6-adf0-b86e8ce2772c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:24.631770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0e509-da90-48f6-adf0-b86e8ce2772c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:24.680910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182dbd2-122b-41f8-8c49-6d769c69878d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:24.681594 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182dbd2-122b-41f8-8c49-6d769c69878d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:24.681870 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182dbd2-122b-41f8-8c49-6d769c69878d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:24.682178 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182dbd2-122b-41f8-8c49-6d769c69878d None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:24.682983 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182dbd2-122b-41f8-8c49-6d769c69878d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:24.683305 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182dbd2-122b-41f8-8c49-6d769c69878d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:24.684700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182dbd2-122b-41f8-8c49-6d769c69878d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:24.698137 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 520/1030] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:24.704349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caaa1d6-2c23-49c1-bfac-a9cf6b7f1759 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:24.727534 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dafad6-049a-4a7c-a0d6-f5ff0b583175 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:24.727825 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dafad6-049a-4a7c-a0d6-f5ff0b583175 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:24.728107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dafad6-049a-4a7c-a0d6-f5ff0b583175 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:24.729473 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 521/1031] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:24.735525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ec7a4-e9f9-4b95-b1c2-7b8808feef53 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:24.735823 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ec7a4-e9f9-4b95-b1c2-7b8808feef53 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:24.736113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ec7a4-e9f9-4b95-b1c2-7b8808feef53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:24.754055 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-148ec7a4-e9f9-4b95-b1c2-7b8808feef53 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:24.755304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-148ec7a4-e9f9-4b95-b1c2-7b8808feef53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:24.804342 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:24.825110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caaa1d6-2c23-49c1-bfac-a9cf6b7f1759 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:24.833813 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 522/1032] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:25:24.858929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ec7a4-e9f9-4b95-b1c2-7b8808feef53 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:24.863322 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0e5db-8a8d-4247-8126-dc4264017b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:24.864130 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0e5db-8a8d-4247-8126-dc4264017b5a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:24.864418 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0e5db-8a8d-4247-8126-dc4264017b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:24.864696 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0e5db-8a8d-4247-8126-dc4264017b5a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:24.873679 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0e5db-8a8d-4247-8126-dc4264017b5a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:24.875231 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0e5db-8a8d-4247-8126-dc4264017b5a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:24.891713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-c7e0e5db-8a8d-4247-8126-dc4264017b5a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:25:24.891713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:24.891713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:24.891713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:24.891713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:24.891713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:24.891713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:24.891713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:24.891713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:24.891713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:24.891713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:24.891713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:24.891713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:25:24.891713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:25:24.891713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:25:24.891713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:25:24.892886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:24.892886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:24.892886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:25:24.892886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:25:24.892886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:25:24.892886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:25:24.892886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:24.892886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:24.892886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:24.892886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:24.892886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:24.892886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:24.892886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:24.892886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:24.892886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:24.892886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:24.892886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:24.892886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:24.893954 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:24.893954 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:24.893954 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:25:24.893954 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:25:24.893954 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:25:24.893954 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:25:24.893954 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:25:24.893954 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:25:24.893954 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:25:24.893954 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:24.893954 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 511/1033] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jul 14 15:25:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:24.898571 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0e5db-8a8d-4247-8126-dc4264017b5a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:24.948732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:24.972455 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ec7a4-e9f9-4b95-b1c2-7b8808feef53 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:25.009262 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0e5db-8a8d-4247-8126-dc4264017b5a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:25.009986 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc5986-4aa7-4da8-a9ed-9eace0fd91c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:25.011116 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc5986-4aa7-4da8-a9ed-9eace0fd91c5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:25.011699 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc5986-4aa7-4da8-a9ed-9eace0fd91c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:25.011979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc5986-4aa7-4da8-a9ed-9eace0fd91c5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:25.012649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc5986-4aa7-4da8-a9ed-9eace0fd91c5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:25.014042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc5986-4aa7-4da8-a9ed-9eace0fd91c5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:25.030192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-39dc5986-4aa7-4da8-a9ed-9eace0fd91c5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:25:25.030192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:25.030192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:25:25.030192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:25:25.030192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:25:25.030192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:25:25.030192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:25:25.030192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:25.030192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:25:25.030192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:25.030192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:25:25.030192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:25.030192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:25.030192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:25.030192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:25.030192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:25.030192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:25.032349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:25.032349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:25.032349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:25.032349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:25.032349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:25.032349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:25.032349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:25:25.032349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:25:25.032349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:25:25.032349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:25:25.032349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:25.032349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:25.032349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:25.032349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:25.032349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:25.032349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:25.034029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:25.034029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:25.034029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:25.034029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:25.034029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:25.034029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:25.034029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:25.034029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:25.034029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:25.034029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:25.034029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:25:25.034029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:25.034029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:25:25.034029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:25.037767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 523/1034] 10.222.0.39 () {56 vars in 1105 bytes} [Thu Jul 14 15:25:24 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:25:25.038796 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc5986-4aa7-4da8-a9ed-9eace0fd91c5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:25.055690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847d4bd-2627-4992-90d3-03a783ea735b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:25.056379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847d4bd-2627-4992-90d3-03a783ea735b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:25.056668 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847d4bd-2627-4992-90d3-03a783ea735b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:25.056944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847d4bd-2627-4992-90d3-03a783ea735b None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:25.057807 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847d4bd-2627-4992-90d3-03a783ea735b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:25.058160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847d4bd-2627-4992-90d3-03a783ea735b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:25.059643 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847d4bd-2627-4992-90d3-03a783ea735b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:25.080712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 512/1035] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jul 14 15:25:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:25.086684 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847d4bd-2627-4992-90d3-03a783ea735b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:25.090469 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:25.165210 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc5986-4aa7-4da8-a9ed-9eace0fd91c5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:25.201655 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847d4bd-2627-4992-90d3-03a783ea735b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:25.204798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:25.214522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28351a1-efcd-4810-bbf7-2ca85ef7e4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:25.215863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28351a1-efcd-4810-bbf7-2ca85ef7e4ed None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:25.216435 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28351a1-efcd-4810-bbf7-2ca85ef7e4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:25.216862 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28351a1-efcd-4810-bbf7-2ca85ef7e4ed None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:25.217809 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28351a1-efcd-4810-bbf7-2ca85ef7e4ed None admin] RBAC: Adding query filter params (name=image) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:25.218207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28351a1-efcd-4810-bbf7-2ca85ef7e4ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:25.220481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28351a1-efcd-4810-bbf7-2ca85ef7e4ed None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:25.230115 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 524/1036] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:25.235113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28351a1-efcd-4810-bbf7-2ca85ef7e4ed None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:25.247655 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fd90d-a3e6-4ad2-9827-c71b8725923e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:25.248429 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fd90d-a3e6-4ad2-9827-c71b8725923e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:25.248715 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fd90d-a3e6-4ad2-9827-c71b8725923e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:25.248997 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fd90d-a3e6-4ad2-9827-c71b8725923e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:25.326091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612fd90d-a3e6-4ad2-9827-c71b8725923e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:25.327631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612fd90d-a3e6-4ad2-9827-c71b8725923e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:25.353705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28351a1-efcd-4810-bbf7-2ca85ef7e4ed None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:25.356171 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:25.393298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bec859-4ddb-4986-a756-a780c7248060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:25.393950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bec859-4ddb-4986-a756-a780c7248060 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:25.394266 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bec859-4ddb-4986-a756-a780c7248060 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:25.394545 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bec859-4ddb-4986-a756-a780c7248060 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:25.395301 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bec859-4ddb-4986-a756-a780c7248060 None admin] RBAC: Adding query filter params (type=image) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:25.395567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bec859-4ddb-4986-a756-a780c7248060 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:25.397752 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bec859-4ddb-4986-a756-a780c7248060 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:25.403265 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 525/1037] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:25.409512 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bec859-4ddb-4986-a756-a780c7248060 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:25.455092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 513/1038] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:25:25 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 15:25:25.464773 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fd90d-a3e6-4ad2-9827-c71b8725923e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:25.470655 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:25.538255 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bec859-4ddb-4986-a756-a780c7248060 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:25.577226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fd90d-a3e6-4ad2-9827-c71b8725923e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:25.577838 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346bf52-cbb4-409c-8dfe-4335dc710f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:25.579222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346bf52-cbb4-409c-8dfe-4335dc710f06 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:25.579847 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346bf52-cbb4-409c-8dfe-4335dc710f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:25.580128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346bf52-cbb4-409c-8dfe-4335dc710f06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:25.580936 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346bf52-cbb4-409c-8dfe-4335dc710f06 None admin] RBAC: Adding query filter params (interface=public, service_id=05a84edc7e6247f39f0c44bc3fb05aba, region_id=RegionOne) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:25.581253 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346bf52-cbb4-409c-8dfe-4335dc710f06 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:25.582666 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346bf52-cbb4-409c-8dfe-4335dc710f06 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:25.588678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 526/1039] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jul 14 15:25:25 2022] GET /identity/v3/endpoints?service_id=05a84edc7e6247f39f0c44bc3fb05aba&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:25.594595 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346bf52-cbb4-409c-8dfe-4335dc710f06 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:25.620872 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edbeb0-74be-4bf6-94c7-6ebd1dd13535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:25.621657 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edbeb0-74be-4bf6-94c7-6ebd1dd13535 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:25.621936 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edbeb0-74be-4bf6-94c7-6ebd1dd13535 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:25.622237 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edbeb0-74be-4bf6-94c7-6ebd1dd13535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:25.630516 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:25.633289 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edbeb0-74be-4bf6-94c7-6ebd1dd13535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:25.634780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edbeb0-74be-4bf6-94c7-6ebd1dd13535 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:25.653605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-50edbeb0-74be-4bf6-94c7-6ebd1dd13535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:25.653605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:25.653605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:25.653605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:25.653605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:25.653605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:25.653605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:25.653605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:25.653605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:25.653605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:25.653605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:25.653605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:25.653605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:25:25.653605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:25:25.653605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:25:25.654648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:25:25.654648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:25.654648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:25.654648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:25.654648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:25.654648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:25.654648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:25.654648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:25.654648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:25.654648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:25.654648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:25.654648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:25.654648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:25.654648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:25.654648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:25.654648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:25.654648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:25.655544 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:25:25.655544 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:25:25.655544 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:25.655544 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:25.655544 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 514/1040] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:25.661607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edbeb0-74be-4bf6-94c7-6ebd1dd13535 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:25.712825 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346bf52-cbb4-409c-8dfe-4335dc710f06 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:25.727848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:25.752386 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41831ea7-48a2-400c-9768-36c7ed3f1c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:25.753053 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41831ea7-48a2-400c-9768-36c7ed3f1c64 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:25.753334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41831ea7-48a2-400c-9768-36c7ed3f1c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:25.753727 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41831ea7-48a2-400c-9768-36c7ed3f1c64 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:25.754550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41831ea7-48a2-400c-9768-36c7ed3f1c64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:25.755970 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41831ea7-48a2-400c-9768-36c7ed3f1c64 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:25.762913 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 527/1041] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jul 14 15:25:25 2022] GET /identity/v3/services => generated 1957 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:25:25.773726 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edbeb0-74be-4bf6-94c7-6ebd1dd13535 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:25.813002 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f15d89-dc65-4b56-a58f-a7ae49bc7692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:25.813692 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f15d89-dc65-4b56-a58f-a7ae49bc7692 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:25.813979 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f15d89-dc65-4b56-a58f-a7ae49bc7692 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:25.814292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f15d89-dc65-4b56-a58f-a7ae49bc7692 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:25.815040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f15d89-dc65-4b56-a58f-a7ae49bc7692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:25.815351 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f15d89-dc65-4b56-a58f-a7ae49bc7692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:25.816782 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f15d89-dc65-4b56-a58f-a7ae49bc7692 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:25.830466 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 515/1042] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:25.835912 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41831ea7-48a2-400c-9768-36c7ed3f1c64 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:25.952030 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:25.960392 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41831ea7-48a2-400c-9768-36c7ed3f1c64 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:26.004991 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be974e0a-0f01-4cde-9884-e9ded1a5cf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:26.005796 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be974e0a-0f01-4cde-9884-e9ded1a5cf19 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:26.006273 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be974e0a-0f01-4cde-9884-e9ded1a5cf19 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:26.007398 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be974e0a-0f01-4cde-9884-e9ded1a5cf19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:26.021216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be974e0a-0f01-4cde-9884-e9ded1a5cf19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:26.022208 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be974e0a-0f01-4cde-9884-e9ded1a5cf19 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:26.038058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-be974e0a-0f01-4cde-9884-e9ded1a5cf19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:25:26.038058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:26.038058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:26.038058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:26.038058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:26.038058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:26.038058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:26.038058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:26.038058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:26.038058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:26.038058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:26.038058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:26.038058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:25:26.038058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:25:26.038058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:25:26.039087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:25:26.039087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:26.039087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:26.039087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:26.039087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:26.039087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:26.039087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:26.039087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:26.039087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:26.039087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:26.039087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:26.039087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:26.039087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:26.039087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:26.039087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:26.039087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:26.039087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:26.040011 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:25:26.040011 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:25:26.040011 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:25:26.040011 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:25:26.040011 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:25:26.040011 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:25:26.040011 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:25:26.040011 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:26.040011 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 528/1043] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:25:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:25:26.045177 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f15d89-dc65-4b56-a58f-a7ae49bc7692 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:26.184524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f15d89-dc65-4b56-a58f-a7ae49bc7692 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:26.208871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:26.228184 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224d945-944c-4481-850e-b21ee51c612d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:26.228846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224d945-944c-4481-850e-b21ee51c612d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:26.229131 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224d945-944c-4481-850e-b21ee51c612d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:26.229407 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224d945-944c-4481-850e-b21ee51c612d None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:26.230225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224d945-944c-4481-850e-b21ee51c612d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:26.230541 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224d945-944c-4481-850e-b21ee51c612d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:26.231972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224d945-944c-4481-850e-b21ee51c612d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:26.250694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 516/1044] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:25:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:26.253260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be974e0a-0f01-4cde-9884-e9ded1a5cf19 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:26.363806 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be974e0a-0f01-4cde-9884-e9ded1a5cf19 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:26.399708 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3a935-c077-4230-94d4-eabe0f92b10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:26.400367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3a935-c077-4230-94d4-eabe0f92b10d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:26.400650 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3a935-c077-4230-94d4-eabe0f92b10d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:26.400929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3a935-c077-4230-94d4-eabe0f92b10d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:26.401757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3a935-c077-4230-94d4-eabe0f92b10d None admin] RBAC: Adding query filter params (role.id=98b969f0afd54257a83a07bfcc0cd3e3, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=64f6b597a47c4a0eb08d1eabc4c0305c) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:26.402098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3a935-c077-4230-94d4-eabe0f92b10d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:26.403527 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3a935-c077-4230-94d4-eabe0f92b10d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:26.417449 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 529/1045] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:25:26 2022] GET /identity/v3/role_assignments?user.id=64f6b597a47c4a0eb08d1eabc4c0305c&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=98b969f0afd54257a83a07bfcc0cd3e3 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:26.697494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733016b1-4ff2-43e1-bacf-be4b27ef69ad None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:26.697680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733016b1-4ff2-43e1-bacf-be4b27ef69ad None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:26.697970 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733016b1-4ff2-43e1-bacf-be4b27ef69ad None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:26.699417 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 517/1046] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:26.706104 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c811c2b-c6da-4339-bbd6-28f8ec4fe2f2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:26.706423 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c811c2b-c6da-4339-bbd6-28f8ec4fe2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:26.706710 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c811c2b-c6da-4339-bbd6-28f8ec4fe2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:26.724647 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5c811c2b-c6da-4339-bbd6-28f8ec4fe2f2 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:26.725867 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5c811c2b-c6da-4339-bbd6-28f8ec4fe2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:26.743322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:26.806606 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 530/1047] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:26.832117 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733016b1-4ff2-43e1-bacf-be4b27ef69ad None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:26.946136 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733016b1-4ff2-43e1-bacf-be4b27ef69ad None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:26.994543 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa7dd9-9a6a-4770-b549-7a50d8c65ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:26.995362 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa7dd9-9a6a-4770-b549-7a50d8c65ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:26.995647 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa7dd9-9a6a-4770-b549-7a50d8c65ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:26.995924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa7dd9-9a6a-4770-b549-7a50d8c65ac2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:27.008470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa7dd9-9a6a-4770-b549-7a50d8c65ac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:25:27.017060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-f3aa7dd9-9a6a-4770-b549-7a50d8c65ac2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:25:27.017060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:27.017060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:27.017060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:27.017060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:27.017060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:27.017060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:27.017060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:27.017060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:27.017060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:27.017060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:27.017060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:27.017060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:25:27.017060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:25:27.017060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:25:27.017060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:25:27.018061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:25:27.018061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:25:27.018061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:25:27.018061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:25:27.018061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:27.018061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:27.018061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:27.018061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:27.018061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:27.018061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:27.018061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:27.018061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:27.018061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:27.018061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:27.018061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:27.018061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:27.019270 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:27.019270 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:27.019270 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:27.019270 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:27.019270 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:25:27.019270 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:25:27.019270 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:25:27.019270 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:25:27.019270 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:25:27.019270 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:25:27.019270 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:25:27.019270 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:27.022463 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 518/1048] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:25:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:27.024552 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c811c2b-c6da-4339-bbd6-28f8ec4fe2f2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:27.137821 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c811c2b-c6da-4339-bbd6-28f8ec4fe2f2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:27.175380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253262d-bb7d-4bfa-a98b-7f33fd72d280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:27.176062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253262d-bb7d-4bfa-a98b-7f33fd72d280 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:27.176348 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253262d-bb7d-4bfa-a98b-7f33fd72d280 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:27.176626 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253262d-bb7d-4bfa-a98b-7f33fd72d280 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:27.177379 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253262d-bb7d-4bfa-a98b-7f33fd72d280 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:27.177690 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253262d-bb7d-4bfa-a98b-7f33fd72d280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:27.179115 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253262d-bb7d-4bfa-a98b-7f33fd72d280 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:27.189347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 531/1049] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:25:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:27.194997 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa7dd9-9a6a-4770-b549-7a50d8c65ac2 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:27.236158 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:27.318269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa7dd9-9a6a-4770-b549-7a50d8c65ac2 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:27.366801 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010a586-37bc-4ee7-9d84-93c0d81ceb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:27.367839 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010a586-37bc-4ee7-9d84-93c0d81ceb68 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:27.368665 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010a586-37bc-4ee7-9d84-93c0d81ceb68 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:27.368665 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010a586-37bc-4ee7-9d84-93c0d81ceb68 None admin] PATH_INFO: `/v3/users/0d5966b2ce514063aa4a0960fcdc45e2` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:27.386060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010a586-37bc-4ee7-9d84-93c0d81ceb68 None admin] RBAC: Authorizing `identity:get_user(user_id=0d5966b2ce514063aa4a0960fcdc45e2)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:27.387560 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010a586-37bc-4ee7-9d84-93c0d81ceb68 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:27.389482 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 519/1050] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:25:27 2022] GET /identity/v3/users/0d5966b2ce514063aa4a0960fcdc45e2 => generated 285 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:27.396548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253262d-bb7d-4bfa-a98b-7f33fd72d280 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:27.412984 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:27.536290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253262d-bb7d-4bfa-a98b-7f33fd72d280 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:27.583302 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab519f5-73a4-45ec-853a-4d9fac59b6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:27.583964 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab519f5-73a4-45ec-853a-4d9fac59b6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:27.584179 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab519f5-73a4-45ec-853a-4d9fac59b6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:27.584458 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab519f5-73a4-45ec-853a-4d9fac59b6d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:27.699640 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab519f5-73a4-45ec-853a-4d9fac59b6d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:27.702373 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab519f5-73a4-45ec-853a-4d9fac59b6d4 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:27.737310 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:27.842218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 532/1051] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:25:27 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:25:27.845249 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010a586-37bc-4ee7-9d84-93c0d81ceb68 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:27.945589 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:27.953900 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010a586-37bc-4ee7-9d84-93c0d81ceb68 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:27.991791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9053561-201d-4311-9f34-63ec20ea84df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:27.992662 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9053561-201d-4311-9f34-63ec20ea84df None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:27.992947 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9053561-201d-4311-9f34-63ec20ea84df None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:27.993222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9053561-201d-4311-9f34-63ec20ea84df None admin] PATH_INFO: `/v3/projects/0b70b7cdfdb5487d864a3623a8178289` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:27.994484 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9053561-201d-4311-9f34-63ec20ea84df None admin] RBAC: Authorizing `identity:get_project(project_id=0b70b7cdfdb5487d864a3623a8178289)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:27.995940 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9053561-201d-4311-9f34-63ec20ea84df None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:28.003322 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 520/1052] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:25:27 2022] GET /identity/v3/projects/0b70b7cdfdb5487d864a3623a8178289 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:28.005305 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab519f5-73a4-45ec-853a-4d9fac59b6d4 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:28.095683 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811da9ca-7282-4464-8de4-dce2a62e4ec1 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:28.095958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811da9ca-7282-4464-8de4-dce2a62e4ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:28.096429 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811da9ca-7282-4464-8de4-dce2a62e4ec1 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:28.098359 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 521/1053] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:28.105209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e996d2-5a3b-40ac-bdd9-3d0707db5252 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:28.106020 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e996d2-5a3b-40ac-bdd9-3d0707db5252 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:28.106867 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e996d2-5a3b-40ac-bdd9-3d0707db5252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:28.134869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-13e996d2-5a3b-40ac-bdd9-3d0707db5252 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:28.137072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-13e996d2-5a3b-40ac-bdd9-3d0707db5252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:28.200728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab519f5-73a4-45ec-853a-4d9fac59b6d4 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:28.218648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:28.246549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 522/1054] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:25:28.253551 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423ec91-28c1-498f-a9a1-080017df5d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:28.254368 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423ec91-28c1-498f-a9a1-080017df5d4c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:28.255023 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423ec91-28c1-498f-a9a1-080017df5d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:28.255307 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423ec91-28c1-498f-a9a1-080017df5d4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:28.256153 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423ec91-28c1-498f-a9a1-080017df5d4c None admin] RBAC: Adding query filter params (role.id=87f040877bfa47bda56305eb022af09e, scope.project.id=0b70b7cdfdb5487d864a3623a8178289, user.id=0d5966b2ce514063aa4a0960fcdc45e2) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:28.256466 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423ec91-28c1-498f-a9a1-080017df5d4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:28.257920 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423ec91-28c1-498f-a9a1-080017df5d4c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:28.272246 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 533/1055] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:25:28 2022] GET /identity/v3/role_assignments?user.id=0d5966b2ce514063aa4a0960fcdc45e2&scope.project.id=0b70b7cdfdb5487d864a3623a8178289&role.id=87f040877bfa47bda56305eb022af09e => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:28.272489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e996d2-5a3b-40ac-bdd9-3d0707db5252 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:28.398329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:28.410478 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e996d2-5a3b-40ac-bdd9-3d0707db5252 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:28.467704 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b24dc-d394-4a43-9642-08e48507aa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:28.469014 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b24dc-d394-4a43-9642-08e48507aa16 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:28.469307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b24dc-d394-4a43-9642-08e48507aa16 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:28.469580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b24dc-d394-4a43-9642-08e48507aa16 None admin] PATH_INFO: `/v3/services/image` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:28.470271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b24dc-d394-4a43-9642-08e48507aa16 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:28.471926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b24dc-d394-4a43-9642-08e48507aa16 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:28.484996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-3e4b24dc-d394-4a43-9642-08e48507aa16 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:25:28.484996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:28.484996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:25:28.484996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:25:28.484996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:25:28.484996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:25:28.484996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:25:28.484996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:28.484996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:25:28.484996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:28.484996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:25:28.484996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:28.484996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:28.484996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:28.484996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:28.484996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:28.484996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:28.486395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:28.486395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:28.486395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:28.486395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:28.486395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:28.486395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:28.486395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:25:28.486395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:25:28.486395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:25:28.486395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:25:28.486395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:28.486395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:28.486395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:28.486395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:28.486395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:28.486395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:28.492235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:28.492235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:28.492235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:28.492235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:28.492235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:28.492235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:28.492235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:28.492235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:28.492235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:28.492235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:28.492235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:25:28.492235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:25:28.492235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 15:25:28.492235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:28.492235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 523/1056] 10.222.0.39 () {56 vars in 1105 bytes} [Thu Jul 14 15:25:28 2022] GET /identity/v3/services/image => generated 86 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:28.494677 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423ec91-28c1-498f-a9a1-080017df5d4c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:28.605704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423ec91-28c1-498f-a9a1-080017df5d4c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:28.607724 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb21274-4eab-469c-a053-5ffa4d22fc8f None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:28.608018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb21274-4eab-469c-a053-5ffa4d22fc8f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:28.608299 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb21274-4eab-469c-a053-5ffa4d22fc8f None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:28.610310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 524/1057] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:28.616009 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23948c57-64d5-4956-b7c4-9067a6b5c6ae None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:28.616329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23948c57-64d5-4956-b7c4-9067a6b5c6ae None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:28.616571 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23948c57-64d5-4956-b7c4-9067a6b5c6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:28.634370 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-23948c57-64d5-4956-b7c4-9067a6b5c6ae None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:28.635588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-23948c57-64d5-4956-b7c4-9067a6b5c6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:28.648747 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a893b0-cacb-4937-a14b-01b0cd5f9d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:28.649316 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a893b0-cacb-4937-a14b-01b0cd5f9d63 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:28.649633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a893b0-cacb-4937-a14b-01b0cd5f9d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:28.649890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a893b0-cacb-4937-a14b-01b0cd5f9d63 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:28.650641 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a893b0-cacb-4937-a14b-01b0cd5f9d63 None admin] RBAC: Adding query filter params (name=image) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:28.650950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a893b0-cacb-4937-a14b-01b0cd5f9d63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:28.652333 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a893b0-cacb-4937-a14b-01b0cd5f9d63 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:28.659042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 534/1058] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:28.665333 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a893b0-cacb-4937-a14b-01b0cd5f9d63 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:28.716605 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:28.731131 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 525/1059] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:25:28.756825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23948c57-64d5-4956-b7c4-9067a6b5c6ae None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:28.800865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a893b0-cacb-4937-a14b-01b0cd5f9d63 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:28.842028 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c2f24-bc48-4767-9ebb-419d6502ded2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:28.842784 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c2f24-bc48-4767-9ebb-419d6502ded2 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:28.843076 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c2f24-bc48-4767-9ebb-419d6502ded2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:28.843356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c2f24-bc48-4767-9ebb-419d6502ded2 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:28.845055 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c2f24-bc48-4767-9ebb-419d6502ded2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:28.845397 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c2f24-bc48-4767-9ebb-419d6502ded2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:28.846895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c2f24-bc48-4767-9ebb-419d6502ded2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:28.852754 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 535/1060] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:28.855736 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:28.859150 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c2f24-bc48-4767-9ebb-419d6502ded2 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:28.875070 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23948c57-64d5-4956-b7c4-9067a6b5c6ae None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:28.915722 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0241a7c-93ce-496b-ab23-2f95f13c5299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:28.916458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0241a7c-93ce-496b-ab23-2f95f13c5299 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:28.916745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0241a7c-93ce-496b-ab23-2f95f13c5299 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:28.917023 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0241a7c-93ce-496b-ab23-2f95f13c5299 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:28.930925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0241a7c-93ce-496b-ab23-2f95f13c5299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:25:28.939983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-d0241a7c-93ce-496b-ab23-2f95f13c5299 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:25:28.939983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:28.939983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:28.939983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:28.939983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:28.939983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:28.939983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:28.939983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:28.939983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:28.939983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:28.939983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:28.939983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:28.939983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:25:28.939983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:25:28.939983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:25:28.939983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:25:28.941038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:25:28.941038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:25:28.941038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:25:28.941038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:25:28.941038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:28.941038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:28.941038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:28.941038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:28.941038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:28.941038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:28.941038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:28.941038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:28.941038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:28.941038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:28.941038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:28.941038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:28.941907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:28.941907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:28.941907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:28.941907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:28.941907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:25:28.941907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:25:28.941907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:25:28.941907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:25:28.941907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:25:28.941907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:25:28.941907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:25:28.941907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:28.941907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 526/1061] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jul 14 15:25:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:28.948184 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0241a7c-93ce-496b-ab23-2f95f13c5299 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:28.988543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c2f24-bc48-4767-9ebb-419d6502ded2 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:28.991601 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:29.029806 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff0578-d64d-4c45-aac9-d39c9ce20109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:29.030499 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff0578-d64d-4c45-aac9-d39c9ce20109 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:29.030780 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff0578-d64d-4c45-aac9-d39c9ce20109 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:29.031678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff0578-d64d-4c45-aac9-d39c9ce20109 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:29.032635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff0578-d64d-4c45-aac9-d39c9ce20109 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:29.034214 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff0578-d64d-4c45-aac9-d39c9ce20109 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:29.057897 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 536/1062] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jul 14 15:25:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:25:29.092880 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0241a7c-93ce-496b-ab23-2f95f13c5299 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:29.141868 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32f527-4fbb-4bf3-9728-2df687fad7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:29.142819 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32f527-4fbb-4bf3-9728-2df687fad7ba None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:29.143172 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32f527-4fbb-4bf3-9728-2df687fad7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:29.143790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32f527-4fbb-4bf3-9728-2df687fad7ba None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:29.145091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32f527-4fbb-4bf3-9728-2df687fad7ba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:29.145406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32f527-4fbb-4bf3-9728-2df687fad7ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:29.146878 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32f527-4fbb-4bf3-9728-2df687fad7ba None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:29.162340 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 527/1063] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jul 14 15:25:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:29.163682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff0578-d64d-4c45-aac9-d39c9ce20109 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:29.278998 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff0578-d64d-4c45-aac9-d39c9ce20109 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:29.317655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd564298-cc78-4534-b58c-d9609a04b001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:29.318502 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd564298-cc78-4534-b58c-d9609a04b001 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:29.318787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd564298-cc78-4534-b58c-d9609a04b001 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:29.319067 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd564298-cc78-4534-b58c-d9609a04b001 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:29.330969 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd564298-cc78-4534-b58c-d9609a04b001 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:29.332464 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd564298-cc78-4534-b58c-d9609a04b001 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:29.351809 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-dd564298-cc78-4534-b58c-d9609a04b001 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:29.351809 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:29.351809 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:29.351809 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:29.351809 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:29.351809 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:29.351809 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:29.351809 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:29.351809 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:29.351809 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:29.351809 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:29.351809 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:29.351809 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:25:29.351809 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:25:29.351809 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:25:29.352990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:25:29.352990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:29.352990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:29.352990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:29.352990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:29.352990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:29.352990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:29.352990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:29.352990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:29.352990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:29.352990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:29.352990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:29.352990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:29.352990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:29.352990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:29.352990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:29.352990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:29.354229 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:25:29.354229 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:25:29.354229 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:29.354229 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:29.354229 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 537/1064] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:29.363319 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32f527-4fbb-4bf3-9728-2df687fad7ba None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:29.369846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:29.511479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32f527-4fbb-4bf3-9728-2df687fad7ba None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:29.550944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f0402-900f-4a04-8b76-62d4c6e01060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:29.551560 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f0402-900f-4a04-8b76-62d4c6e01060 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:29.551858 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f0402-900f-4a04-8b76-62d4c6e01060 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:29.552126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f0402-900f-4a04-8b76-62d4c6e01060 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:29.552903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f0402-900f-4a04-8b76-62d4c6e01060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:29.553227 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f0402-900f-4a04-8b76-62d4c6e01060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:29.554653 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f0402-900f-4a04-8b76-62d4c6e01060 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:29.571991 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 528/1065] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:29.573636 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd564298-cc78-4534-b58c-d9609a04b001 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:29.589850 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:29.688930 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd564298-cc78-4534-b58c-d9609a04b001 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:29.724700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055d1ed-06c9-454f-aaee-d60af25d0552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:29.725500 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055d1ed-06c9-454f-aaee-d60af25d0552 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:29.725787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055d1ed-06c9-454f-aaee-d60af25d0552 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:29.726084 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055d1ed-06c9-454f-aaee-d60af25d0552 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:29.735690 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055d1ed-06c9-454f-aaee-d60af25d0552 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:29.738414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055d1ed-06c9-454f-aaee-d60af25d0552 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:29.755895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-9055d1ed-06c9-454f-aaee-d60af25d0552 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:25:29.755895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:29.755895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:29.755895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:29.755895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:29.755895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:29.755895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:29.755895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:29.755895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:29.755895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:29.755895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:29.755895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:29.755895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:25:29.755895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:25:29.755895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:25:29.755895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:25:29.757195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:29.757195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:29.757195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:25:29.757195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:25:29.757195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:25:29.757195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:25:29.757195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:29.757195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:29.757195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:29.757195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:29.757195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:29.757195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:29.757195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:29.757195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:29.757195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:29.757195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:29.757195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:29.757195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:29.758940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:29.758940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:29.758940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:25:29.758940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:25:29.758940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:25:29.758940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:25:29.758940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:25:29.758940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:25:29.758940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:25:29.758940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:29.758940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 538/1066] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jul 14 15:25:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:29.766171 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f0402-900f-4a04-8b76-62d4c6e01060 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:29.837771 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:29.884331 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f0402-900f-4a04-8b76-62d4c6e01060 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:29.929724 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde14376-c317-45a3-a107-9f26cd91789c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:29.930559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde14376-c317-45a3-a107-9f26cd91789c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:29.930844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde14376-c317-45a3-a107-9f26cd91789c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:29.931118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde14376-c317-45a3-a107-9f26cd91789c None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:29.932185 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde14376-c317-45a3-a107-9f26cd91789c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:29.933851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde14376-c317-45a3-a107-9f26cd91789c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:29.934241 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde14376-c317-45a3-a107-9f26cd91789c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:29.955670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 529/1067] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jul 14 15:25:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:29.962183 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055d1ed-06c9-454f-aaee-d60af25d0552 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:30.080029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:30.140071 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055d1ed-06c9-454f-aaee-d60af25d0552 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:30.185539 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb81826-68cd-4212-bc43-24d3b29854b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:30.186415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb81826-68cd-4212-bc43-24d3b29854b7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:30.186704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb81826-68cd-4212-bc43-24d3b29854b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:30.187006 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb81826-68cd-4212-bc43-24d3b29854b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:30.204530 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb81826-68cd-4212-bc43-24d3b29854b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:30.206015 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb81826-68cd-4212-bc43-24d3b29854b7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:30.225705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-3eb81826-68cd-4212-bc43-24d3b29854b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:30.225705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:30.225705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:30.225705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:30.225705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:30.225705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:30.225705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:30.225705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:30.225705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:30.225705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:30.225705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:30.225705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:30.225705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:25:30.225705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:25:30.225705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:25:30.226929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:25:30.226929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:30.226929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:30.226929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:30.226929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:30.226929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:30.226929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:30.226929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:30.226929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:30.226929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:30.226929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:30.226929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:30.226929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:30.226929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:30.226929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:30.226929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:30.226929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:30.232926 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:25:30.232926 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:25:30.232926 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:30.232926 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:30.232926 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 539/1068] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:25:30.234971 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde14376-c317-45a3-a107-9f26cd91789c None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:30.385101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde14376-c317-45a3-a107-9f26cd91789c None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:30.411371 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:30.430467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950e381-3682-4093-a6e4-d90cf30ac08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:30.430873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950e381-3682-4093-a6e4-d90cf30ac08d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:30.431155 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950e381-3682-4093-a6e4-d90cf30ac08d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:30.431428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950e381-3682-4093-a6e4-d90cf30ac08d None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:30.432159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950e381-3682-4093-a6e4-d90cf30ac08d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:30.432466 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950e381-3682-4093-a6e4-d90cf30ac08d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:30.433853 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950e381-3682-4093-a6e4-d90cf30ac08d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:30.448213 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 530/1069] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:30.450413 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48269fc0-6b90-4681-823a-f5dca30701b9 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:30.450965 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48269fc0-6b90-4681-823a-f5dca30701b9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:30.450965 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48269fc0-6b90-4681-823a-f5dca30701b9 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:30.452521 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 540/1070] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:30.453966 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950e381-3682-4093-a6e4-d90cf30ac08d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:30.458398 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0a8e1-848e-456c-9ae4-642f732e50e9 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:30.458695 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0a8e1-848e-456c-9ae4-642f732e50e9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:30.458985 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0a8e1-848e-456c-9ae4-642f732e50e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:30.479976 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a8a0a8e1-848e-456c-9ae4-642f732e50e9 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:30.481186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a8a0a8e1-848e-456c-9ae4-642f732e50e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:30.572060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950e381-3682-4093-a6e4-d90cf30ac08d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:30.574441 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 541/1071] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:25:30.589092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0a8e1-848e-456c-9ae4-642f732e50e9 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:30.614953 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2c5db-8551-4642-8116-143917f4a1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:30.615758 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2c5db-8551-4642-8116-143917f4a1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:30.616042 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2c5db-8551-4642-8116-143917f4a1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:30.616318 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2c5db-8551-4642-8116-143917f4a1f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:30.626142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2c5db-8551-4642-8116-143917f4a1f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:30.627683 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2c5db-8551-4642-8116-143917f4a1f4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:30.643348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-26e2c5db-8551-4642-8116-143917f4a1f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:25:30.643348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:30.643348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:30.643348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:30.643348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:30.643348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:30.643348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:30.643348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:30.643348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:30.643348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:30.643348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:30.643348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:30.643348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:25:30.643348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:25:30.643348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:25:30.644333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:25:30.644333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:30.644333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:30.644333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:30.644333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:30.644333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:30.644333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:30.644333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:30.644333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:30.644333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:30.644333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:30.644333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:30.644333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:30.644333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:30.644333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:30.644333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:30.644333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:30.645358 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:25:30.645358 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:25:30.645358 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:25:30.645358 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:25:30.645358 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:25:30.645358 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:25:30.645358 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:25:30.645358 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:30.649283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 531/1072] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:25:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:25:30.650581 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2c5db-8551-4642-8116-143917f4a1f4 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:30.672657 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:30.700096 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:30.722729 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0a8e1-848e-456c-9ae4-642f732e50e9 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:30.759116 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae70da4-d660-48c9-911e-2c30bdf31733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:30.759905 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae70da4-d660-48c9-911e-2c30bdf31733 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:30.760194 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae70da4-d660-48c9-911e-2c30bdf31733 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:30.760478 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae70da4-d660-48c9-911e-2c30bdf31733 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:30.762583 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2c5db-8551-4642-8116-143917f4a1f4 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:30.772242 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae70da4-d660-48c9-911e-2c30bdf31733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:25:30.781704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-fae70da4-d660-48c9-911e-2c30bdf31733 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:25:30.781704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:30.781704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:30.781704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:30.781704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:30.781704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:30.781704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:30.781704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:30.781704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:30.781704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:30.781704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:30.781704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:30.781704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:25:30.781704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:25:30.781704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:25:30.781704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:25:30.782772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:25:30.782772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:25:30.782772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:25:30.782772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:25:30.782772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:30.782772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:30.782772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:30.782772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:30.782772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:30.782772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:30.782772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:30.782772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:30.782772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:30.782772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:30.782772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:30.782772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:30.783672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:30.783672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:30.783672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:30.783672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:30.783672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:25:30.783672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:25:30.783672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:25:30.783672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:25:30.783672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:25:30.783672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:25:30.783672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:25:30.783672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:30.788660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 542/1073] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:25:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:25:30.789305 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae70da4-d660-48c9-911e-2c30bdf31733 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:30.804992 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b10a3c-c0e6-49e0-a5df-c2af7e0ea7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:30.805718 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b10a3c-c0e6-49e0-a5df-c2af7e0ea7cd None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:30.806140 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b10a3c-c0e6-49e0-a5df-c2af7e0ea7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:30.806423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b10a3c-c0e6-49e0-a5df-c2af7e0ea7cd None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:30.807337 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b10a3c-c0e6-49e0-a5df-c2af7e0ea7cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:30.807651 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b10a3c-c0e6-49e0-a5df-c2af7e0ea7cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:30.809092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b10a3c-c0e6-49e0-a5df-c2af7e0ea7cd None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:30.822809 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 532/1074] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:25:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:30.829844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b10a3c-c0e6-49e0-a5df-c2af7e0ea7cd None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:30.898190 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae70da4-d660-48c9-911e-2c30bdf31733 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:30.915429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:30.939326 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4e278-721b-4fe0-acee-4c196a682969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:30.939920 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4e278-721b-4fe0-acee-4c196a682969 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:30.940205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4e278-721b-4fe0-acee-4c196a682969 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:30.940482 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4e278-721b-4fe0-acee-4c196a682969 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:30.941243 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4e278-721b-4fe0-acee-4c196a682969 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:30.941555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4e278-721b-4fe0-acee-4c196a682969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:30.943077 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4e278-721b-4fe0-acee-4c196a682969 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:30.950726 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b10a3c-c0e6-49e0-a5df-c2af7e0ea7cd None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:30.957670 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 543/1075] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:25:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:30.958488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:30.958680 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4e278-721b-4fe0-acee-4c196a682969 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:30.995358 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d6823-954a-45ae-94be-00a084807616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:30.996383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d6823-954a-45ae-94be-00a084807616 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:30.996713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d6823-954a-45ae-94be-00a084807616 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:30.997041 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759d6823-954a-45ae-94be-00a084807616 None admin] PATH_INFO: `/v3/projects/ba19b660ef1442289fb322231ce26f07/users/64f6b597a47c4a0eb08d1eabc4c0305c/roles/98b969f0afd54257a83a07bfcc0cd3e3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:30.999506 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d6823-954a-45ae-94be-00a084807616 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba19b660ef1442289fb322231ce26f07, user_id=64f6b597a47c4a0eb08d1eabc4c0305c, role_id=98b969f0afd54257a83a07bfcc0cd3e3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:31.001912 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759d6823-954a-45ae-94be-00a084807616 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:31.018945 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 533/1076] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:25:30 2022] PUT /identity/v3/projects/ba19b660ef1442289fb322231ce26f07/users/64f6b597a47c4a0eb08d1eabc4c0305c/roles/98b969f0afd54257a83a07bfcc0cd3e3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:25:31.075141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4e278-721b-4fe0-acee-4c196a682969 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:31.115576 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c54b1-c02e-48d0-93df-d4db29975e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:31.116477 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c54b1-c02e-48d0-93df-d4db29975e07 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:31.116784 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c54b1-c02e-48d0-93df-d4db29975e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:31.117063 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c54b1-c02e-48d0-93df-d4db29975e07 None admin] PATH_INFO: `/v3/users/0d5966b2ce514063aa4a0960fcdc45e2` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:31.118361 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c54b1-c02e-48d0-93df-d4db29975e07 None admin] RBAC: Authorizing `identity:get_user(user_id=0d5966b2ce514063aa4a0960fcdc45e2)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:31.119827 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c54b1-c02e-48d0-93df-d4db29975e07 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:31.121684 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 544/1077] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:25:30 2022] GET /identity/v3/users/0d5966b2ce514063aa4a0960fcdc45e2 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:31.128119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d6823-954a-45ae-94be-00a084807616 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:31.246814 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759d6823-954a-45ae-94be-00a084807616 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:31.282805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74c0e9-37a1-4ba4-8d5d-859a16086aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:31.285609 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74c0e9-37a1-4ba4-8d5d-859a16086aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:31.285609 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74c0e9-37a1-4ba4-8d5d-859a16086aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:31.285609 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74c0e9-37a1-4ba4-8d5d-859a16086aa6 None admin] PATH_INFO: `/v3/projects/0b70b7cdfdb5487d864a3623a8178289` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:31.286889 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74c0e9-37a1-4ba4-8d5d-859a16086aa6 None admin] RBAC: Authorizing `identity:get_project(project_id=0b70b7cdfdb5487d864a3623a8178289)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:31.288902 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74c0e9-37a1-4ba4-8d5d-859a16086aa6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:31.291601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 534/1078] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:25:31 2022] GET /identity/v3/projects/0b70b7cdfdb5487d864a3623a8178289 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:31.298396 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c54b1-c02e-48d0-93df-d4db29975e07 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:31.325046 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9187a97-6118-4a9d-9ece-a1752af62689 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:31.325409 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9187a97-6118-4a9d-9ece-a1752af62689 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:31.325569 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9187a97-6118-4a9d-9ece-a1752af62689 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:31.327234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 535/1079] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:31.333661 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca93c4-a7ef-483f-bacd-25902fec67b3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:31.333661 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca93c4-a7ef-483f-bacd-25902fec67b3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:31.334091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca93c4-a7ef-483f-bacd-25902fec67b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:31.356268 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-60ca93c4-a7ef-483f-bacd-25902fec67b3 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:31.357771 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-60ca93c4-a7ef-483f-bacd-25902fec67b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:31.370088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:31.394218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:31.455252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c54b1-c02e-48d0-93df-d4db29975e07 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:31.463815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 536/1080] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:25:31.490538 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca93c4-a7ef-483f-bacd-25902fec67b3 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:31.497510 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a8ab5-7595-4705-8375-692f2e9524d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:31.498954 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a8ab5-7595-4705-8375-692f2e9524d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:31.499396 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a8ab5-7595-4705-8375-692f2e9524d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:31.499876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a8ab5-7595-4705-8375-692f2e9524d1 None admin] PATH_INFO: `/v3/projects/0b70b7cdfdb5487d864a3623a8178289/users/0d5966b2ce514063aa4a0960fcdc45e2/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:31.502277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a8ab5-7595-4705-8375-692f2e9524d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b70b7cdfdb5487d864a3623a8178289, user_id=0d5966b2ce514063aa4a0960fcdc45e2, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:31.503785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a8ab5-7595-4705-8375-692f2e9524d1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:31.522045 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 545/1081] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:25:31 2022] PUT /identity/v3/projects/0b70b7cdfdb5487d864a3623a8178289/users/0d5966b2ce514063aa4a0960fcdc45e2/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:25:31.663893 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca93c4-a7ef-483f-bacd-25902fec67b3 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:31.708791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f839ac-0f91-46d9-8878-85c4bbde74ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:31.709451 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f839ac-0f91-46d9-8878-85c4bbde74ff None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:31.709780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f839ac-0f91-46d9-8878-85c4bbde74ff None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:31.710054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f839ac-0f91-46d9-8878-85c4bbde74ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:31.746134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:31.819851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f839ac-0f91-46d9-8878-85c4bbde74ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:31.822565 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f839ac-0f91-46d9-8878-85c4bbde74ff None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:32.005161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 537/1082] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:25:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:25:32.007472 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a8ab5-7595-4705-8375-692f2e9524d1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:32.120309 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a8ab5-7595-4705-8375-692f2e9524d1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:32.122700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:32.160830 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b410f-f379-4365-8132-3077f47cac08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:32.161480 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b410f-f379-4365-8132-3077f47cac08 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:32.161768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b410f-f379-4365-8132-3077f47cac08 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:32.162051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b410f-f379-4365-8132-3077f47cac08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:32.174016 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b410f-f379-4365-8132-3077f47cac08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:32.175526 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b410f-f379-4365-8132-3077f47cac08 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:32.195315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-b23b410f-f379-4365-8132-3077f47cac08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:32.195315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:32.195315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:32.195315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:32.195315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:32.195315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:32.195315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:32.195315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:32.195315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:32.195315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:32.195315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:32.195315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:32.195315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:25:32.195315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:25:32.195315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:25:32.196290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:25:32.196290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:32.196290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:32.196290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:32.196290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:32.196290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:32.196290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:32.196290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:32.196290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:32.196290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:32.196290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:32.196290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:32.196290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:32.196290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:32.196290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:32.196290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:32.196290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:32.204003 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:25:32.204003 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:25:32.204003 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:32.204003 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:32.204003 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 546/1083] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:32.206223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f839ac-0f91-46d9-8878-85c4bbde74ff None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:32.276096 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:32.322040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f839ac-0f91-46d9-8878-85c4bbde74ff None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:32.360718 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad7c40-bbf1-4b60-81cd-bbb9a2a1a9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:32.361403 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad7c40-bbf1-4b60-81cd-bbb9a2a1a9bf None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:32.361686 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad7c40-bbf1-4b60-81cd-bbb9a2a1a9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:32.361962 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad7c40-bbf1-4b60-81cd-bbb9a2a1a9bf None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:32.362765 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad7c40-bbf1-4b60-81cd-bbb9a2a1a9bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:32.363130 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad7c40-bbf1-4b60-81cd-bbb9a2a1a9bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:32.364595 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad7c40-bbf1-4b60-81cd-bbb9a2a1a9bf None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:32.386203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 538/1084] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:33.356676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cad293-7540-41e2-abb0-2849584fb6d7 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:33.357223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cad293-7540-41e2-abb0-2849584fb6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:33.357223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cad293-7540-41e2-abb0-2849584fb6d7 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:33.358641 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 547/1085] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:33.364789 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f64ba7-88a6-4cbd-ad9a-23520c806eef None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:33.365278 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f64ba7-88a6-4cbd-ad9a-23520c806eef None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:33.365375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f64ba7-88a6-4cbd-ad9a-23520c806eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:33.383106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d7f64ba7-88a6-4cbd-ad9a-23520c806eef None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:33.384343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d7f64ba7-88a6-4cbd-ad9a-23520c806eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:33.461221 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 539/1086] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:33.485955 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cad293-7540-41e2-abb0-2849584fb6d7 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:33.606001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cad293-7540-41e2-abb0-2849584fb6d7 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:33.647665 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e23460-a6da-4f34-a19b-1cd98adf982c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:33.648386 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e23460-a6da-4f34-a19b-1cd98adf982c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:33.648671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e23460-a6da-4f34-a19b-1cd98adf982c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:33.648948 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e23460-a6da-4f34-a19b-1cd98adf982c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:33.659494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e23460-a6da-4f34-a19b-1cd98adf982c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:25:33.667561 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-99e23460-a6da-4f34-a19b-1cd98adf982c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:25:33.667561 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:33.667561 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:33.667561 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:33.667561 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:33.667561 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:33.667561 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:33.667561 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:33.667561 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:33.667561 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:33.667561 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:33.667561 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:33.667561 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:25:33.667561 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:25:33.667561 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:25:33.667561 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:25:33.668525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:25:33.668525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:25:33.668525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:25:33.668525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:25:33.668525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:33.668525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:33.668525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:33.668525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:33.668525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:33.668525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:33.668525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:33.668525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:33.668525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:33.668525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:33.668525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:33.668525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:33.669376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:33.669376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:33.669376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:33.669376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:33.669376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:25:33.669376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:25:33.669376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:25:33.669376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:25:33.669376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:25:33.669376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:25:33.669376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 14 15:25:33.669376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:33.669376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 548/1087] 10.222.0.39 () {56 vars in 1120 bytes} [Thu Jul 14 15:25:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:33.675970 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f64ba7-88a6-4cbd-ad9a-23520c806eef None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:33.710485 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9351cb-a6a2-4409-ad68-30c707d61ba1 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:33.710777 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9351cb-a6a2-4409-ad68-30c707d61ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:33.711053 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9351cb-a6a2-4409-ad68-30c707d61ba1 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:33.712478 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 549/1088] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:25:33.717676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9aa145-cb55-4125-b13c-69e2278e4713 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:33.717868 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9aa145-cb55-4125-b13c-69e2278e4713 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:33.718132 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9aa145-cb55-4125-b13c-69e2278e4713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:33.726099 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:33.736340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ba9aa145-cb55-4125-b13c-69e2278e4713 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:33.737542 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ba9aa145-cb55-4125-b13c-69e2278e4713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:33.748153 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:33.776392 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f64ba7-88a6-4cbd-ad9a-23520c806eef None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:33.810336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 550/1089] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 15:25:33.816855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7eceb-c3e4-46ff-983c-2161ecdce33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:33.817539 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7eceb-c3e4-46ff-983c-2161ecdce33b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:33.817826 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7eceb-c3e4-46ff-983c-2161ecdce33b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:33.818129 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7eceb-c3e4-46ff-983c-2161ecdce33b None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:33.818886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7eceb-c3e4-46ff-983c-2161ecdce33b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:33.819267 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7eceb-c3e4-46ff-983c-2161ecdce33b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:33.820665 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7eceb-c3e4-46ff-983c-2161ecdce33b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:33.831758 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 540/1090] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jul 14 15:25:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:33.836104 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9aa145-cb55-4125-b13c-69e2278e4713 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:33.837056 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7eceb-c3e4-46ff-983c-2161ecdce33b None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:33.938651 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7eceb-c3e4-46ff-983c-2161ecdce33b None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:33.938874 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9aa145-cb55-4125-b13c-69e2278e4713 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:33.956584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:33.975627 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902e477-3aa5-48be-b1cc-ed2bd4f380c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:33.976418 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902e477-3aa5-48be-b1cc-ed2bd4f380c3 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:33.976705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902e477-3aa5-48be-b1cc-ed2bd4f380c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:33.976986 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902e477-3aa5-48be-b1cc-ed2bd4f380c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:33.978853 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a3b40-8f6c-461b-84a4-9a6e94be8fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:33.979645 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a3b40-8f6c-461b-84a4-9a6e94be8fcf None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:33.979930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a3b40-8f6c-461b-84a4-9a6e94be8fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:33.980210 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a3b40-8f6c-461b-84a4-9a6e94be8fcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:33.988251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902e477-3aa5-48be-b1cc-ed2bd4f380c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:25:33.991289 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a3b40-8f6c-461b-84a4-9a6e94be8fcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:33.992770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a3b40-8f6c-461b-84a4-9a6e94be8fcf None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:33.996351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-6902e477-3aa5-48be-b1cc-ed2bd4f380c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:25:33.996351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:33.996351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:33.996351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:33.996351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:33.996351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:33.996351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:33.996351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:33.996351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:33.996351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:33.996351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:33.996351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:33.996351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:25:33.996351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:25:33.996351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:25:33.996351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:25:33.997475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:25:33.997475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:25:33.997475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:25:33.997475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:25:33.997475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:33.997475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:33.997475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:33.997475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:33.997475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:33.997475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:33.997475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:33.997475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:33.997475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:33.997475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:33.997475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:33.997475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:34.003251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:34.003251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:34.003251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:34.003251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:34.003251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:25:34.003251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:25:34.003251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:25:34.003251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:25:34.003251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:25:34.003251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:25:34.003251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:25:34.003251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:34.003251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 551/1091] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:25:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:34.004635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902e477-3aa5-48be-b1cc-ed2bd4f380c3 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:34.014412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:34.024625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-608a3b40-8f6c-461b-84a4-9a6e94be8fcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:34.024625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:34.024625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:34.024625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:34.024625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:34.024625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:34.024625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:34.024625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:34.024625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:34.024625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:34.024625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:34.024625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:34.024625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:25:34.024625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:25:34.024625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:25:34.025572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:25:34.025572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:34.025572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:34.025572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:34.025572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:34.025572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:34.025572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:34.025572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:34.025572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:34.025572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:34.025572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:34.025572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:34.025572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:34.025572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:34.025572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:34.025572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:34.025572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:34.026521 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:25:34.026521 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:25:34.026521 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:34.026521 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:34.026772 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 541/1092] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:25:34.032403 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a3b40-8f6c-461b-84a4-9a6e94be8fcf None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:34.110979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902e477-3aa5-48be-b1cc-ed2bd4f380c3 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:34.132827 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a3b40-8f6c-461b-84a4-9a6e94be8fcf None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:34.145127 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a0e9b-5b51-4fd6-9de9-b0f8b8b0b16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:34.145799 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a0e9b-5b51-4fd6-9de9-b0f8b8b0b16a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:34.146104 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a0e9b-5b51-4fd6-9de9-b0f8b8b0b16a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:34.146386 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a0e9b-5b51-4fd6-9de9-b0f8b8b0b16a None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:34.147131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a0e9b-5b51-4fd6-9de9-b0f8b8b0b16a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:34.147445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a0e9b-5b51-4fd6-9de9-b0f8b8b0b16a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:34.148817 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a0e9b-5b51-4fd6-9de9-b0f8b8b0b16a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:34.157373 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 552/1093] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:25:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:34.163130 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a0e9b-5b51-4fd6-9de9-b0f8b8b0b16a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:34.166285 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9f12b-9192-4f5a-9bc7-f7d601ee4358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:34.166952 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9f12b-9192-4f5a-9bc7-f7d601ee4358 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:34.167242 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9f12b-9192-4f5a-9bc7-f7d601ee4358 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:34.167523 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9f12b-9192-4f5a-9bc7-f7d601ee4358 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:34.168248 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9f12b-9192-4f5a-9bc7-f7d601ee4358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:34.168559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9f12b-9192-4f5a-9bc7-f7d601ee4358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:34.169939 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9f12b-9192-4f5a-9bc7-f7d601ee4358 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:34.183675 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 542/1094] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:34.189799 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9f12b-9192-4f5a-9bc7-f7d601ee4358 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:34.215337 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:34.230599 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:34.264194 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a0e9b-5b51-4fd6-9de9-b0f8b8b0b16a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:34.292438 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9f12b-9192-4f5a-9bc7-f7d601ee4358 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:34.298375 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0d13b-3035-4c73-8445-c3d853b1cbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:34.299497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0d13b-3035-4c73-8445-c3d853b1cbbf None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:34.299779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0d13b-3035-4c73-8445-c3d853b1cbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:34.300050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0d13b-3035-4c73-8445-c3d853b1cbbf None admin] PATH_INFO: `/v3/users/0d5966b2ce514063aa4a0960fcdc45e2` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:34.301233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0d13b-3035-4c73-8445-c3d853b1cbbf None admin] RBAC: Authorizing `identity:get_user(user_id=0d5966b2ce514063aa4a0960fcdc45e2)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:34.302710 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0d13b-3035-4c73-8445-c3d853b1cbbf None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:34.304511 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 553/1095] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:25:34 2022] GET /identity/v3/users/0d5966b2ce514063aa4a0960fcdc45e2 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:34.309910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0d13b-3035-4c73-8445-c3d853b1cbbf None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:34.329805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4269561-6b0e-409b-99a3-61a129435b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:34.330630 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4269561-6b0e-409b-99a3-61a129435b68 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:34.330908 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4269561-6b0e-409b-99a3-61a129435b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:34.331178 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4269561-6b0e-409b-99a3-61a129435b68 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:34.338244 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4269561-6b0e-409b-99a3-61a129435b68 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:34.339679 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4269561-6b0e-409b-99a3-61a129435b68 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:34.354470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-b4269561-6b0e-409b-99a3-61a129435b68 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:25:34.354470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:34.354470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:34.354470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:34.354470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:34.354470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:34.354470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:34.354470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:34.354470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:34.354470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:34.354470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:34.354470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:34.354470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:25:34.354470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:25:34.354470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:25:34.354470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:25:34.355729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:34.355729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:34.355729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:25:34.355729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:25:34.355729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:25:34.355729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:25:34.355729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:34.355729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:34.355729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:34.355729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:34.355729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:34.355729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:34.355729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:34.355729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:34.355729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:34.355729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:34.355729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:34.355729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:34.356930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:34.356930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:34.356930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:25:34.356930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:25:34.356930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:25:34.356930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:25:34.356930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:25:34.356930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:25:34.356930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 15:25:34.356930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:34.356930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 543/1096] 10.222.0.39 () {56 vars in 1093 bytes} [Thu Jul 14 15:25:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:25:34.362534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4269561-6b0e-409b-99a3-61a129435b68 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:34.415852 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0d13b-3035-4c73-8445-c3d853b1cbbf None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:34.456325 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:34.462491 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e12019-d858-403f-931f-4601ea2a87f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:34.463180 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e12019-d858-403f-931f-4601ea2a87f2 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:34.463584 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e12019-d858-403f-931f-4601ea2a87f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:34.463772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e12019-d858-403f-931f-4601ea2a87f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:34.467628 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:34.479052 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4269561-6b0e-409b-99a3-61a129435b68 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:34.521437 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a30589-a5b2-4c95-bc34-2d603239a883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:34.522156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a30589-a5b2-4c95-bc34-2d603239a883 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:34.522445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a30589-a5b2-4c95-bc34-2d603239a883 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:34.522730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a30589-a5b2-4c95-bc34-2d603239a883 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:34.523592 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a30589-a5b2-4c95-bc34-2d603239a883 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:34.523909 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a30589-a5b2-4c95-bc34-2d603239a883 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:34.525388 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a30589-a5b2-4c95-bc34-2d603239a883 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:34.541627 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e12019-d858-403f-931f-4601ea2a87f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:34.543148 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e12019-d858-403f-931f-4601ea2a87f2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:34.547033 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 544/1097] 10.222.0.39 () {56 vars in 1133 bytes} [Thu Jul 14 15:25:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:34.553832 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a30589-a5b2-4c95-bc34-2d603239a883 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:34.662144 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 554/1098] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:25:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 15:25:34.668176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e12019-d858-403f-931f-4601ea2a87f2 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:34.675842 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a30589-a5b2-4c95-bc34-2d603239a883 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:34.707877 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:34.712369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760539f3-2db8-4544-ac16-f3199671daed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:34.713025 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760539f3-2db8-4544-ac16-f3199671daed None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:34.713594 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760539f3-2db8-4544-ac16-f3199671daed None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:34.713594 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760539f3-2db8-4544-ac16-f3199671daed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:34.726587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:34.778650 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e12019-d858-403f-931f-4601ea2a87f2 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:34.784673 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760539f3-2db8-4544-ac16-f3199671daed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:34.786193 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760539f3-2db8-4544-ac16-f3199671daed None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:34.817362 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d9910-166f-44c0-9cbb-8ef4b69a521d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:34.818269 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d9910-166f-44c0-9cbb-8ef4b69a521d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:34.818560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d9910-166f-44c0-9cbb-8ef4b69a521d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:34.818841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d9910-166f-44c0-9cbb-8ef4b69a521d None admin] PATH_INFO: `/v3/projects/0b70b7cdfdb5487d864a3623a8178289` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:34.820036 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d9910-166f-44c0-9cbb-8ef4b69a521d None admin] RBAC: Authorizing `identity:get_project(project_id=0b70b7cdfdb5487d864a3623a8178289)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:34.821488 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d9910-166f-44c0-9cbb-8ef4b69a521d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:34.823380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 555/1099] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:25:34 2022] GET /identity/v3/projects/0b70b7cdfdb5487d864a3623a8178289 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:34.830455 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d9910-166f-44c0-9cbb-8ef4b69a521d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:34.903519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 545/1100] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:25:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 15:25:34.910681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760539f3-2db8-4544-ac16-f3199671daed None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:34.947257 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d9910-166f-44c0-9cbb-8ef4b69a521d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:34.949780 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:34.962701 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:34.987025 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2b0a8-a2a5-4899-a93e-a794616005fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:34.987742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2b0a8-a2a5-4899-a93e-a794616005fd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:34.988032 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2b0a8-a2a5-4899-a93e-a794616005fd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:34.988314 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2b0a8-a2a5-4899-a93e-a794616005fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:34.989168 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2b0a8-a2a5-4899-a93e-a794616005fd None admin] RBAC: Adding query filter params (role.id=87f040877bfa47bda56305eb022af09e, scope.project.id=0b70b7cdfdb5487d864a3623a8178289, user.id=0d5966b2ce514063aa4a0960fcdc45e2) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:34.989487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2b0a8-a2a5-4899-a93e-a794616005fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:34.990996 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2b0a8-a2a5-4899-a93e-a794616005fd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:34.997284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 556/1101] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:25:34 2022] GET /identity/v3/role_assignments?user.id=0d5966b2ce514063aa4a0960fcdc45e2&scope.project.id=0b70b7cdfdb5487d864a3623a8178289&role.id=87f040877bfa47bda56305eb022af09e => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:35.038085 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760539f3-2db8-4544-ac16-f3199671daed None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:35.078545 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a748c87-31ee-4796-9351-2f8b4e1861b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:35.079360 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a748c87-31ee-4796-9351-2f8b4e1861b4 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:35.079649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a748c87-31ee-4796-9351-2f8b4e1861b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:35.079932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a748c87-31ee-4796-9351-2f8b4e1861b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:35.091772 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a748c87-31ee-4796-9351-2f8b4e1861b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:35.093398 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a748c87-31ee-4796-9351-2f8b4e1861b4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:35.113448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-4a748c87-31ee-4796-9351-2f8b4e1861b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:35.113448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:35.113448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:35.113448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:35.113448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:35.113448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:35.113448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:35.113448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:35.113448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:35.113448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:35.113448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:35.113448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:35.113448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:25:35.113448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:25:35.113448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:25:35.114680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:25:35.114680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:35.114680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:35.114680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:35.114680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:35.114680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:35.114680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:35.114680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:35.114680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:35.114680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:35.114680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:35.114680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:35.114680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:35.114680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:35.114680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:35.114680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:35.114680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:35.116077 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:25:35.116077 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:25:35.116077 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:25:35.116077 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:35.116077 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 546/1102] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:25:35.120725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2b0a8-a2a5-4899-a93e-a794616005fd None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:35.244810 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2b0a8-a2a5-4899-a93e-a794616005fd None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:35.286988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654ea10-d80d-442b-b382-e4721ae26112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:35.287669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654ea10-d80d-442b-b382-e4721ae26112 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:35.287956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654ea10-d80d-442b-b382-e4721ae26112 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:35.288239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654ea10-d80d-442b-b382-e4721ae26112 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:35.288969 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654ea10-d80d-442b-b382-e4721ae26112 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:35.289280 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654ea10-d80d-442b-b382-e4721ae26112 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:35.290706 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654ea10-d80d-442b-b382-e4721ae26112 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:35.303951 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 557/1103] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:35.309664 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a748c87-31ee-4796-9351-2f8b4e1861b4 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:35.419714 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:35.429480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a748c87-31ee-4796-9351-2f8b4e1861b4 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:35.467539 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a4bb8-2689-4154-9094-cf81a48ead96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:35.467539 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a4bb8-2689-4154-9094-cf81a48ead96 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:35.467539 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a4bb8-2689-4154-9094-cf81a48ead96 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:35.468386 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a4bb8-2689-4154-9094-cf81a48ead96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:35.475499 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a4bb8-2689-4154-9094-cf81a48ead96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:35.476974 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a4bb8-2689-4154-9094-cf81a48ead96 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:35.491548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-e58a4bb8-2689-4154-9094-cf81a48ead96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:25:35.491548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:35.491548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:35.491548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:35.491548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:35.491548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:35.491548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:35.491548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:35.491548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:35.491548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:35.491548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:35.491548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:35.491548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:25:35.491548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:25:35.491548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:25:35.492580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:25:35.492580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:35.492580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:35.492580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:35.492580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:35.492580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:35.492580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:35.492580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:35.492580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:35.492580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:35.492580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:35.492580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:35.492580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:35.492580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:35.492580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:35.492580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:35.492580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:35.493494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:25:35.493494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:25:35.493494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:25:35.493494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:25:35.493494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:25:35.493494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:25:35.493494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:25:35.493494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:25:35.493494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 547/1104] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:25:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:35.499008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654ea10-d80d-442b-b382-e4721ae26112 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:35.529192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:35.602485 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654ea10-d80d-442b-b382-e4721ae26112 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:35.638968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce44cfc-4fe4-4020-a041-49077a696de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:35.639629 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce44cfc-4fe4-4020-a041-49077a696de3 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:35.639908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce44cfc-4fe4-4020-a041-49077a696de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:35.640263 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce44cfc-4fe4-4020-a041-49077a696de3 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:35.641053 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce44cfc-4fe4-4020-a041-49077a696de3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:35.641360 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce44cfc-4fe4-4020-a041-49077a696de3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:35.643265 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce44cfc-4fe4-4020-a041-49077a696de3 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:35.655468 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 558/1105] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:25:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:35.661879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a4bb8-2689-4154-9094-cf81a48ead96 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:35.764973 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a4bb8-2689-4154-9094-cf81a48ead96 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:35.800227 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb04ccc-f8a0-4377-9c59-4a199ea15de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:35.800884 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb04ccc-f8a0-4377-9c59-4a199ea15de5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:35.801170 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb04ccc-f8a0-4377-9c59-4a199ea15de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:35.801448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb04ccc-f8a0-4377-9c59-4a199ea15de5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:35.802313 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb04ccc-f8a0-4377-9c59-4a199ea15de5 None admin] RBAC: Adding query filter params (role.id=98b969f0afd54257a83a07bfcc0cd3e3, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=64f6b597a47c4a0eb08d1eabc4c0305c) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:35.802630 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb04ccc-f8a0-4377-9c59-4a199ea15de5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:35.804071 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb04ccc-f8a0-4377-9c59-4a199ea15de5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:35.810309 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 548/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:25:35 2022] GET /identity/v3/role_assignments?user.id=64f6b597a47c4a0eb08d1eabc4c0305c&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=98b969f0afd54257a83a07bfcc0cd3e3 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:37.206803 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f4379-0fc9-4688-9204-4958fc4546ee None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:37.207366 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f4379-0fc9-4688-9204-4958fc4546ee None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:37.207366 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f4379-0fc9-4688-9204-4958fc4546ee None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:37.208725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 559/1107] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:37.213976 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862138e-4db9-4dfd-9b17-60135ba1bc95 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:37.214434 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862138e-4db9-4dfd-9b17-60135ba1bc95 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:37.214571 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862138e-4db9-4dfd-9b17-60135ba1bc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:37.232197 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-0862138e-4db9-4dfd-9b17-60135ba1bc95 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:37.233410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0862138e-4db9-4dfd-9b17-60135ba1bc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:37.247193 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:37.305292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 549/1108] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:37.339440 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f4379-0fc9-4688-9204-4958fc4546ee None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:37.452014 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:37.465962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f4379-0fc9-4688-9204-4958fc4546ee None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:37.501760 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f128b0-2787-4849-b2b9-e5a57a6ee2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:37.502653 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f128b0-2787-4849-b2b9-e5a57a6ee2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:37.502985 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f128b0-2787-4849-b2b9-e5a57a6ee2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:37.503298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f128b0-2787-4849-b2b9-e5a57a6ee2c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:37.504555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f128b0-2787-4849-b2b9-e5a57a6ee2c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:37.506024 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f128b0-2787-4849-b2b9-e5a57a6ee2c7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:37.507688 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 560/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:37.513653 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862138e-4db9-4dfd-9b17-60135ba1bc95 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:37.614269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862138e-4db9-4dfd-9b17-60135ba1bc95 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:37.648345 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757f946-99a6-4673-aac1-7210fd8e3f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:37.649012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757f946-99a6-4673-aac1-7210fd8e3f45 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:37.649296 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757f946-99a6-4673-aac1-7210fd8e3f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:37.649570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757f946-99a6-4673-aac1-7210fd8e3f45 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:37.650316 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757f946-99a6-4673-aac1-7210fd8e3f45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:37.651751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757f946-99a6-4673-aac1-7210fd8e3f45 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:37.672855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 550/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jul 14 15:25:37 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:25:39.822654 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f73c3-b372-44e2-839c-68d9e212df99 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:39.823195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f73c3-b372-44e2-839c-68d9e212df99 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:39.823195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f73c3-b372-44e2-839c-68d9e212df99 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:39.824569 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 561/1111] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:39.830583 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e88f6c-4187-4c79-aa25-d33468571e58 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:39.831027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e88f6c-4187-4c79-aa25-d33468571e58 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:39.831115 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e88f6c-4187-4c79-aa25-d33468571e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:39.837054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:39.849286 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-06e88f6c-4187-4c79-aa25-d33468571e58 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:39.850675 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-06e88f6c-4187-4c79-aa25-d33468571e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:39.917142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 551/1112] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:39.942521 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f73c3-b372-44e2-839c-68d9e212df99 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:40.043857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f73c3-b372-44e2-839c-68d9e212df99 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:40.078975 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728c618-d4a4-42fa-b56a-858a06d53568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:40.079742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728c618-d4a4-42fa-b56a-858a06d53568 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:40.080029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728c618-d4a4-42fa-b56a-858a06d53568 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:40.080305 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728c618-d4a4-42fa-b56a-858a06d53568 None admin] PATH_INFO: `/v3/roles/26bfea3cd8164feeb8043fd508a5268c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:40.081793 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728c618-d4a4-42fa-b56a-858a06d53568 None admin] RBAC: Authorizing `identity:get_role(role_id=26bfea3cd8164feeb8043fd508a5268c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:40.083215 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728c618-d4a4-42fa-b56a-858a06d53568 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:40.084590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 562/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:25:39 2022] GET /identity/v3/roles/26bfea3cd8164feeb8043fd508a5268c => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:40.090649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e88f6c-4187-4c79-aa25-d33468571e58 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:40.191949 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e88f6c-4187-4c79-aa25-d33468571e58 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:40.229736 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8d591-eeaa-4533-9d15-b741923d7c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:40.230638 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8d591-eeaa-4533-9d15-b741923d7c7a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:40.230922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8d591-eeaa-4533-9d15-b741923d7c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:40.231196 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8d591-eeaa-4533-9d15-b741923d7c7a None admin] PATH_INFO: `/v3/users/0de911fa59314b51a1a73849ac48f001` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:40.233242 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:40.246030 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8d591-eeaa-4533-9d15-b741923d7c7a None admin] RBAC: Authorizing `identity:get_user(user_id=0de911fa59314b51a1a73849ac48f001)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:40.247517 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8d591-eeaa-4533-9d15-b741923d7c7a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:40.249217 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 552/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:25:40 2022] GET /identity/v3/users/0de911fa59314b51a1a73849ac48f001 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:40.256030 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728c618-d4a4-42fa-b56a-858a06d53568 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:40.283585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:40.367702 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728c618-d4a4-42fa-b56a-858a06d53568 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:40.405735 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfef95d-ea64-4f19-8396-3caa04af200d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:40.406715 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfef95d-ea64-4f19-8396-3caa04af200d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:40.407003 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfef95d-ea64-4f19-8396-3caa04af200d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:40.407288 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfef95d-ea64-4f19-8396-3caa04af200d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:40.487843 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfef95d-ea64-4f19-8396-3caa04af200d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:40.489300 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfef95d-ea64-4f19-8396-3caa04af200d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:40.513949 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:40.594742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 563/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:25:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:25:40.601783 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8d591-eeaa-4533-9d15-b741923d7c7a None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:40.701693 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8d591-eeaa-4533-9d15-b741923d7c7a None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:40.737270 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca377d-b6ed-4a78-9bce-0d530b11696b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:40.738150 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca377d-b6ed-4a78-9bce-0d530b11696b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:40.738439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca377d-b6ed-4a78-9bce-0d530b11696b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:40.738720 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca377d-b6ed-4a78-9bce-0d530b11696b None admin] PATH_INFO: `/v3/projects/0b70b7cdfdb5487d864a3623a8178289` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:40.739900 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca377d-b6ed-4a78-9bce-0d530b11696b None admin] RBAC: Authorizing `identity:get_project(project_id=0b70b7cdfdb5487d864a3623a8178289)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:40.741343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca377d-b6ed-4a78-9bce-0d530b11696b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:40.743075 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 553/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:25:40 2022] GET /identity/v3/projects/0b70b7cdfdb5487d864a3623a8178289 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:40.749888 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfef95d-ea64-4f19-8396-3caa04af200d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:40.849546 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfef95d-ea64-4f19-8396-3caa04af200d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:40.875043 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:40.887309 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29195cef-e1f1-45e2-a284-b066b2f52a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:40.887963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29195cef-e1f1-45e2-a284-b066b2f52a85 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:40.888249 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29195cef-e1f1-45e2-a284-b066b2f52a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:40.888528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29195cef-e1f1-45e2-a284-b066b2f52a85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:40.889372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29195cef-e1f1-45e2-a284-b066b2f52a85 None admin] RBAC: Adding query filter params (role.id=26bfea3cd8164feeb8043fd508a5268c, scope.project.id=0b70b7cdfdb5487d864a3623a8178289, user.id=0de911fa59314b51a1a73849ac48f001) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:40.889683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29195cef-e1f1-45e2-a284-b066b2f52a85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:40.891267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29195cef-e1f1-45e2-a284-b066b2f52a85 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:40.896959 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 564/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:25:40 2022] GET /identity/v3/role_assignments?user.id=0de911fa59314b51a1a73849ac48f001&scope.project.id=0b70b7cdfdb5487d864a3623a8178289&role.id=26bfea3cd8164feeb8043fd508a5268c => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:42.946421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a34da8-7663-439e-915e-5d68696bb7dd None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:42.946967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a34da8-7663-439e-915e-5d68696bb7dd None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:42.946967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a34da8-7663-439e-915e-5d68696bb7dd None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:42.948316 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 554/1118] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:42.953746 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8e666-135e-4920-9655-978086a41551 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:42.954213 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8e666-135e-4920-9655-978086a41551 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:42.954441 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8e666-135e-4920-9655-978086a41551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:42.972432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ceb8e666-135e-4920-9655-978086a41551 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:42.973642 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ceb8e666-135e-4920-9655-978086a41551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:43.045599 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 565/1119] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:43.069262 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a34da8-7663-439e-915e-5d68696bb7dd None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:43.133662 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:43.178771 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a34da8-7663-439e-915e-5d68696bb7dd None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:43.214302 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb91ad-a807-4daa-b689-2c97bfe46b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:43.215079 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb91ad-a807-4daa-b689-2c97bfe46b22 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:43.215366 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb91ad-a807-4daa-b689-2c97bfe46b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:43.215639 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb91ad-a807-4daa-b689-2c97bfe46b22 None admin] PATH_INFO: `/v3/roles/26bfea3cd8164feeb8043fd508a5268c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:43.217129 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb91ad-a807-4daa-b689-2c97bfe46b22 None admin] RBAC: Authorizing `identity:get_role(role_id=26bfea3cd8164feeb8043fd508a5268c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:43.219112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb91ad-a807-4daa-b689-2c97bfe46b22 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:43.220595 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 555/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:25:43 2022] GET /identity/v3/roles/26bfea3cd8164feeb8043fd508a5268c => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:43.226646 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8e666-135e-4920-9655-978086a41551 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:43.333057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8e666-135e-4920-9655-978086a41551 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:43.352070 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:43.370538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351187de-7ca6-4912-9a15-2545567f28cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:43.371419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351187de-7ca6-4912-9a15-2545567f28cb None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:43.371704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351187de-7ca6-4912-9a15-2545567f28cb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:43.371985 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351187de-7ca6-4912-9a15-2545567f28cb None admin] PATH_INFO: `/v3/users/0de911fa59314b51a1a73849ac48f001` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:43.373182 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351187de-7ca6-4912-9a15-2545567f28cb None admin] RBAC: Authorizing `identity:get_user(user_id=0de911fa59314b51a1a73849ac48f001)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:43.375446 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351187de-7ca6-4912-9a15-2545567f28cb None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:43.377362 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 566/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:25:43 2022] GET /identity/v3/users/0de911fa59314b51a1a73849ac48f001 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:43.384468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb91ad-a807-4daa-b689-2c97bfe46b22 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:43.487711 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb91ad-a807-4daa-b689-2c97bfe46b22 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:43.514306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:43.523345 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d1649-a1c4-4ea6-9965-1b1fc8e34dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:43.524197 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d1649-a1c4-4ea6-9965-1b1fc8e34dbe None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:43.524484 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d1649-a1c4-4ea6-9965-1b1fc8e34dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:43.524762 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d1649-a1c4-4ea6-9965-1b1fc8e34dbe None admin] PATH_INFO: `/v3/projects/0b70b7cdfdb5487d864a3623a8178289` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:43.525939 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d1649-a1c4-4ea6-9965-1b1fc8e34dbe None admin] RBAC: Authorizing `identity:get_project(project_id=0b70b7cdfdb5487d864a3623a8178289)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:43.527410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d1649-a1c4-4ea6-9965-1b1fc8e34dbe None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:43.529108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 556/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:25:43 2022] GET /identity/v3/projects/0b70b7cdfdb5487d864a3623a8178289 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:43.535677 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351187de-7ca6-4912-9a15-2545567f28cb None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:43.663752 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351187de-7ca6-4912-9a15-2545567f28cb None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:43.705040 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20079b6-a1c2-4458-8faf-af5ffcf12298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:43.705929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20079b6-a1c2-4458-8faf-af5ffcf12298 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:43.706243 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20079b6-a1c2-4458-8faf-af5ffcf12298 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:43.706523 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20079b6-a1c2-4458-8faf-af5ffcf12298 None admin] PATH_INFO: `/v3/projects/0b70b7cdfdb5487d864a3623a8178289/users/0de911fa59314b51a1a73849ac48f001/roles/26bfea3cd8164feeb8043fd508a5268c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:43.708727 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20079b6-a1c2-4458-8faf-af5ffcf12298 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b70b7cdfdb5487d864a3623a8178289, user_id=0de911fa59314b51a1a73849ac48f001, role_id=26bfea3cd8164feeb8043fd508a5268c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:43.710199 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20079b6-a1c2-4458-8faf-af5ffcf12298 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:43.723326 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 567/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:25:43 2022] PUT /identity/v3/projects/0b70b7cdfdb5487d864a3623a8178289/users/0de911fa59314b51a1a73849ac48f001/roles/26bfea3cd8164feeb8043fd508a5268c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:25:45.790739 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104be25-0cdd-45e6-a79d-e8691b37f7db None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:45.791281 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104be25-0cdd-45e6-a79d-e8691b37f7db None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:45.791404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104be25-0cdd-45e6-a79d-e8691b37f7db None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:45.793061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 557/1124] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:45.799132 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195038f-1c6a-48a6-87e6-64b28c2f6e54 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:45.799590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195038f-1c6a-48a6-87e6-64b28c2f6e54 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:45.799699 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195038f-1c6a-48a6-87e6-64b28c2f6e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:45.816129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c195038f-1c6a-48a6-87e6-64b28c2f6e54 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:45.817316 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c195038f-1c6a-48a6-87e6-64b28c2f6e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:45.860165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:45.885174 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 568/1125] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:45.909431 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104be25-0cdd-45e6-a79d-e8691b37f7db None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:46.052822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104be25-0cdd-45e6-a79d-e8691b37f7db None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:46.087520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9c611-2b98-419c-b469-26d86d2cc1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:46.088375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9c611-2b98-419c-b469-26d86d2cc1fb None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:46.088662 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9c611-2b98-419c-b469-26d86d2cc1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:46.088938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9c611-2b98-419c-b469-26d86d2cc1fb None admin] PATH_INFO: `/v3/roles/26bfea3cd8164feeb8043fd508a5268c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:46.090465 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9c611-2b98-419c-b469-26d86d2cc1fb None admin] RBAC: Authorizing `identity:get_role(role_id=26bfea3cd8164feeb8043fd508a5268c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:46.091947 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9c611-2b98-419c-b469-26d86d2cc1fb None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:46.094130 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 558/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:25:45 2022] GET /identity/v3/roles/26bfea3cd8164feeb8043fd508a5268c => generated 223 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:46.100120 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195038f-1c6a-48a6-87e6-64b28c2f6e54 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:46.200125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195038f-1c6a-48a6-87e6-64b28c2f6e54 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:46.236134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc066c15-8c5d-4400-8350-11e1e8fc3310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:46.237008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc066c15-8c5d-4400-8350-11e1e8fc3310 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:46.237292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc066c15-8c5d-4400-8350-11e1e8fc3310 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:46.237572 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc066c15-8c5d-4400-8350-11e1e8fc3310 None admin] PATH_INFO: `/v3/users/0de911fa59314b51a1a73849ac48f001` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:46.238773 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc066c15-8c5d-4400-8350-11e1e8fc3310 None admin] RBAC: Authorizing `identity:get_user(user_id=0de911fa59314b51a1a73849ac48f001)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:46.240231 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc066c15-8c5d-4400-8350-11e1e8fc3310 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:46.241875 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 569/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:25:46 2022] GET /identity/v3/users/0de911fa59314b51a1a73849ac48f001 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:46.247693 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9c611-2b98-419c-b469-26d86d2cc1fb None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:46.312724 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:46.349491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9c611-2b98-419c-b469-26d86d2cc1fb None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:46.383943 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206838fd-27a2-41b8-b72b-83cf0e8caf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:46.384646 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206838fd-27a2-41b8-b72b-83cf0e8caf8d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:46.385133 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206838fd-27a2-41b8-b72b-83cf0e8caf8d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:46.385612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206838fd-27a2-41b8-b72b-83cf0e8caf8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:46.457228 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206838fd-27a2-41b8-b72b-83cf0e8caf8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:46.458724 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206838fd-27a2-41b8-b72b-83cf0e8caf8d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:46.518809 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:46.558773 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 559/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:25:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:25:46.565024 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc066c15-8c5d-4400-8350-11e1e8fc3310 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:46.611250 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:46.664516 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc066c15-8c5d-4400-8350-11e1e8fc3310 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:46.699354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0850a-4dd4-4094-a5dc-c6479c61a976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:46.700215 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0850a-4dd4-4094-a5dc-c6479c61a976 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:46.700506 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0850a-4dd4-4094-a5dc-c6479c61a976 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:46.700783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0850a-4dd4-4094-a5dc-c6479c61a976 None admin] PATH_INFO: `/v3/projects/0b70b7cdfdb5487d864a3623a8178289` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:46.702151 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0850a-4dd4-4094-a5dc-c6479c61a976 None admin] RBAC: Authorizing `identity:get_project(project_id=0b70b7cdfdb5487d864a3623a8178289)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:46.704296 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0850a-4dd4-4094-a5dc-c6479c61a976 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:46.706018 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 570/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:25:46 2022] GET /identity/v3/projects/0b70b7cdfdb5487d864a3623a8178289 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:46.712357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206838fd-27a2-41b8-b72b-83cf0e8caf8d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:46.814590 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206838fd-27a2-41b8-b72b-83cf0e8caf8d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:46.849128 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe04943-81ad-4030-9fef-c453915979cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:46.849734 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe04943-81ad-4030-9fef-c453915979cb None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:46.849983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe04943-81ad-4030-9fef-c453915979cb None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:46.850459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe04943-81ad-4030-9fef-c453915979cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:46.851312 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe04943-81ad-4030-9fef-c453915979cb None admin] RBAC: Adding query filter params (role.id=26bfea3cd8164feeb8043fd508a5268c, scope.project.id=0b70b7cdfdb5487d864a3623a8178289, user.id=0de911fa59314b51a1a73849ac48f001) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:46.851629 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe04943-81ad-4030-9fef-c453915979cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:46.853086 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe04943-81ad-4030-9fef-c453915979cb None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:46.859979 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 560/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:25:46 2022] GET /identity/v3/role_assignments?user.id=0de911fa59314b51a1a73849ac48f001&scope.project.id=0b70b7cdfdb5487d864a3623a8178289&role.id=26bfea3cd8164feeb8043fd508a5268c => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:49.033315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfb26e-aa36-4d01-837e-069d4e1e95fd None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:49.033870 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfb26e-aa36-4d01-837e-069d4e1e95fd None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:49.033870 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfb26e-aa36-4d01-837e-069d4e1e95fd None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:49.035276 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 571/1131] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:49.040626 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc30aec-f3b2-4414-bf24-36c89d31d611 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:49.041045 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc30aec-f3b2-4414-bf24-36c89d31d611 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:49.041184 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc30aec-f3b2-4414-bf24-36c89d31d611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:49.058879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9fc30aec-f3b2-4414-bf24-36c89d31d611 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:49.060081 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9fc30aec-f3b2-4414-bf24-36c89d31d611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:49.091462 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:49.145835 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 561/1132] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:49.169847 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfb26e-aa36-4d01-837e-069d4e1e95fd None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:49.282364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfb26e-aa36-4d01-837e-069d4e1e95fd None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:49.304195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:49.331047 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca8c80-724f-4bd9-af88-62ec75d36999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:49.331850 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca8c80-724f-4bd9-af88-62ec75d36999 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:49.332135 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca8c80-724f-4bd9-af88-62ec75d36999 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:49.332415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca8c80-724f-4bd9-af88-62ec75d36999 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:49.333616 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca8c80-724f-4bd9-af88-62ec75d36999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:49.335083 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca8c80-724f-4bd9-af88-62ec75d36999 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:49.336734 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 572/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:49.343930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc30aec-f3b2-4414-bf24-36c89d31d611 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:49.445849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc30aec-f3b2-4414-bf24-36c89d31d611 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:49.480411 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fe6f7-1a99-4297-94ea-ba70705af232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:49.481066 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fe6f7-1a99-4297-94ea-ba70705af232 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:49.481351 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fe6f7-1a99-4297-94ea-ba70705af232 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:49.481628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fe6f7-1a99-4297-94ea-ba70705af232 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:49.482391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fe6f7-1a99-4297-94ea-ba70705af232 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:49.483997 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213fe6f7-1a99-4297-94ea-ba70705af232 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:49.511437 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 562/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jul 14 15:25:49 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:25:51.695819 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63f36c-f2c0-41d5-be1c-18b34b6b65e0 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:51.696345 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63f36c-f2c0-41d5-be1c-18b34b6b65e0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:51.696345 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63f36c-f2c0-41d5-be1c-18b34b6b65e0 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:51.697649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 573/1135] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:25:51.704019 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d8b4e-f18b-4786-afe6-eb2329f13a17 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:51.704863 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d8b4e-f18b-4786-afe6-eb2329f13a17 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:51.704863 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d8b4e-f18b-4786-afe6-eb2329f13a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:51.729409 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c10d8b4e-f18b-4786-afe6-eb2329f13a17 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:51.730664 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c10d8b4e-f18b-4786-afe6-eb2329f13a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:51.734329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:51.804251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 563/1136] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:51.829902 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63f36c-f2c0-41d5-be1c-18b34b6b65e0 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:51.935119 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63f36c-f2c0-41d5-be1c-18b34b6b65e0 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:51.970600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd79c13-0697-4c5e-a202-31a3b60dac18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:51.971306 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd79c13-0697-4c5e-a202-31a3b60dac18 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:51.971592 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd79c13-0697-4c5e-a202-31a3b60dac18 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:51.971869 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd79c13-0697-4c5e-a202-31a3b60dac18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:51.973045 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd79c13-0697-4c5e-a202-31a3b60dac18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:51.974520 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd79c13-0697-4c5e-a202-31a3b60dac18 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:51.976148 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 574/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:25:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:51.982040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d8b4e-f18b-4786-afe6-eb2329f13a17 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:52.082099 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d8b4e-f18b-4786-afe6-eb2329f13a17 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:52.116213 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f36e33-d204-4ad5-a279-9f987a6444e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:52.116883 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f36e33-d204-4ad5-a279-9f987a6444e4 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:52.117172 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f36e33-d204-4ad5-a279-9f987a6444e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:52.117449 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f36e33-d204-4ad5-a279-9f987a6444e4 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:52.118231 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f36e33-d204-4ad5-a279-9f987a6444e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:52.119680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f36e33-d204-4ad5-a279-9f987a6444e4 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:52.129701 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:52.143304 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 564/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jul 14 15:25:51 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:25:54.360915 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ca4e7-1c35-41fd-8cb8-4ad8b4ec1de5 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:54.361506 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ca4e7-1c35-41fd-8cb8-4ad8b4ec1de5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:54.361506 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ca4e7-1c35-41fd-8cb8-4ad8b4ec1de5 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:54.362873 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 575/1139] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:54.368414 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481515c1-dc71-4816-9972-db1de459dd38 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:54.368860 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481515c1-dc71-4816-9972-db1de459dd38 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:54.368965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481515c1-dc71-4816-9972-db1de459dd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:54.386010 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-481515c1-dc71-4816-9972-db1de459dd38 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:54.387252 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-481515c1-dc71-4816-9972-db1de459dd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:54.458775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 565/1140] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:54.482998 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ca4e7-1c35-41fd-8cb8-4ad8b4ec1de5 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:54.535464 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:54.591792 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ca4e7-1c35-41fd-8cb8-4ad8b4ec1de5 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:54.630201 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38e76e-e35e-4a07-9678-b943c29054de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:54.631133 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38e76e-e35e-4a07-9678-b943c29054de None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:54.631416 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38e76e-e35e-4a07-9678-b943c29054de None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:54.631692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38e76e-e35e-4a07-9678-b943c29054de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:54.642584 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38e76e-e35e-4a07-9678-b943c29054de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:25:54.650320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-5f38e76e-e35e-4a07-9678-b943c29054de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:25:54.650320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:54.650320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:54.650320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:54.650320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:54.650320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:54.650320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:54.650320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:54.650320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:54.650320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:54.650320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:54.650320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:54.650320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:25:54.650320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:25:54.650320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:25:54.650320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:25:54.651503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:25:54.651503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:25:54.651503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:25:54.651503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:25:54.651503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:54.651503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:54.651503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:54.651503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:54.651503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:54.651503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:54.651503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:54.651503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:54.651503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:54.651503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:54.651503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:54.651503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:54.652771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:54.652771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:54.652771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:54.652771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:54.652771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:25:54.652771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:25:54.652771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:25:54.652771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:25:54.652771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:25:54.652771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:25:54.652771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:25:54.652771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:54.652771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 576/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:25:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:54.659111 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481515c1-dc71-4816-9972-db1de459dd38 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:54.760415 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481515c1-dc71-4816-9972-db1de459dd38 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:54.787430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:54.797663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1b1a7-9890-49bb-b322-025a11cb1d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:54.798380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1b1a7-9890-49bb-b322-025a11cb1d25 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:54.798922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1b1a7-9890-49bb-b322-025a11cb1d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:54.799201 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1b1a7-9890-49bb-b322-025a11cb1d25 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:54.799969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1b1a7-9890-49bb-b322-025a11cb1d25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:54.800281 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1b1a7-9890-49bb-b322-025a11cb1d25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:54.801692 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1b1a7-9890-49bb-b322-025a11cb1d25 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:54.810833 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 566/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:25:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:54.816992 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38e76e-e35e-4a07-9678-b943c29054de None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:54.927077 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38e76e-e35e-4a07-9678-b943c29054de None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:54.937993 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:54.964870 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7929f6d-5c9d-47b1-8161-6de7309c3930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:54.965744 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7929f6d-5c9d-47b1-8161-6de7309c3930 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:54.966028 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7929f6d-5c9d-47b1-8161-6de7309c3930 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:54.966337 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7929f6d-5c9d-47b1-8161-6de7309c3930 None admin] PATH_INFO: `/v3/users/16eb1a1940a343d480fa4cd72d45c260` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:54.980462 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7929f6d-5c9d-47b1-8161-6de7309c3930 None admin] RBAC: Authorizing `identity:get_user(user_id=16eb1a1940a343d480fa4cd72d45c260)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:54.981926 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7929f6d-5c9d-47b1-8161-6de7309c3930 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:54.984244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 577/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:25:54 2022] GET /identity/v3/users/16eb1a1940a343d480fa4cd72d45c260 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:54.990417 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1b1a7-9890-49bb-b322-025a11cb1d25 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:55.095286 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1b1a7-9890-49bb-b322-025a11cb1d25 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:55.130227 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fd98e-a6f0-42b4-8689-3b6f27d92ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:55.130879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fd98e-a6f0-42b4-8689-3b6f27d92ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:55.131165 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fd98e-a6f0-42b4-8689-3b6f27d92ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:55.131438 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fd98e-a6f0-42b4-8689-3b6f27d92ed6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:55.198986 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:55.218968 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92fd98e-a6f0-42b4-8689-3b6f27d92ed6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:55.220572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92fd98e-a6f0-42b4-8689-3b6f27d92ed6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:55.324365 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 567/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:25:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:25:55.331034 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7929f6d-5c9d-47b1-8161-6de7309c3930 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:55.443918 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7929f6d-5c9d-47b1-8161-6de7309c3930 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:55.482790 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89441e4-76ab-483d-90e6-45f5c00763ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:55.483718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89441e4-76ab-483d-90e6-45f5c00763ae None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:55.484231 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89441e4-76ab-483d-90e6-45f5c00763ae None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:55.484592 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89441e4-76ab-483d-90e6-45f5c00763ae None admin] PATH_INFO: `/v3/projects/6b97d538877643c7ac5443bd649f9264` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:55.485801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89441e4-76ab-483d-90e6-45f5c00763ae None admin] RBAC: Authorizing `identity:get_project(project_id=6b97d538877643c7ac5443bd649f9264)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:55.487283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89441e4-76ab-483d-90e6-45f5c00763ae None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:55.489007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 578/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:25:55 2022] GET /identity/v3/projects/6b97d538877643c7ac5443bd649f9264 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:55.498506 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fd98e-a6f0-42b4-8689-3b6f27d92ed6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:55.591452 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:55.604127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fd98e-a6f0-42b4-8689-3b6f27d92ed6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:55.641319 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba624905-2ecb-4811-857b-94bc021348da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:55.642427 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba624905-2ecb-4811-857b-94bc021348da None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:55.642934 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba624905-2ecb-4811-857b-94bc021348da None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:55.643420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba624905-2ecb-4811-857b-94bc021348da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:55.644992 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba624905-2ecb-4811-857b-94bc021348da None admin] RBAC: Adding query filter params (role.id=87f040877bfa47bda56305eb022af09e, scope.project.id=6b97d538877643c7ac5443bd649f9264, user.id=16eb1a1940a343d480fa4cd72d45c260) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:55.645580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba624905-2ecb-4811-857b-94bc021348da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:55.648240 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba624905-2ecb-4811-857b-94bc021348da None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:55.658377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 568/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:25:55 2022] GET /identity/v3/role_assignments?user.id=16eb1a1940a343d480fa4cd72d45c260&scope.project.id=6b97d538877643c7ac5443bd649f9264&role.id=87f040877bfa47bda56305eb022af09e => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:25:57.755108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eb847-79bb-4f73-b692-402566ad4979 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:57.755644 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eb847-79bb-4f73-b692-402566ad4979 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:57.755644 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eb847-79bb-4f73-b692-402566ad4979 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:57.757027 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 579/1147] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:25:57.762444 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a71663-7480-44d9-bc30-9ff58553c624 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:57.762889 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a71663-7480-44d9-bc30-9ff58553c624 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:57.762994 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a71663-7480-44d9-bc30-9ff58553c624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:57.780080 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-70a71663-7480-44d9-bc30-9ff58553c624 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:25:57.781422 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-70a71663-7480-44d9-bc30-9ff58553c624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:25:57.854732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 569/1148] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:25:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:25:57.879805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0eb847-79bb-4f73-b692-402566ad4979 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:57.927649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:57.996777 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0eb847-79bb-4f73-b692-402566ad4979 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:58.032414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef4980-8cc9-4dad-b76c-9297596b001d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:58.033111 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef4980-8cc9-4dad-b76c-9297596b001d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:58.033391 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef4980-8cc9-4dad-b76c-9297596b001d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:58.033666 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef4980-8cc9-4dad-b76c-9297596b001d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:58.043707 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef4980-8cc9-4dad-b76c-9297596b001d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:25:58.052543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-27ef4980-8cc9-4dad-b76c-9297596b001d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:25:58.052543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:25:58.052543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:25:58.052543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:25:58.052543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:25:58.052543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:25:58.052543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:25:58.052543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:25:58.052543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:25:58.052543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:25:58.052543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:25:58.052543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:25:58.052543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:25:58.052543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:25:58.052543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:25:58.052543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:25:58.053801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:25:58.053801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:25:58.053801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:25:58.053801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:25:58.053801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:25:58.053801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:25:58.053801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:25:58.053801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:25:58.053801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:25:58.053801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:25:58.053801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:25:58.053801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:25:58.053801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:25:58.053801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:25:58.053801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:25:58.053801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:25:58.054725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:25:58.054725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:25:58.054725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:25:58.054725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:25:58.054725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:25:58.054725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:25:58.054725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:25:58.054725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:25:58.054725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:25:58.054725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:25:58.054725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:25:58.054725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:25:58.054725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 580/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:25:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:25:58.060094 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a71663-7480-44d9-bc30-9ff58553c624 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:58.143041 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:58.162651 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a71663-7480-44d9-bc30-9ff58553c624 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:58.197958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdee19c-adcb-422d-9d6d-f1a20f5b682e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:58.198653 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdee19c-adcb-422d-9d6d-f1a20f5b682e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:58.198940 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdee19c-adcb-422d-9d6d-f1a20f5b682e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:58.199220 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdee19c-adcb-422d-9d6d-f1a20f5b682e None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:58.199976 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdee19c-adcb-422d-9d6d-f1a20f5b682e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:25:58.200288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdee19c-adcb-422d-9d6d-f1a20f5b682e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:58.201669 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdee19c-adcb-422d-9d6d-f1a20f5b682e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:58.210352 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 570/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:25:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:58.216279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef4980-8cc9-4dad-b76c-9297596b001d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:58.316144 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:58.323150 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef4980-8cc9-4dad-b76c-9297596b001d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:58.359407 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29757a1e-b570-4799-be55-fc88a4a97434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:58.360440 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29757a1e-b570-4799-be55-fc88a4a97434 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:58.360732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29757a1e-b570-4799-be55-fc88a4a97434 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:58.361079 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29757a1e-b570-4799-be55-fc88a4a97434 None admin] PATH_INFO: `/v3/users/16eb1a1940a343d480fa4cd72d45c260` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:58.362228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29757a1e-b570-4799-be55-fc88a4a97434 None admin] RBAC: Authorizing `identity:get_user(user_id=16eb1a1940a343d480fa4cd72d45c260)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:58.363676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29757a1e-b570-4799-be55-fc88a4a97434 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:58.365326 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 581/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:25:58 2022] GET /identity/v3/users/16eb1a1940a343d480fa4cd72d45c260 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:58.371211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdee19c-adcb-422d-9d6d-f1a20f5b682e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:58.474218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdee19c-adcb-422d-9d6d-f1a20f5b682e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:58.511114 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce8e66-60b7-4e2f-b778-d954d7b6dfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:58.511984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce8e66-60b7-4e2f-b778-d954d7b6dfa6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:58.512267 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce8e66-60b7-4e2f-b778-d954d7b6dfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:58.512549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce8e66-60b7-4e2f-b778-d954d7b6dfa6 None admin] PATH_INFO: `/v3/projects/6b97d538877643c7ac5443bd649f9264` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:58.513827 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce8e66-60b7-4e2f-b778-d954d7b6dfa6 None admin] RBAC: Authorizing `identity:get_project(project_id=6b97d538877643c7ac5443bd649f9264)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:58.515879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce8e66-60b7-4e2f-b778-d954d7b6dfa6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:58.517763 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 571/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:25:58 2022] GET /identity/v3/projects/6b97d538877643c7ac5443bd649f9264 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:25:58.524450 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29757a1e-b570-4799-be55-fc88a4a97434 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:25:58.672325 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29757a1e-b570-4799-be55-fc88a4a97434 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:25:58.715478 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ba36d-786f-40e8-bb34-56d1f4935313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:25:58.716362 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ba36d-786f-40e8-bb34-56d1f4935313 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:25:58.716647 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ba36d-786f-40e8-bb34-56d1f4935313 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:25:58.716929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ba36d-786f-40e8-bb34-56d1f4935313 None admin] PATH_INFO: `/v3/projects/6b97d538877643c7ac5443bd649f9264/users/16eb1a1940a343d480fa4cd72d45c260/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:25:58.719411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ba36d-786f-40e8-bb34-56d1f4935313 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b97d538877643c7ac5443bd649f9264, user_id=16eb1a1940a343d480fa4cd72d45c260, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:25:58.720845 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ba36d-786f-40e8-bb34-56d1f4935313 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:25:58.735308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 582/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:25:58 2022] PUT /identity/v3/projects/6b97d538877643c7ac5443bd649f9264/users/16eb1a1940a343d480fa4cd72d45c260/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:00.847030 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fce92-5924-4250-b805-50d30b34089a None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:00.847607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fce92-5924-4250-b805-50d30b34089a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:00.847607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fce92-5924-4250-b805-50d30b34089a None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:00.848982 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 572/1154] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:26:00.854913 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd76cf-05fe-4b7c-8119-195fbaa7fdd1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:00.855422 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd76cf-05fe-4b7c-8119-195fbaa7fdd1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:00.855517 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd76cf-05fe-4b7c-8119-195fbaa7fdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:00.873572 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-71cd76cf-05fe-4b7c-8119-195fbaa7fdd1 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:00.875735 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-71cd76cf-05fe-4b7c-8119-195fbaa7fdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:00.894604 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:00.948777 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 583/1155] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:26:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:26:00.973976 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fce92-5924-4250-b805-50d30b34089a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:00.989706 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:01.081483 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fce92-5924-4250-b805-50d30b34089a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:01.117762 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2072bc1-658a-42e6-9952-cf2d49e560d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:01.118590 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2072bc1-658a-42e6-9952-cf2d49e560d2 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:01.118872 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2072bc1-658a-42e6-9952-cf2d49e560d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:01.119143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2072bc1-658a-42e6-9952-cf2d49e560d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:01.130623 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2072bc1-658a-42e6-9952-cf2d49e560d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:26:01.138134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-c2072bc1-658a-42e6-9952-cf2d49e560d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:26:01.138134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:01.138134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:01.138134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:01.138134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:01.138134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:01.138134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:01.138134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:01.138134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:01.138134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:01.138134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:01.138134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:01.138134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:26:01.138134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:26:01.138134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:26:01.138134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:26:01.139287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:26:01.139287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:26:01.139287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:26:01.139287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:26:01.139287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:01.139287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:01.139287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:01.139287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:01.139287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:01.139287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:01.139287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:01.139287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:01.139287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:01.139287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:01.139287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:01.139287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:01.140318 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:01.140318 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:01.140318 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:01.140318 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:01.140318 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:26:01.140318 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:26:01.140318 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:26:01.140318 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:26:01.140318 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:26:01.140318 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:26:01.140318 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:26:01.140318 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:26:01.140318 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 573/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:26:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:01.145916 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd76cf-05fe-4b7c-8119-195fbaa7fdd1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:01.248306 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd76cf-05fe-4b7c-8119-195fbaa7fdd1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:01.285958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62b30c-5f81-4276-beff-c7fd4a592073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:01.286694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62b30c-5f81-4276-beff-c7fd4a592073 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:01.286985 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62b30c-5f81-4276-beff-c7fd4a592073 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:01.287266 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62b30c-5f81-4276-beff-c7fd4a592073 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:01.288022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62b30c-5f81-4276-beff-c7fd4a592073 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:01.288338 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62b30c-5f81-4276-beff-c7fd4a592073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:01.289729 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62b30c-5f81-4276-beff-c7fd4a592073 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:01.299437 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 584/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:26:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:01.305214 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2072bc1-658a-42e6-9952-cf2d49e560d2 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:01.381048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:01.411795 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2072bc1-658a-42e6-9952-cf2d49e560d2 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:01.449066 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfba61-1fed-4b62-9b88-de266e95e8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:01.449942 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfba61-1fed-4b62-9b88-de266e95e8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:01.450259 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfba61-1fed-4b62-9b88-de266e95e8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:01.450543 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfba61-1fed-4b62-9b88-de266e95e8b6 None admin] PATH_INFO: `/v3/users/16eb1a1940a343d480fa4cd72d45c260` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:01.451846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfba61-1fed-4b62-9b88-de266e95e8b6 None admin] RBAC: Authorizing `identity:get_user(user_id=16eb1a1940a343d480fa4cd72d45c260)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:01.454052 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfba61-1fed-4b62-9b88-de266e95e8b6 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:01.455726 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 574/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:26:01 2022] GET /identity/v3/users/16eb1a1940a343d480fa4cd72d45c260 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:01.461589 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62b30c-5f81-4276-beff-c7fd4a592073 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:01.478130 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:01.565155 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62b30c-5f81-4276-beff-c7fd4a592073 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:01.599781 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4acfdf-8434-4c34-b425-22bd4e998638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:01.600435 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4acfdf-8434-4c34-b425-22bd4e998638 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:01.600718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4acfdf-8434-4c34-b425-22bd4e998638 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:01.600995 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4acfdf-8434-4c34-b425-22bd4e998638 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:01.689018 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4acfdf-8434-4c34-b425-22bd4e998638 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:01.690965 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4acfdf-8434-4c34-b425-22bd4e998638 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:01.707684 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:01.798096 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 585/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:26:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:26:01.804544 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfba61-1fed-4b62-9b88-de266e95e8b6 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:01.907982 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfba61-1fed-4b62-9b88-de266e95e8b6 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:01.942473 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1affba-d116-44ba-88bb-0caae4d25a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:01.943238 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1affba-d116-44ba-88bb-0caae4d25a7c None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:01.943516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1affba-d116-44ba-88bb-0caae4d25a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:01.943787 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1affba-d116-44ba-88bb-0caae4d25a7c None admin] PATH_INFO: `/v3/projects/6b97d538877643c7ac5443bd649f9264` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:01.944958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1affba-d116-44ba-88bb-0caae4d25a7c None admin] RBAC: Authorizing `identity:get_project(project_id=6b97d538877643c7ac5443bd649f9264)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:01.946436 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1affba-d116-44ba-88bb-0caae4d25a7c None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:01.948136 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 575/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:26:01 2022] GET /identity/v3/projects/6b97d538877643c7ac5443bd649f9264 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:01.955440 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4acfdf-8434-4c34-b425-22bd4e998638 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:02.062781 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4acfdf-8434-4c34-b425-22bd4e998638 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:02.077920 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:02.099023 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7b523-400b-4abf-bcd5-b6c12024ade4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:02.099694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7b523-400b-4abf-bcd5-b6c12024ade4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:02.099978 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7b523-400b-4abf-bcd5-b6c12024ade4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:02.100263 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7b523-400b-4abf-bcd5-b6c12024ade4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:02.101109 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7b523-400b-4abf-bcd5-b6c12024ade4 None admin] RBAC: Adding query filter params (role.id=87f040877bfa47bda56305eb022af09e, scope.project.id=6b97d538877643c7ac5443bd649f9264, user.id=16eb1a1940a343d480fa4cd72d45c260) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:02.101419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7b523-400b-4abf-bcd5-b6c12024ade4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:02.102907 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7b523-400b-4abf-bcd5-b6c12024ade4 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:02.110489 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 586/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:26:01 2022] GET /identity/v3/role_assignments?user.id=16eb1a1940a343d480fa4cd72d45c260&scope.project.id=6b97d538877643c7ac5443bd649f9264&role.id=87f040877bfa47bda56305eb022af09e => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:04.240324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7afcd-c854-4218-8cd4-59fdaa15dd95 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:04.240894 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7afcd-c854-4218-8cd4-59fdaa15dd95 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:04.240894 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7afcd-c854-4218-8cd4-59fdaa15dd95 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:04.242274 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 576/1162] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:26:04.247923 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed15ac-d89f-4b25-9bd6-4e1850d3d30f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:04.248464 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed15ac-d89f-4b25-9bd6-4e1850d3d30f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:04.248464 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed15ac-d89f-4b25-9bd6-4e1850d3d30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:04.266826 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-31ed15ac-d89f-4b25-9bd6-4e1850d3d30f None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:04.268060 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-31ed15ac-d89f-4b25-9bd6-4e1850d3d30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:04.340859 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 587/1163] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:26:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:26:04.365544 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7afcd-c854-4218-8cd4-59fdaa15dd95 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:04.377502 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:04.474982 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7afcd-c854-4218-8cd4-59fdaa15dd95 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:04.511794 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e85207-6027-4ae9-9302-f7eafc5f8ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:04.512454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e85207-6027-4ae9-9302-f7eafc5f8ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:04.512740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e85207-6027-4ae9-9302-f7eafc5f8ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:04.513016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e85207-6027-4ae9-9302-f7eafc5f8ee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:04.585904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e85207-6027-4ae9-9302-f7eafc5f8ee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:04.587414 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e85207-6027-4ae9-9302-f7eafc5f8ee9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:04.598746 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:04.696545 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 577/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:26:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:26:04.703148 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed15ac-d89f-4b25-9bd6-4e1850d3d30f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:04.808787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed15ac-d89f-4b25-9bd6-4e1850d3d30f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:04.819299 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:04.845738 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd3662-e158-4a9b-bd00-95561edadb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:04.846581 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd3662-e158-4a9b-bd00-95561edadb6d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:04.846869 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd3662-e158-4a9b-bd00-95561edadb6d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:04.847145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd3662-e158-4a9b-bd00-95561edadb6d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:04.854165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd3662-e158-4a9b-bd00-95561edadb6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:04.855632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd3662-e158-4a9b-bd00-95561edadb6d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:04.870538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-b7bd3662-e158-4a9b-bd00-95561edadb6d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 15:26:04.870538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:04.870538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 14 15:26:04.870538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 14 15:26:04.870538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:26:04.870538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:26:04.870538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:26:04.870538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:26:04.870538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 14 15:26:04.870538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:26:04.870538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:26:04.870538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:26:04.870538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:04.870538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:04.870538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:04.870538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:04.870538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:04.871679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:04.871679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:04.871679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:04.871679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:04.871679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:04.871679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:04.871679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:26:04.871679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:26:04.871679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:26:04.871679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:26:04.871679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:04.871679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:04.871679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:04.871679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:04.871679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:04.871679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:04.872621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:04.872621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:04.872621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:04.872621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:04.872621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:04.872621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:04.872621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:04.872621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:04.872621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:04.872621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:04.872621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 14 15:26:04.872621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:26:04.872621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 14 15:26:04.872621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:26:04.872621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 588/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jul 14 15:26:04 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:04.878658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e85207-6027-4ae9-9302-f7eafc5f8ee9 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:04.978053 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e85207-6027-4ae9-9302-f7eafc5f8ee9 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:04.988169 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:05.013444 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454dd3c-385d-4b5b-b33e-218fb82df091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:05.014153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454dd3c-385d-4b5b-b33e-218fb82df091 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:05.014970 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454dd3c-385d-4b5b-b33e-218fb82df091 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:05.015248 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454dd3c-385d-4b5b-b33e-218fb82df091 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:05.016242 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454dd3c-385d-4b5b-b33e-218fb82df091 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:05.016548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454dd3c-385d-4b5b-b33e-218fb82df091 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:05.017952 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454dd3c-385d-4b5b-b33e-218fb82df091 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:05.026232 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 578/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Thu Jul 14 15:26:04 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:07.208550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c7d2e-2bb0-4b0e-8854-27c3578597dd None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:07.209097 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c7d2e-2bb0-4b0e-8854-27c3578597dd None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:07.209097 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c7d2e-2bb0-4b0e-8854-27c3578597dd None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:07.210530 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 589/1167] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:26:07.215790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ac465-bb2f-499c-8489-11f226fddda4 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:07.216212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ac465-bb2f-499c-8489-11f226fddda4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:07.216397 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ac465-bb2f-499c-8489-11f226fddda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:07.234839 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-044ac465-bb2f-499c-8489-11f226fddda4 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:07.236038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-044ac465-bb2f-499c-8489-11f226fddda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:07.304973 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 579/1168] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:26:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:26:07.328314 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c7d2e-2bb0-4b0e-8854-27c3578597dd None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:07.439232 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c7d2e-2bb0-4b0e-8854-27c3578597dd None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:07.474238 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5307dc-106a-46eb-9a2d-cf389533447d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:07.474819 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5307dc-106a-46eb-9a2d-cf389533447d None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:07.475101 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5307dc-106a-46eb-9a2d-cf389533447d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:07.475379 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5307dc-106a-46eb-9a2d-cf389533447d None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:07.476119 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5307dc-106a-46eb-9a2d-cf389533447d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:07.477500 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5307dc-106a-46eb-9a2d-cf389533447d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:07.494530 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 590/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Thu Jul 14 15:26:07 2022] POST /identity/v3/domains => generated 267 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:26:09.622053 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87180ed-65a6-4255-896e-274c5a2830c2 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:09.622634 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87180ed-65a6-4255-896e-274c5a2830c2 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:09.622634 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87180ed-65a6-4255-896e-274c5a2830c2 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:09.624612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 580/1170] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:26:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:26:09.629889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411ff82-96b3-4ec9-a81a-2c2316ac1d72 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:09.630358 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411ff82-96b3-4ec9-a81a-2c2316ac1d72 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:09.630477 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411ff82-96b3-4ec9-a81a-2c2316ac1d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:09.647167 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8411ff82-96b3-4ec9-a81a-2c2316ac1d72 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:09.648383 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8411ff82-96b3-4ec9-a81a-2c2316ac1d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:09.671986 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:09.716981 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 591/1171] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:26:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:26:09.741581 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87180ed-65a6-4255-896e-274c5a2830c2 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:09.842174 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87180ed-65a6-4255-896e-274c5a2830c2 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:09.844556 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:09.877449 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3fa1b-493b-4641-b330-9313f7303a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:09.878333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3fa1b-493b-4641-b330-9313f7303a46 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:09.878621 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3fa1b-493b-4641-b330-9313f7303a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:09.878901 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3fa1b-493b-4641-b330-9313f7303a46 None admin] PATH_INFO: `/v3/domains/4469ebbba84546d2a50708611b5ef4c9` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:09.889030 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3fa1b-493b-4641-b330-9313f7303a46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4469ebbba84546d2a50708611b5ef4c9)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:09.890827 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3fa1b-493b-4641-b330-9313f7303a46 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:09.892414 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 581/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Thu Jul 14 15:26:09 2022] GET /identity/v3/domains/4469ebbba84546d2a50708611b5ef4c9 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:09.898471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411ff82-96b3-4ec9-a81a-2c2316ac1d72 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:09.996482 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411ff82-96b3-4ec9-a81a-2c2316ac1d72 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:10.029477 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4636c96-41b5-4640-81a7-76484b9822ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:10.030645 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4636c96-41b5-4640-81a7-76484b9822ef None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:10.030966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4636c96-41b5-4640-81a7-76484b9822ef None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:10.031244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4636c96-41b5-4640-81a7-76484b9822ef None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:10.031945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4636c96-41b5-4640-81a7-76484b9822ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:10.033368 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4636c96-41b5-4640-81a7-76484b9822ef None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:10.058710 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 592/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jul 14 15:26:09 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:26:12.177691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d6893-fa95-43aa-8b8a-f40832adf72a None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:12.178286 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d6893-fa95-43aa-8b8a-f40832adf72a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:12.178286 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d6893-fa95-43aa-8b8a-f40832adf72a None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:12.179646 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 582/1174] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:26:12.184858 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497eace-a60b-497b-a221-2bab290148cc None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:12.185346 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497eace-a60b-497b-a221-2bab290148cc None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:12.185460 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497eace-a60b-497b-a221-2bab290148cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:12.202939 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b497eace-a60b-497b-a221-2bab290148cc None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:12.204115 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b497eace-a60b-497b-a221-2bab290148cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:12.206869 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:12.270510 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 593/1175] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:26:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:26:12.296252 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d6893-fa95-43aa-8b8a-f40832adf72a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:12.396357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d6893-fa95-43aa-8b8a-f40832adf72a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:12.429464 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc6bb5-ea1c-4aae-9fe7-2f42e248f6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:12.430356 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc6bb5-ea1c-4aae-9fe7-2f42e248f6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:12.430641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc6bb5-ea1c-4aae-9fe7-2f42e248f6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:12.430915 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc6bb5-ea1c-4aae-9fe7-2f42e248f6c0 None admin] PATH_INFO: `/v3/domains/4469ebbba84546d2a50708611b5ef4c9` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:12.432091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc6bb5-ea1c-4aae-9fe7-2f42e248f6c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4469ebbba84546d2a50708611b5ef4c9)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:12.433528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc6bb5-ea1c-4aae-9fe7-2f42e248f6c0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:12.435178 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 583/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Thu Jul 14 15:26:12 2022] GET /identity/v3/domains/4469ebbba84546d2a50708611b5ef4c9 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:12.442055 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497eace-a60b-497b-a221-2bab290148cc None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:12.537974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497eace-a60b-497b-a221-2bab290148cc None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:12.572085 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06b3ed-6e31-4190-851b-f16b9814a68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:12.572742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06b3ed-6e31-4190-851b-f16b9814a68e None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:12.573028 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06b3ed-6e31-4190-851b-f16b9814a68e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:12.573305 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06b3ed-6e31-4190-851b-f16b9814a68e None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:12.574008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06b3ed-6e31-4190-851b-f16b9814a68e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:12.575467 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06b3ed-6e31-4190-851b-f16b9814a68e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:12.585194 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:12.596649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 594/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jul 14 15:26:12 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:26:14.719427 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05de2e5-8ddc-4572-92c9-c58e80301e9c None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:14.719959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05de2e5-8ddc-4572-92c9-c58e80301e9c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:14.719959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05de2e5-8ddc-4572-92c9-c58e80301e9c None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:14.721838 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 584/1178] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:26:14.727204 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868278e7-4781-42b4-b52d-15e4c78a1567 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:14.727634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868278e7-4781-42b4-b52d-15e4c78a1567 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:14.727776 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868278e7-4781-42b4-b52d-15e4c78a1567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:14.744485 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-868278e7-4781-42b4-b52d-15e4c78a1567 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:14.745682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-868278e7-4781-42b4-b52d-15e4c78a1567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:14.812411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 595/1179] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:26:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:26:14.837131 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05de2e5-8ddc-4572-92c9-c58e80301e9c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:14.868113 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:14.939284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05de2e5-8ddc-4572-92c9-c58e80301e9c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:14.979437 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5c6a7-b42b-4e15-85e9-3ac8f34fe581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:14.980139 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5c6a7-b42b-4e15-85e9-3ac8f34fe581 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:14.980426 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5c6a7-b42b-4e15-85e9-3ac8f34fe581 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:14.980705 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5c6a7-b42b-4e15-85e9-3ac8f34fe581 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:14.991880 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5c6a7-b42b-4e15-85e9-3ac8f34fe581 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:26:15.000199 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-93f5c6a7-b42b-4e15-85e9-3ac8f34fe581 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:26:15.000199 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:15.000199 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:15.000199 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:15.000199 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:15.000199 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:15.000199 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:15.000199 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:15.000199 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:15.000199 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:15.000199 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:15.000199 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:15.000199 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:26:15.000199 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:26:15.000199 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:26:15.000199 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:26:15.001381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:26:15.001381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:26:15.001381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:26:15.001381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:26:15.001381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:15.001381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:15.001381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:15.001381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:15.001381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:15.001381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:15.001381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:15.001381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:15.001381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:15.001381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:15.001381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:15.001381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:15.002540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:15.002540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:15.002540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:15.002540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:15.002540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:26:15.002540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:26:15.002540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:26:15.002540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:26:15.002540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:26:15.002540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:26:15.002540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:26:15.002540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:26:15.002540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 585/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:26:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:15.008020 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868278e7-4781-42b4-b52d-15e4c78a1567 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:15.106373 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868278e7-4781-42b4-b52d-15e4c78a1567 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:15.132292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:15.141534 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b99bba-505b-4e31-b993-9b320354dfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:15.142233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b99bba-505b-4e31-b993-9b320354dfe6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:15.142524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b99bba-505b-4e31-b993-9b320354dfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:15.142805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b99bba-505b-4e31-b993-9b320354dfe6 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:15.143549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b99bba-505b-4e31-b993-9b320354dfe6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:15.143859 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b99bba-505b-4e31-b993-9b320354dfe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:15.145239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b99bba-505b-4e31-b993-9b320354dfe6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:15.153195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 596/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:26:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:15.159758 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5c6a7-b42b-4e15-85e9-3ac8f34fe581 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:15.249519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:15.260039 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5c6a7-b42b-4e15-85e9-3ac8f34fe581 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:15.294176 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2674c7-b60a-4007-83c4-601b55c2fb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:15.295065 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2674c7-b60a-4007-83c4-601b55c2fb02 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:15.295347 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2674c7-b60a-4007-83c4-601b55c2fb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:15.295792 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2674c7-b60a-4007-83c4-601b55c2fb02 None admin] PATH_INFO: `/v3/users/cd8a83efed164098b1a92bc258f43a6b` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:15.310417 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2674c7-b60a-4007-83c4-601b55c2fb02 None admin] RBAC: Authorizing `identity:get_user(user_id=cd8a83efed164098b1a92bc258f43a6b)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:15.312007 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2674c7-b60a-4007-83c4-601b55c2fb02 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:15.313711 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 586/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:26:15 2022] GET /identity/v3/users/cd8a83efed164098b1a92bc258f43a6b => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:15.319597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b99bba-505b-4e31-b993-9b320354dfe6 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:15.418785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b99bba-505b-4e31-b993-9b320354dfe6 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:15.453860 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aca563-cf3d-4ce4-b61b-2c048fb8b045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:15.454615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aca563-cf3d-4ce4-b61b-2c048fb8b045 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:15.454896 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aca563-cf3d-4ce4-b61b-2c048fb8b045 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:15.455174 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aca563-cf3d-4ce4-b61b-2c048fb8b045 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:15.508726 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:15.521785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aca563-cf3d-4ce4-b61b-2c048fb8b045 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:15.523280 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aca563-cf3d-4ce4-b61b-2c048fb8b045 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:15.625376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 597/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:26:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:26:15.631320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2674c7-b60a-4007-83c4-601b55c2fb02 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:15.728248 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2674c7-b60a-4007-83c4-601b55c2fb02 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:15.762172 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fce6f-eb31-475d-96b3-18c76842da7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:15.763000 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fce6f-eb31-475d-96b3-18c76842da7a None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:15.763339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fce6f-eb31-475d-96b3-18c76842da7a None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:15.763560 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fce6f-eb31-475d-96b3-18c76842da7a None admin] PATH_INFO: `/v3/projects/edfbe5e627f44a95ae84592446be5473` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:15.764772 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95fce6f-eb31-475d-96b3-18c76842da7a None admin] RBAC: Authorizing `identity:get_project(project_id=edfbe5e627f44a95ae84592446be5473)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:15.766219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95fce6f-eb31-475d-96b3-18c76842da7a None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:15.767883 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 587/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:26:15 2022] GET /identity/v3/projects/edfbe5e627f44a95ae84592446be5473 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:15.774063 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aca563-cf3d-4ce4-b61b-2c048fb8b045 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:15.861875 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:15.874344 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aca563-cf3d-4ce4-b61b-2c048fb8b045 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:15.914707 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae564bd1-3b09-4fdd-985b-79da00c7225c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:15.915355 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae564bd1-3b09-4fdd-985b-79da00c7225c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:15.915634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae564bd1-3b09-4fdd-985b-79da00c7225c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:15.915906 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae564bd1-3b09-4fdd-985b-79da00c7225c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:15.916721 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae564bd1-3b09-4fdd-985b-79da00c7225c None admin] RBAC: Adding query filter params (role.id=87f040877bfa47bda56305eb022af09e, scope.project.id=edfbe5e627f44a95ae84592446be5473, user.id=cd8a83efed164098b1a92bc258f43a6b) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:15.917035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae564bd1-3b09-4fdd-985b-79da00c7225c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:15.918494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae564bd1-3b09-4fdd-985b-79da00c7225c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:15.924945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 598/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:26:15 2022] GET /identity/v3/role_assignments?user.id=cd8a83efed164098b1a92bc258f43a6b&scope.project.id=edfbe5e627f44a95ae84592446be5473&role.id=87f040877bfa47bda56305eb022af09e => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:17.946438 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c387bb-a4a9-4968-a2f3-cd9647c50d76 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:17.946990 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c387bb-a4a9-4968-a2f3-cd9647c50d76 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:17.946990 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c387bb-a4a9-4968-a2f3-cd9647c50d76 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:17.948346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 588/1186] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:26:17.953631 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a65fd-4e4a-497d-8955-43555808b2b1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:17.954107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a65fd-4e4a-497d-8955-43555808b2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:17.954244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a65fd-4e4a-497d-8955-43555808b2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:17.971376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-911a65fd-4e4a-497d-8955-43555808b2b1 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:17.972575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-911a65fd-4e4a-497d-8955-43555808b2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:18.039971 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 599/1187] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:26:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:26:18.064267 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c387bb-a4a9-4968-a2f3-cd9647c50d76 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:18.082339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:18.165323 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c387bb-a4a9-4968-a2f3-cd9647c50d76 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:18.198762 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b02c00-cee6-45d1-a3a7-0d402e9e5a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:18.199472 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b02c00-cee6-45d1-a3a7-0d402e9e5a54 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:18.199755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b02c00-cee6-45d1-a3a7-0d402e9e5a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:18.200028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b02c00-cee6-45d1-a3a7-0d402e9e5a54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:18.210113 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b02c00-cee6-45d1-a3a7-0d402e9e5a54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:26:18.218284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-45b02c00-cee6-45d1-a3a7-0d402e9e5a54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:26:18.218284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:18.218284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:18.218284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:18.218284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:18.218284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:18.218284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:18.218284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:18.218284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:18.218284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:18.218284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:18.218284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:18.218284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:26:18.218284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:26:18.218284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:26:18.218284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:26:18.219535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:26:18.219535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:26:18.219535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:26:18.219535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:26:18.219535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:18.219535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:18.219535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:18.219535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:18.219535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:18.219535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:18.219535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:18.219535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:18.219535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:18.219535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:18.219535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:18.219535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:18.221054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:18.221054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:18.221054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:18.221054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:18.221054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:26:18.221054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:26:18.221054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:26:18.221054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:26:18.221054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:26:18.221054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:26:18.221054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:26:18.221054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:26:18.221054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 589/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:26:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:18.225992 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a65fd-4e4a-497d-8955-43555808b2b1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:18.306193 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:18.324306 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a65fd-4e4a-497d-8955-43555808b2b1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:18.358469 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629d619-1993-404b-8f16-07afd6c0740c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:18.359300 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629d619-1993-404b-8f16-07afd6c0740c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:18.359590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629d619-1993-404b-8f16-07afd6c0740c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:18.359872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629d619-1993-404b-8f16-07afd6c0740c None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:18.360617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629d619-1993-404b-8f16-07afd6c0740c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:18.360930 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629d619-1993-404b-8f16-07afd6c0740c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:18.362552 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629d619-1993-404b-8f16-07afd6c0740c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:18.370453 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 600/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:26:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:18.377114 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b02c00-cee6-45d1-a3a7-0d402e9e5a54 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:18.453639 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:18.476852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b02c00-cee6-45d1-a3a7-0d402e9e5a54 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:18.510417 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9b590-6b5c-47c8-89a6-b5d170e7d920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:18.511380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9b590-6b5c-47c8-89a6-b5d170e7d920 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:18.511661 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9b590-6b5c-47c8-89a6-b5d170e7d920 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:18.511935 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9b590-6b5c-47c8-89a6-b5d170e7d920 None admin] PATH_INFO: `/v3/users/cd8a83efed164098b1a92bc258f43a6b` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:18.513103 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9b590-6b5c-47c8-89a6-b5d170e7d920 None admin] RBAC: Authorizing `identity:get_user(user_id=cd8a83efed164098b1a92bc258f43a6b)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:18.514740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9b590-6b5c-47c8-89a6-b5d170e7d920 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:18.516364 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 590/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:26:18 2022] GET /identity/v3/users/cd8a83efed164098b1a92bc258f43a6b => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:18.522187 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629d619-1993-404b-8f16-07afd6c0740c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:18.620254 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629d619-1993-404b-8f16-07afd6c0740c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:18.653006 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139bebe-e95c-4b2b-8e9a-7ec093c46ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:18.653845 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139bebe-e95c-4b2b-8e9a-7ec093c46ccd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:18.654155 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139bebe-e95c-4b2b-8e9a-7ec093c46ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:18.654437 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139bebe-e95c-4b2b-8e9a-7ec093c46ccd None admin] PATH_INFO: `/v3/projects/edfbe5e627f44a95ae84592446be5473` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:18.656286 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139bebe-e95c-4b2b-8e9a-7ec093c46ccd None admin] RBAC: Authorizing `identity:get_project(project_id=edfbe5e627f44a95ae84592446be5473)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:18.657710 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139bebe-e95c-4b2b-8e9a-7ec093c46ccd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:18.659410 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 601/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:26:18 2022] GET /identity/v3/projects/edfbe5e627f44a95ae84592446be5473 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:18.665464 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9b590-6b5c-47c8-89a6-b5d170e7d920 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:18.764426 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9b590-6b5c-47c8-89a6-b5d170e7d920 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:18.798786 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf56b2-439e-4ff0-81e9-441b6b0bc559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:18.799662 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf56b2-439e-4ff0-81e9-441b6b0bc559 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:18.799941 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf56b2-439e-4ff0-81e9-441b6b0bc559 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:18.800214 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf56b2-439e-4ff0-81e9-441b6b0bc559 None admin] PATH_INFO: `/v3/projects/edfbe5e627f44a95ae84592446be5473/users/cd8a83efed164098b1a92bc258f43a6b/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:18.802183 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf56b2-439e-4ff0-81e9-441b6b0bc559 None admin] RBAC: Authorizing `identity:create_grant(project_id=edfbe5e627f44a95ae84592446be5473, user_id=cd8a83efed164098b1a92bc258f43a6b, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:18.803614 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf56b2-439e-4ff0-81e9-441b6b0bc559 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:18.816767 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 591/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:26:18 2022] PUT /identity/v3/projects/edfbe5e627f44a95ae84592446be5473/users/cd8a83efed164098b1a92bc258f43a6b/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:26:20.881346 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeec35-8e64-4973-b8f8-631c46b5e70c None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:20.881889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeec35-8e64-4973-b8f8-631c46b5e70c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:20.881889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edeec35-8e64-4973-b8f8-631c46b5e70c None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:20.883304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 602/1193] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:26:20.889530 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37fce9-97bc-4374-93da-cb999b9e2c22 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:20.890066 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37fce9-97bc-4374-93da-cb999b9e2c22 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:20.890468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37fce9-97bc-4374-93da-cb999b9e2c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:20.896460 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:20.908460 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2d37fce9-97bc-4374-93da-cb999b9e2c22 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:26:20.909665 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2d37fce9-97bc-4374-93da-cb999b9e2c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:26:20.979310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 592/1194] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:26:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:26:21.004177 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edeec35-8e64-4973-b8f8-631c46b5e70c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:21.019694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:21.106272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edeec35-8e64-4973-b8f8-631c46b5e70c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:21.139861 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48df43-a624-4590-bcc7-74a1fab7a857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:21.140586 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48df43-a624-4590-bcc7-74a1fab7a857 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:21.140868 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48df43-a624-4590-bcc7-74a1fab7a857 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:21.141145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48df43-a624-4590-bcc7-74a1fab7a857 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:21.151274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48df43-a624-4590-bcc7-74a1fab7a857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:26:21.159615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-ae48df43-a624-4590-bcc7-74a1fab7a857 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:26:21.159615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:26:21.159615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:26:21.159615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:26:21.159615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:26:21.159615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:26:21.159615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:26:21.159615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:26:21.159615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:26:21.159615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:26:21.159615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:26:21.159615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:26:21.159615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:26:21.159615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:26:21.159615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:26:21.159615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:26:21.160749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:26:21.160749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:26:21.160749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:26:21.160749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:26:21.160749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:26:21.160749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:26:21.160749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:26:21.160749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:26:21.160749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:26:21.160749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:26:21.160749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:26:21.160749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:26:21.160749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:26:21.160749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:26:21.160749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:26:21.160749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:26:21.161656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:26:21.161656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:26:21.161656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:26:21.161656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:26:21.161656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:26:21.161656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:26:21.161656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:26:21.161656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:26:21.161656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:26:21.161656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:26:21.161656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:26:21.161656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:26:21.161656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 603/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:26:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:26:21.166992 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37fce9-97bc-4374-93da-cb999b9e2c22 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:21.261830 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37fce9-97bc-4374-93da-cb999b9e2c22 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:21.296014 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed1e6b-d10d-458d-8580-e7c737e3b1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:21.296672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed1e6b-d10d-458d-8580-e7c737e3b1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:21.296956 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed1e6b-d10d-458d-8580-e7c737e3b1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:21.297230 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed1e6b-d10d-458d-8580-e7c737e3b1a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:21.297963 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed1e6b-d10d-458d-8580-e7c737e3b1a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:21.298557 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed1e6b-d10d-458d-8580-e7c737e3b1a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:21.299918 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed1e6b-d10d-458d-8580-e7c737e3b1a0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:21.301229 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:21.308637 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 593/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:26:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:21.315276 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48df43-a624-4590-bcc7-74a1fab7a857 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:21.383385 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:21.412519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48df43-a624-4590-bcc7-74a1fab7a857 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:21.446688 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514556d9-8451-44f4-b126-1f42777c47b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:21.447551 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514556d9-8451-44f4-b126-1f42777c47b8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:21.447836 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514556d9-8451-44f4-b126-1f42777c47b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:21.448116 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514556d9-8451-44f4-b126-1f42777c47b8 None admin] PATH_INFO: `/v3/users/cd8a83efed164098b1a92bc258f43a6b` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:21.449288 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514556d9-8451-44f4-b126-1f42777c47b8 None admin] RBAC: Authorizing `identity:get_user(user_id=cd8a83efed164098b1a92bc258f43a6b)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:21.450781 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514556d9-8451-44f4-b126-1f42777c47b8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:21.452494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 604/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Thu Jul 14 15:26:21 2022] GET /identity/v3/users/cd8a83efed164098b1a92bc258f43a6b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:21.458226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed1e6b-d10d-458d-8580-e7c737e3b1a0 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:21.554967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed1e6b-d10d-458d-8580-e7c737e3b1a0 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:21.587141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2a1a4-7eff-43c7-9fb8-098aed351833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:21.587766 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2a1a4-7eff-43c7-9fb8-098aed351833 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:21.588046 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2a1a4-7eff-43c7-9fb8-098aed351833 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:21.588320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2a1a4-7eff-43c7-9fb8-098aed351833 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:21.647331 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:21.654133 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2a1a4-7eff-43c7-9fb8-098aed351833 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:21.656494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2a1a4-7eff-43c7-9fb8-098aed351833 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:21.753507 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 594/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:26:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:26:21.759448 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514556d9-8451-44f4-b126-1f42777c47b8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:21.861922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514556d9-8451-44f4-b126-1f42777c47b8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:21.895281 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35fa8a-9c77-476c-9924-5bee661f4783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:21.896130 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35fa8a-9c77-476c-9924-5bee661f4783 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:21.896417 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35fa8a-9c77-476c-9924-5bee661f4783 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:21.896698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35fa8a-9c77-476c-9924-5bee661f4783 None admin] PATH_INFO: `/v3/projects/edfbe5e627f44a95ae84592446be5473` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:21.897870 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35fa8a-9c77-476c-9924-5bee661f4783 None admin] RBAC: Authorizing `identity:get_project(project_id=edfbe5e627f44a95ae84592446be5473)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:21.899341 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35fa8a-9c77-476c-9924-5bee661f4783 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:21.901039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 605/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Thu Jul 14 15:26:21 2022] GET /identity/v3/projects/edfbe5e627f44a95ae84592446be5473 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:21.908041 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2a1a4-7eff-43c7-9fb8-098aed351833 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:26:22.002964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:22.015249 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2a1a4-7eff-43c7-9fb8-098aed351833 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:26:22.050158 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77c824-686e-48bb-aa1d-5e01cc244bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:26:22.051070 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77c824-686e-48bb-aa1d-5e01cc244bcb None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:26:22.052364 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77c824-686e-48bb-aa1d-5e01cc244bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:26:22.052642 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77c824-686e-48bb-aa1d-5e01cc244bcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:26:22.053467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77c824-686e-48bb-aa1d-5e01cc244bcb None admin] RBAC: Adding query filter params (role.id=87f040877bfa47bda56305eb022af09e, scope.project.id=edfbe5e627f44a95ae84592446be5473, user.id=cd8a83efed164098b1a92bc258f43a6b) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:26:22.053780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77c824-686e-48bb-aa1d-5e01cc244bcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:26:22.055243 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77c824-686e-48bb-aa1d-5e01cc244bcb None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:26:22.061234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 595/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:26:21 2022] GET /identity/v3/role_assignments?user.id=cd8a83efed164098b1a92bc258f43a6b&scope.project.id=edfbe5e627f44a95ae84592446be5473&role.id=87f040877bfa47bda56305eb022af09e => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:26:31.891065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:32.058544 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=20 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:20.268641 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac83e08-e208-4e3c-9408-a42d8b272f0a None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:20.269260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac83e08-e208-4e3c-9408-a42d8b272f0a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:20.269260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac83e08-e208-4e3c-9408-a42d8b272f0a None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:20.270763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 606/1201] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:27:20.276856 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d666e77-ea11-49d0-aefb-46d55abcb14e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:20.277421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d666e77-ea11-49d0-aefb-46d55abcb14e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:20.277421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d666e77-ea11-49d0-aefb-46d55abcb14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:20.301418 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8d666e77-ea11-49d0-aefb-46d55abcb14e None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:20.302706 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8d666e77-ea11-49d0-aefb-46d55abcb14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:20.402817 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 596/1202] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:27:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:27:20.429323 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac83e08-e208-4e3c-9408-a42d8b272f0a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:20.565490 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac83e08-e208-4e3c-9408-a42d8b272f0a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:20.612699 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1218bfd-8663-4900-b354-1e8857d9a7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:20.613518 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1218bfd-8663-4900-b354-1e8857d9a7ca None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:20.613798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1218bfd-8663-4900-b354-1e8857d9a7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:20.614090 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1218bfd-8663-4900-b354-1e8857d9a7ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:20.625909 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1218bfd-8663-4900-b354-1e8857d9a7ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:20.627394 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1218bfd-8663-4900-b354-1e8857d9a7ca None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:20.647704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-d1218bfd-8663-4900-b354-1e8857d9a7ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:20.647704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:20.647704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:20.647704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:20.647704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:20.647704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:20.647704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:20.647704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:20.647704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:20.647704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:20.647704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:20.647704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:20.647704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:27:20.647704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:27:20.647704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:27:20.648785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:27:20.648785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:20.648785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:20.648785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:20.648785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:20.648785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:20.648785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:20.648785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:20.648785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:20.648785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:20.648785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:20.648785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:20.648785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:20.648785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:20.648785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:20.648785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:20.648785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:20.650051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:27:20.650051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:27:20.650051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:20.650051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:27:20.650051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 607/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:20.658903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d666e77-ea11-49d0-aefb-46d55abcb14e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:20.782757 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d666e77-ea11-49d0-aefb-46d55abcb14e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:20.818426 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:20.828304 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f27499-d6ae-462c-814b-08792a35108b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:20.828991 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f27499-d6ae-462c-814b-08792a35108b None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:20.829273 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f27499-d6ae-462c-814b-08792a35108b None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:20.829554 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f27499-d6ae-462c-814b-08792a35108b None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:20.830429 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f27499-d6ae-462c-814b-08792a35108b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:20.830635 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f27499-d6ae-462c-814b-08792a35108b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:20.831999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f27499-d6ae-462c-814b-08792a35108b None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:20.850117 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 597/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:20.851362 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1218bfd-8663-4900-b354-1e8857d9a7ca None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:20.935008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:20.998126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1218bfd-8663-4900-b354-1e8857d9a7ca None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:21.045397 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6779fd5-c51b-453b-a527-027e250dba5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:21.046413 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6779fd5-c51b-453b-a527-027e250dba5d None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:21.046875 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6779fd5-c51b-453b-a527-027e250dba5d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:21.047328 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6779fd5-c51b-453b-a527-027e250dba5d None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:21.048453 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6779fd5-c51b-453b-a527-027e250dba5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:21.050117 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6779fd5-c51b-453b-a527-027e250dba5d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:21.074039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 608/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Thu Jul 14 15:27:20 2022] POST /identity/v3/users => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:27:23.458320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86c047-bc3d-43a1-8dc2-e56b72dd01bc None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:23.458901 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86c047-bc3d-43a1-8dc2-e56b72dd01bc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:23.459069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86c047-bc3d-43a1-8dc2-e56b72dd01bc None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:23.460874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 598/1206] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:27:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:27:23.467998 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab056ca4-a4a5-4e6d-8516-eda82ca75774 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:23.468758 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab056ca4-a4a5-4e6d-8516-eda82ca75774 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:23.468758 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab056ca4-a4a5-4e6d-8516-eda82ca75774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:23.487681 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ab056ca4-a4a5-4e6d-8516-eda82ca75774 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:23.488922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ab056ca4-a4a5-4e6d-8516-eda82ca75774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:23.584681 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 609/1207] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:27:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:27:23.610097 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86c047-bc3d-43a1-8dc2-e56b72dd01bc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:23.730435 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86c047-bc3d-43a1-8dc2-e56b72dd01bc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:23.772916 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90e007-c109-457e-99e0-046075ceabde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:23.774009 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90e007-c109-457e-99e0-046075ceabde None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:23.774255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90e007-c109-457e-99e0-046075ceabde None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:23.774602 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90e007-c109-457e-99e0-046075ceabde None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:23.787723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90e007-c109-457e-99e0-046075ceabde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:27:23.796611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-ec90e007-c109-457e-99e0-046075ceabde None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:27:23.796611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:23.796611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:23.796611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:23.796611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:23.796611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:23.796611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:23.796611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:23.796611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:23.796611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:23.796611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:23.796611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:23.796611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:27:23.796611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:27:23.796611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:27:23.796611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:27:23.798641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:27:23.798641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:27:23.798641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:27:23.798641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:27:23.798641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:23.798641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:23.798641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:23.798641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:23.798641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:23.798641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:23.798641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:23.798641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:23.798641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:23.798641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:23.798641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:23.798641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:23.799537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:23.799537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:23.799537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:23.799537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:23.799537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:27:23.799537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:27:23.799537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:27:23.799537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:27:23.799537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:27:23.799537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:27:23.799537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:27:23.799537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:23.799537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 599/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:27:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:23.805113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab056ca4-a4a5-4e6d-8516-eda82ca75774 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:23.852050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:23.941174 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab056ca4-a4a5-4e6d-8516-eda82ca75774 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:23.986787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d842b96-385a-4fa7-a35a-6ccb1be1c1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:23.987386 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d842b96-385a-4fa7-a35a-6ccb1be1c1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:23.987672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d842b96-385a-4fa7-a35a-6ccb1be1c1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:23.987953 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d842b96-385a-4fa7-a35a-6ccb1be1c1c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:23.991923 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d842b96-385a-4fa7-a35a-6ccb1be1c1c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:23.991923 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d842b96-385a-4fa7-a35a-6ccb1be1c1c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:23.991923 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d842b96-385a-4fa7-a35a-6ccb1be1c1c8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:24.002119 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 610/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jul 14 15:27:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:24.006207 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90e007-c109-457e-99e0-046075ceabde None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:24.072004 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:24.139498 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90e007-c109-457e-99e0-046075ceabde None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:24.183985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e470a-faf7-44c5-8e62-e03f9403fee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:24.185093 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e470a-faf7-44c5-8e62-e03f9403fee8 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:24.185385 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e470a-faf7-44c5-8e62-e03f9403fee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:24.185666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e470a-faf7-44c5-8e62-e03f9403fee8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:24.198648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e470a-faf7-44c5-8e62-e03f9403fee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:24.200574 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e470a-faf7-44c5-8e62-e03f9403fee8 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:24.223166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-3d0e470a-faf7-44c5-8e62-e03f9403fee8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:24.223166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:24.223166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:24.223166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:24.223166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:24.223166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:24.223166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:24.223166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:24.223166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:24.223166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:24.223166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:24.223166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:24.223166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:27:24.223166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:27:24.223166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:27:24.225525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:27:24.225525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:24.225525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:24.225525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:24.225525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:24.225525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:24.225525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:24.225525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:24.225525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:24.225525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:24.225525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:24.225525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:24.225525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:24.225525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:24.225525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:24.225525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:24.225525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:24.226588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:27:24.226588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:27:24.226588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:24.226588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:24.226588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 600/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:24.233483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d842b96-385a-4fa7-a35a-6ccb1be1c1c8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:24.356335 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:24.359981 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d842b96-385a-4fa7-a35a-6ccb1be1c1c8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:24.405964 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e35af-cd42-49cd-ac8c-eb2aee5c261b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:24.406739 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e35af-cd42-49cd-ac8c-eb2aee5c261b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:24.407101 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e35af-cd42-49cd-ac8c-eb2aee5c261b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:24.407442 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e35af-cd42-49cd-ac8c-eb2aee5c261b None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:24.408262 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e35af-cd42-49cd-ac8c-eb2aee5c261b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:24.408561 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e35af-cd42-49cd-ac8c-eb2aee5c261b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:24.410142 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e35af-cd42-49cd-ac8c-eb2aee5c261b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:24.429351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 611/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:24.430580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e470a-faf7-44c5-8e62-e03f9403fee8 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:24.556798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e470a-faf7-44c5-8e62-e03f9403fee8 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:24.560558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:24.599815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9b779-0d96-49bd-a47b-306bfb338139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:24.600698 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9b779-0d96-49bd-a47b-306bfb338139 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:24.600983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9b779-0d96-49bd-a47b-306bfb338139 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:24.601255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9b779-0d96-49bd-a47b-306bfb338139 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:24.612014 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9b779-0d96-49bd-a47b-306bfb338139 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:24.612880 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9b779-0d96-49bd-a47b-306bfb338139 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:24.630862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-29e9b779-0d96-49bd-a47b-306bfb338139 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:27:24.630862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:24.630862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:24.630862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:24.630862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:24.630862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:24.630862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:24.630862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:24.630862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:24.630862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:24.630862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:24.630862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:24.630862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:27:24.630862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:27:24.630862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:27:24.630862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:27:24.633383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:24.633383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:24.633383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:27:24.633383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:27:24.633383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:27:24.633383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:27:24.633383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:24.633383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:24.633383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:24.633383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:24.633383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:24.633383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:24.633383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:24.633383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:24.633383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:24.633383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:24.633383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:24.633383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:24.634509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:24.634509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:24.634509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:27:24.634509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:27:24.634509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:27:24.634509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:27:24.634509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:27:24.634509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:27:24.634509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:27:24.634509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:24.634509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 601/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:27:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:24.639041 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e35af-cd42-49cd-ac8c-eb2aee5c261b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:24.783099 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e35af-cd42-49cd-ac8c-eb2aee5c261b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:24.829035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9534026-19f3-4214-b460-dc6f54db2d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:24.830156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9534026-19f3-4214-b460-dc6f54db2d2a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:24.830451 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9534026-19f3-4214-b460-dc6f54db2d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:24.830731 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9534026-19f3-4214-b460-dc6f54db2d2a None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:24.831584 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9534026-19f3-4214-b460-dc6f54db2d2a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:24.831895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9534026-19f3-4214-b460-dc6f54db2d2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:24.833333 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9534026-19f3-4214-b460-dc6f54db2d2a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:24.858816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 612/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jul 14 15:27:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:24.865843 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9b779-0d96-49bd-a47b-306bfb338139 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:25.000871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9b779-0d96-49bd-a47b-306bfb338139 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:25.057736 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03ea0d-b2db-4410-a458-1e21dd5f57c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:25.058529 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03ea0d-b2db-4410-a458-1e21dd5f57c5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:25.058966 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03ea0d-b2db-4410-a458-1e21dd5f57c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:25.059987 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03ea0d-b2db-4410-a458-1e21dd5f57c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:25.100670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:25.154693 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03ea0d-b2db-4410-a458-1e21dd5f57c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:25.156418 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03ea0d-b2db-4410-a458-1e21dd5f57c5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:25.264443 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 602/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:27:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:27:25.270118 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9534026-19f3-4214-b460-dc6f54db2d2a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:25.290635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:25.390821 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9534026-19f3-4214-b460-dc6f54db2d2a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:25.440758 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da20d97-3d73-436b-841b-bbcf3b2b4dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:25.441921 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da20d97-3d73-436b-841b-bbcf3b2b4dbc None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:25.442521 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da20d97-3d73-436b-841b-bbcf3b2b4dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:25.442977 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da20d97-3d73-436b-841b-bbcf3b2b4dbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:25.458802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da20d97-3d73-436b-841b-bbcf3b2b4dbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:25.460321 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da20d97-3d73-436b-841b-bbcf3b2b4dbc None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:25.481555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-6da20d97-3d73-436b-841b-bbcf3b2b4dbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:25.481555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:25.481555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:25.481555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:25.481555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:25.481555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:25.481555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:25.481555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:25.481555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:25.481555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:25.481555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:25.481555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:25.481555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:27:25.481555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:27:25.481555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:27:25.482664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:27:25.482664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:25.482664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:25.482664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:25.482664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:25.482664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:25.482664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:25.482664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:25.482664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:25.482664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:25.482664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:25.482664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:25.482664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:25.482664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:25.482664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:25.482664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:25.482664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:25.483595 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:27:25.483595 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:27:25.483595 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:25.483595 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:27:25.483595 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 613/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:27:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:25.490289 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03ea0d-b2db-4410-a458-1e21dd5f57c5 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:25.558820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:25.602340 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03ea0d-b2db-4410-a458-1e21dd5f57c5 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:25.645234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815f280-7598-45cb-9fd3-f64c6582374d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:25.646032 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815f280-7598-45cb-9fd3-f64c6582374d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:25.646353 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815f280-7598-45cb-9fd3-f64c6582374d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:25.646630 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815f280-7598-45cb-9fd3-f64c6582374d None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:25.647361 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815f280-7598-45cb-9fd3-f64c6582374d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:25.647672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815f280-7598-45cb-9fd3-f64c6582374d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:25.649180 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815f280-7598-45cb-9fd3-f64c6582374d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:25.663569 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 603/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:25.670607 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da20d97-3d73-436b-841b-bbcf3b2b4dbc None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:25.760635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:25.809209 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da20d97-3d73-436b-841b-bbcf3b2b4dbc None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:25.855082 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85c700-d508-4270-80ab-6904af5318df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:25.855955 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85c700-d508-4270-80ab-6904af5318df None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:25.856243 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85c700-d508-4270-80ab-6904af5318df None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:25.856612 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85c700-d508-4270-80ab-6904af5318df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:25.866569 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85c700-d508-4270-80ab-6904af5318df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:25.870247 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85c700-d508-4270-80ab-6904af5318df None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:25.889761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-de85c700-d508-4270-80ab-6904af5318df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:27:25.889761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:25.889761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:25.889761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:25.889761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:25.889761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:25.889761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:25.889761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:25.889761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:25.889761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:25.889761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:25.889761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:25.889761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:27:25.889761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:27:25.889761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:27:25.890933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:27:25.890933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:25.890933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:25.890933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:25.890933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:25.890933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:25.890933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:25.890933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:25.890933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:25.890933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:25.890933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:25.890933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:25.890933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:25.890933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:25.890933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:25.890933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:25.890933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:25.892012 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:27:25.892012 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:27:25.892012 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:27:25.892012 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:27:25.892012 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:27:25.892012 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:27:25.892012 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:27:25.892012 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:27:25.892012 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 614/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:27:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:25.898012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815f280-7598-45cb-9fd3-f64c6582374d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:26.029901 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815f280-7598-45cb-9fd3-f64c6582374d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:26.058107 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:26.072330 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03271a99-bb81-4c49-988d-db7d35fef06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:26.073021 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03271a99-bb81-4c49-988d-db7d35fef06e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:26.073338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03271a99-bb81-4c49-988d-db7d35fef06e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:26.073702 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03271a99-bb81-4c49-988d-db7d35fef06e None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:26.075277 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03271a99-bb81-4c49-988d-db7d35fef06e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:26.075597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03271a99-bb81-4c49-988d-db7d35fef06e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:26.077328 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03271a99-bb81-4c49-988d-db7d35fef06e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:26.092446 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 604/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:27:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:27:26.098338 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85c700-d508-4270-80ab-6904af5318df None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:26.227296 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85c700-d508-4270-80ab-6904af5318df None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:26.266688 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:26.273982 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4fcd2-d834-435c-aa8e-e472daf6d610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:26.274790 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4fcd2-d834-435c-aa8e-e472daf6d610 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:26.275065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4fcd2-d834-435c-aa8e-e472daf6d610 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:26.275420 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4fcd2-d834-435c-aa8e-e472daf6d610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:26.276351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4fcd2-d834-435c-aa8e-e472daf6d610 None admin] RBAC: Adding query filter params (role.id=1d73a20858554285862ec7d933eb6149, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=1d1dbca57a4c43ce9bc37c2303417d05) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:26.276675 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4fcd2-d834-435c-aa8e-e472daf6d610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:26.278531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4fcd2-d834-435c-aa8e-e472daf6d610 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:26.294191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 615/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:27:26 2022] GET /identity/v3/role_assignments?user.id=1d1dbca57a4c43ce9bc37c2303417d05&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=1d73a20858554285862ec7d933eb6149 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:28.421703 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73f855-c688-4259-8ff2-3c9477b1dff5 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:28.422322 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73f855-c688-4259-8ff2-3c9477b1dff5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:28.422322 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73f855-c688-4259-8ff2-3c9477b1dff5 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:28.423975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 605/1220] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:27:28.429863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b4d8c-4e31-4ccb-94ae-7deb313cc9d9 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:28.430285 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b4d8c-4e31-4ccb-94ae-7deb313cc9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:28.430477 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b4d8c-4e31-4ccb-94ae-7deb313cc9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:28.449013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2a0b4d8c-4e31-4ccb-94ae-7deb313cc9d9 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:28.451364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2a0b4d8c-4e31-4ccb-94ae-7deb313cc9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:28.527409 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 616/1221] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:27:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:27:28.552480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73f855-c688-4259-8ff2-3c9477b1dff5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:28.665663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73f855-c688-4259-8ff2-3c9477b1dff5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:28.700859 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66085220-5791-4951-877f-773120202103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:28.701563 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66085220-5791-4951-877f-773120202103 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:28.701843 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66085220-5791-4951-877f-773120202103 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:28.702149 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66085220-5791-4951-877f-773120202103 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:28.713956 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66085220-5791-4951-877f-773120202103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:27:28.722938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-66085220-5791-4951-877f-773120202103 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:27:28.722938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:28.722938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:28.722938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:28.722938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:28.722938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:28.722938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:28.722938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:28.722938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:28.722938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:28.722938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:28.722938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:28.722938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:27:28.722938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:27:28.722938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:27:28.722938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:27:28.724161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:27:28.724161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:27:28.724161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:27:28.724161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:27:28.724161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:28.724161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:28.724161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:28.724161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:28.724161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:28.724161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:28.724161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:28.724161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:28.724161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:28.724161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:28.724161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:28.724161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:28.725074 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:28.725074 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:28.725074 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:28.725074 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:28.725074 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:27:28.725074 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:27:28.725074 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:27:28.725074 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:27:28.725074 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:27:28.725074 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:27:28.725074 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:27:28.725074 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:28.725074 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 606/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:27:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:28.730645 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b4d8c-4e31-4ccb-94ae-7deb313cc9d9 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:28.840302 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b4d8c-4e31-4ccb-94ae-7deb313cc9d9 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:28.869560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:28.884833 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49513c70-c697-4aa6-ae2e-ff0a6e06103f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:28.885518 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49513c70-c697-4aa6-ae2e-ff0a6e06103f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:28.885864 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49513c70-c697-4aa6-ae2e-ff0a6e06103f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:28.886558 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49513c70-c697-4aa6-ae2e-ff0a6e06103f None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:28.887584 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49513c70-c697-4aa6-ae2e-ff0a6e06103f None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:28.888166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49513c70-c697-4aa6-ae2e-ff0a6e06103f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:28.889604 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49513c70-c697-4aa6-ae2e-ff0a6e06103f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:28.899591 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 617/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jul 14 15:27:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:28.911051 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66085220-5791-4951-877f-773120202103 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:28.971557 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:29.037254 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66085220-5791-4951-877f-773120202103 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:29.076576 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771fb85-ac8d-43eb-87ac-aa09da25ed99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:29.077437 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771fb85-ac8d-43eb-87ac-aa09da25ed99 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:29.077731 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771fb85-ac8d-43eb-87ac-aa09da25ed99 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:29.078005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771fb85-ac8d-43eb-87ac-aa09da25ed99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:29.089723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771fb85-ac8d-43eb-87ac-aa09da25ed99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:29.091960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771fb85-ac8d-43eb-87ac-aa09da25ed99 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:29.111719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-0771fb85-ac8d-43eb-87ac-aa09da25ed99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:29.111719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:29.111719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:29.111719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:29.111719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:29.111719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:29.111719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:29.111719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:29.111719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:29.111719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:29.111719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:29.111719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:29.111719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:27:29.111719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:27:29.111719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:27:29.112710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:27:29.112710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:29.112710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:29.112710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:29.112710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:29.112710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:29.112710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:29.112710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:29.112710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:29.112710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:29.112710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:29.112710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:29.112710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:29.112710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:29.112710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:29.112710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:29.112710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:29.113900 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:27:29.113900 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:27:29.113900 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:29.113900 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:29.113900 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 607/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:29.119092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49513c70-c697-4aa6-ae2e-ff0a6e06103f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:29.229967 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49513c70-c697-4aa6-ae2e-ff0a6e06103f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:29.266880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644933ea-9fe2-478c-88aa-c14f593c8e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:29.267548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644933ea-9fe2-478c-88aa-c14f593c8e91 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:29.267834 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644933ea-9fe2-478c-88aa-c14f593c8e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:29.268119 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644933ea-9fe2-478c-88aa-c14f593c8e91 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:29.268837 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644933ea-9fe2-478c-88aa-c14f593c8e91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:29.269142 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644933ea-9fe2-478c-88aa-c14f593c8e91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:29.270568 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644933ea-9fe2-478c-88aa-c14f593c8e91 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:29.283810 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 618/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:29.290189 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771fb85-ac8d-43eb-87ac-aa09da25ed99 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:29.403671 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:29.412433 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771fb85-ac8d-43eb-87ac-aa09da25ed99 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:29.459955 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7c511-a19b-48a8-8990-8c9cc93250ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:29.460722 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7c511-a19b-48a8-8990-8c9cc93250ce None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:29.461012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7c511-a19b-48a8-8990-8c9cc93250ce None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:29.461291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7c511-a19b-48a8-8990-8c9cc93250ce None admin] PATH_INFO: `/v3/users/placement` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:29.471112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7c511-a19b-48a8-8990-8c9cc93250ce None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:29.472765 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e7c511-a19b-48a8-8990-8c9cc93250ce None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:29.489327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-48e7c511-a19b-48a8-8990-8c9cc93250ce None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:27:29.489327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:29.489327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:29.489327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:29.489327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:29.489327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:29.489327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:29.489327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:29.489327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:29.489327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:29.489327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:29.489327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:29.489327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:27:29.489327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:27:29.489327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:27:29.489327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:27:29.496570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:29.496570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:29.496570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:27:29.496570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:27:29.496570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:27:29.496570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:27:29.496570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:29.496570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:29.496570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:29.496570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:29.496570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:29.496570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:29.496570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:29.496570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:29.496570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:29.496570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:29.496570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:29.496570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:29.498488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:29.498488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:29.498488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:27:29.498488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:27:29.498488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:27:29.498488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:27:29.498488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:27:29.498488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:27:29.498488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:27:29.498488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:29.498488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 608/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:27:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:29.499649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644933ea-9fe2-478c-88aa-c14f593c8e91 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:29.552336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:29.615186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644933ea-9fe2-478c-88aa-c14f593c8e91 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:29.655249 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c371932-6e55-460a-8109-a450124ffb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:29.655927 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c371932-6e55-460a-8109-a450124ffb10 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:29.656211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c371932-6e55-460a-8109-a450124ffb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:29.656487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c371932-6e55-460a-8109-a450124ffb10 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:29.657326 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c371932-6e55-460a-8109-a450124ffb10 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:29.657639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c371932-6e55-460a-8109-a450124ffb10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:29.659109 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c371932-6e55-460a-8109-a450124ffb10 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:29.677815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 619/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jul 14 15:27:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:27:29.683770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7c511-a19b-48a8-8990-8c9cc93250ce None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:29.795007 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e7c511-a19b-48a8-8990-8c9cc93250ce None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:29.835434 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464748e-864f-4ba8-b955-947e6c8ba69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:29.836226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464748e-864f-4ba8-b955-947e6c8ba69e None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:29.836512 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464748e-864f-4ba8-b955-947e6c8ba69e None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:29.836794 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464748e-864f-4ba8-b955-947e6c8ba69e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:29.848203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464748e-864f-4ba8-b955-947e6c8ba69e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:29.849651 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464748e-864f-4ba8-b955-947e6c8ba69e None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:29.867421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-5464748e-864f-4ba8-b955-947e6c8ba69e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:29.867421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:29.867421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:29.867421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:29.867421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:29.867421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:29.867421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:29.867421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:29.867421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:29.867421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:29.867421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:29.867421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:29.867421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:27:29.867421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:27:29.867421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:27:29.868514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:27:29.868514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:29.868514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:29.868514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:29.868514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:29.868514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:29.868514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:29.868514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:29.868514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:29.868514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:29.868514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:29.868514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:29.868514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:29.868514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:29.868514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:29.868514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:29.868514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:29.869681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:27:29.869681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:27:29.869681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:29.869681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:29.871448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 609/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:29.879915 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c371932-6e55-460a-8109-a450124ffb10 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:30.004374 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c371932-6e55-460a-8109-a450124ffb10 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:30.006745 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:30.042105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6b0c0-c9d9-4eb0-9fe6-82062d76fee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:30.042786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6b0c0-c9d9-4eb0-9fe6-82062d76fee5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:30.043071 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6b0c0-c9d9-4eb0-9fe6-82062d76fee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:30.043389 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6b0c0-c9d9-4eb0-9fe6-82062d76fee5 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:30.044343 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6b0c0-c9d9-4eb0-9fe6-82062d76fee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:30.044656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6b0c0-c9d9-4eb0-9fe6-82062d76fee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:30.046180 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6b0c0-c9d9-4eb0-9fe6-82062d76fee5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:30.058099 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 620/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:27:30.064027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464748e-864f-4ba8-b955-947e6c8ba69e None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:30.073869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:30.183191 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464748e-864f-4ba8-b955-947e6c8ba69e None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:30.222797 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83101136-3710-4a8d-8a58-2f1552bddcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:30.223661 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83101136-3710-4a8d-8a58-2f1552bddcc0 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:30.224028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83101136-3710-4a8d-8a58-2f1552bddcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:30.224448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83101136-3710-4a8d-8a58-2f1552bddcc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:30.233225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83101136-3710-4a8d-8a58-2f1552bddcc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:30.235057 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83101136-3710-4a8d-8a58-2f1552bddcc0 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:30.251667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-83101136-3710-4a8d-8a58-2f1552bddcc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:27:30.251667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:30.251667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:30.251667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:30.251667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:30.251667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:30.251667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:30.251667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:30.251667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:30.251667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:30.251667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:30.251667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:30.251667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:27:30.251667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:27:30.251667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:27:30.252824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:27:30.252824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:30.252824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:30.252824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:30.252824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:30.252824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:30.252824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:30.252824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:30.252824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:30.252824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:30.252824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:30.252824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:30.252824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:30.252824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:30.252824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:30.252824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:30.252824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:30.254026 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:27:30.254026 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:27:30.254026 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:27:30.254026 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:27:30.254026 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:27:30.254026 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:27:30.254026 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:27:30.254026 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:30.258646 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 610/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:27:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:30.259698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6b0c0-c9d9-4eb0-9fe6-82062d76fee5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:30.372511 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6b0c0-c9d9-4eb0-9fe6-82062d76fee5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:30.415004 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c45b8-05d9-43ee-9ee7-023115c241de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:30.415647 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c45b8-05d9-43ee-9ee7-023115c241de None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:30.419410 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c45b8-05d9-43ee-9ee7-023115c241de None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:30.420083 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c45b8-05d9-43ee-9ee7-023115c241de None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:30.421710 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c45b8-05d9-43ee-9ee7-023115c241de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:30.422269 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c45b8-05d9-43ee-9ee7-023115c241de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:30.424962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c45b8-05d9-43ee-9ee7-023115c241de None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:30.445902 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 621/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:27:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:27:30.452686 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83101136-3710-4a8d-8a58-2f1552bddcc0 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:30.530809 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:30.569423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83101136-3710-4a8d-8a58-2f1552bddcc0 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:30.609502 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb756864-03aa-4b4d-8326-8309e41efda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:30.610558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb756864-03aa-4b4d-8326-8309e41efda1 None admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:30.610866 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb756864-03aa-4b4d-8326-8309e41efda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:30.611218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb756864-03aa-4b4d-8326-8309e41efda1 None admin] PATH_INFO: `/v3/projects/ba19b660ef1442289fb322231ce26f07/users/1d1dbca57a4c43ce9bc37c2303417d05/roles/1d73a20858554285862ec7d933eb6149` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:30.629360 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb756864-03aa-4b4d-8326-8309e41efda1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba19b660ef1442289fb322231ce26f07, user_id=1d1dbca57a4c43ce9bc37c2303417d05, role_id=1d73a20858554285862ec7d933eb6149)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:30.630785 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb756864-03aa-4b4d-8326-8309e41efda1 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:30.644536 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 611/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:27:30 2022] PUT /identity/v3/projects/ba19b660ef1442289fb322231ce26f07/users/1d1dbca57a4c43ce9bc37c2303417d05/roles/1d73a20858554285862ec7d933eb6149 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:27:32.905331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b18766-9d85-43eb-a186-12ad3cc6f6fb None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:32.906173 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b18766-9d85-43eb-a186-12ad3cc6f6fb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:32.906317 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b18766-9d85-43eb-a186-12ad3cc6f6fb None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:32.908096 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 622/1233] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:27:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:27:32.914548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641f4d1-a804-44c8-9327-c6e947d5abb9 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:32.915134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641f4d1-a804-44c8-9327-c6e947d5abb9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:32.915134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641f4d1-a804-44c8-9327-c6e947d5abb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:32.935543 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d641f4d1-a804-44c8-9327-c6e947d5abb9 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:32.936734 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d641f4d1-a804-44c8-9327-c6e947d5abb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:33.014445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 612/1234] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:27:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:27:33.038533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b18766-9d85-43eb-a186-12ad3cc6f6fb None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:33.068300 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:33.161457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b18766-9d85-43eb-a186-12ad3cc6f6fb None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:33.201772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf503e-be87-4940-b80b-d1a52177530b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:33.202613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf503e-be87-4940-b80b-d1a52177530b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:33.202899 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf503e-be87-4940-b80b-d1a52177530b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:33.203180 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf503e-be87-4940-b80b-d1a52177530b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:33.214100 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cf503e-be87-4940-b80b-d1a52177530b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:27:33.223988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-28cf503e-be87-4940-b80b-d1a52177530b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:27:33.223988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:33.223988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:33.223988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:33.223988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:33.223988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:33.223988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:33.223988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:33.223988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:33.223988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:33.223988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:33.223988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:33.223988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:27:33.223988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:27:33.223988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:27:33.223988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:27:33.225308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:27:33.225308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:27:33.225308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:27:33.225308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:27:33.225308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:33.225308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:33.225308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:33.225308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:33.225308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:33.225308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:33.225308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:33.225308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:33.225308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:33.225308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:33.225308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:33.225308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:33.226216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:33.226216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:33.226216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:33.226216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:33.226216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:27:33.226216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:27:33.226216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:27:33.226216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:27:33.226216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:27:33.226216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:27:33.226216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 15:27:33.226216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:27:33.226216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 623/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Thu Jul 14 15:27:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:33.231912 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641f4d1-a804-44c8-9327-c6e947d5abb9 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:33.285664 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:33.347862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641f4d1-a804-44c8-9327-c6e947d5abb9 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:33.384303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7372242-dae0-42c9-ae14-9d8df53a63b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:33.384976 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7372242-dae0-42c9-ae14-9d8df53a63b7 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:33.385264 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7372242-dae0-42c9-ae14-9d8df53a63b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:33.385544 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7372242-dae0-42c9-ae14-9d8df53a63b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:33.386430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7372242-dae0-42c9-ae14-9d8df53a63b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:33.387903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7372242-dae0-42c9-ae14-9d8df53a63b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:33.388315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7372242-dae0-42c9-ae14-9d8df53a63b7 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:33.398049 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 613/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Thu Jul 14 15:27:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:33.404340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf503e-be87-4940-b80b-d1a52177530b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:33.500373 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:33.519694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cf503e-be87-4940-b80b-d1a52177530b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:33.567768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09654824-8b7c-4d29-addc-6661e7b70d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:33.568496 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09654824-8b7c-4d29-addc-6661e7b70d90 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:33.568779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09654824-8b7c-4d29-addc-6661e7b70d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:33.569059 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09654824-8b7c-4d29-addc-6661e7b70d90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:33.582000 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09654824-8b7c-4d29-addc-6661e7b70d90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:33.583551 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09654824-8b7c-4d29-addc-6661e7b70d90 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:33.601456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-09654824-8b7c-4d29-addc-6661e7b70d90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:33.601456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:33.601456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:33.601456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:33.601456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:33.601456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:33.601456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:33.601456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:33.601456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:33.601456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:33.601456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:33.601456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:33.601456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:27:33.601456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:27:33.601456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:27:33.602664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:27:33.602664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:33.602664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:33.602664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:33.602664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:33.602664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:33.602664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:33.602664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:33.602664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:33.602664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:33.602664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:33.602664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:33.602664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:33.602664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:33.602664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:33.602664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:33.602664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:33.604128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:27:33.604128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:27:33.604128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:33.604128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:27:33.604128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 624/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:33.609510 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7372242-dae0-42c9-ae14-9d8df53a63b7 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:33.714747 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7372242-dae0-42c9-ae14-9d8df53a63b7 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:33.724798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:33.752079 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcd301-20e6-4019-88bb-c8e6995f9c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:33.752740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcd301-20e6-4019-88bb-c8e6995f9c19 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:33.753027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcd301-20e6-4019-88bb-c8e6995f9c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:33.753306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcd301-20e6-4019-88bb-c8e6995f9c19 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:33.754135 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcd301-20e6-4019-88bb-c8e6995f9c19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:33.754461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcd301-20e6-4019-88bb-c8e6995f9c19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:33.755837 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcd301-20e6-4019-88bb-c8e6995f9c19 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:33.767948 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 614/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:33.773632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09654824-8b7c-4d29-addc-6661e7b70d90 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:33.882296 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09654824-8b7c-4d29-addc-6661e7b70d90 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:33.928561 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb4632-e020-4b19-8d18-2ec790408fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:33.929454 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb4632-e020-4b19-8d18-2ec790408fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:33.929748 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb4632-e020-4b19-8d18-2ec790408fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:33.930050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb4632-e020-4b19-8d18-2ec790408fe0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:33.933428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:33.942803 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb4632-e020-4b19-8d18-2ec790408fe0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:33.944313 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb4632-e020-4b19-8d18-2ec790408fe0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:33.960655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-4bdb4632-e020-4b19-8d18-2ec790408fe0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:27:33.960655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:33.960655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:33.960655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:33.960655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:33.960655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:33.960655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:33.960655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:33.960655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:33.960655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:33.960655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:33.960655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:33.960655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:27:33.960655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:27:33.960655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:27:33.960655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:27:33.963662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:33.963662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:33.963662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:27:33.963662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:27:33.963662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:27:33.963662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:27:33.963662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:33.963662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:33.963662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:33.963662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:33.963662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:33.963662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:33.963662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:33.963662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:33.963662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:33.963662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:33.963662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:33.963662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:33.965192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:33.965192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:33.965192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:27:33.965192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:27:33.965192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:27:33.965192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:27:33.965192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:27:33.965192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:27:33.965192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:27:33.965192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:27:33.965192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 625/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:27:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:33.968001 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcd301-20e6-4019-88bb-c8e6995f9c19 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:34.090246 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcd301-20e6-4019-88bb-c8e6995f9c19 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:34.130386 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a02d4-c6bc-41ad-bdcc-d67de59b8fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:34.131142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a02d4-c6bc-41ad-bdcc-d67de59b8fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:34.131473 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a02d4-c6bc-41ad-bdcc-d67de59b8fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:34.131811 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a02d4-c6bc-41ad-bdcc-d67de59b8fd2 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:34.132750 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a02d4-c6bc-41ad-bdcc-d67de59b8fd2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:34.133062 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a02d4-c6bc-41ad-bdcc-d67de59b8fd2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:34.134586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a02d4-c6bc-41ad-bdcc-d67de59b8fd2 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:34.154521 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 615/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jul 14 15:27:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:34.160665 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb4632-e020-4b19-8d18-2ec790408fe0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:34.282664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb4632-e020-4b19-8d18-2ec790408fe0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:34.321122 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12f97d-a13b-4db8-9dbf-01e9794f7b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:34.321875 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12f97d-a13b-4db8-9dbf-01e9794f7b47 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:34.322185 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12f97d-a13b-4db8-9dbf-01e9794f7b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:34.322461 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12f97d-a13b-4db8-9dbf-01e9794f7b47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:34.388329 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:34.396090 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12f97d-a13b-4db8-9dbf-01e9794f7b47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:34.397592 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12f97d-a13b-4db8-9dbf-01e9794f7b47 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:34.504436 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 626/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:27:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 15:27:34.510764 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a02d4-c6bc-41ad-bdcc-d67de59b8fd2 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:34.542763 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:34.626095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a02d4-c6bc-41ad-bdcc-d67de59b8fd2 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:34.666600 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62ffb8-7b8c-448f-a818-af20d0d68cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:34.667458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62ffb8-7b8c-448f-a818-af20d0d68cea None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:34.667820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62ffb8-7b8c-448f-a818-af20d0d68cea None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:34.671610 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62ffb8-7b8c-448f-a818-af20d0d68cea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:34.685910 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62ffb8-7b8c-448f-a818-af20d0d68cea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:34.688337 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62ffb8-7b8c-448f-a818-af20d0d68cea None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:34.709549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-7e62ffb8-7b8c-448f-a818-af20d0d68cea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:34.709549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:34.709549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:34.709549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:34.709549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:34.709549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:34.709549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:34.709549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:34.709549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:34.709549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:34.709549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:34.709549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:34.709549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:27:34.709549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:27:34.709549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:27:34.712570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:27:34.712570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:34.712570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:34.712570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:34.712570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:34.712570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:34.712570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:34.712570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:34.712570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:34.712570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:34.712570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:34.712570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:34.712570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:34.712570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:34.712570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:34.712570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:34.712570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:34.713774 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:27:34.713774 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:27:34.713774 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:34.713774 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:34.713774 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 616/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:27:34.717318 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12f97d-a13b-4db8-9dbf-01e9794f7b47 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:34.822920 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:34.830624 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12f97d-a13b-4db8-9dbf-01e9794f7b47 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:34.868705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ed97c-fa86-41bf-be19-35bbff5e7513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:34.869750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ed97c-fa86-41bf-be19-35bbff5e7513 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:34.870190 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ed97c-fa86-41bf-be19-35bbff5e7513 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:34.870514 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ed97c-fa86-41bf-be19-35bbff5e7513 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:34.871933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ed97c-fa86-41bf-be19-35bbff5e7513 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:34.872240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ed97c-fa86-41bf-be19-35bbff5e7513 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:34.873851 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ed97c-fa86-41bf-be19-35bbff5e7513 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:34.887683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 627/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:34.893688 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62ffb8-7b8c-448f-a818-af20d0d68cea None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:34.983397 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:35.010101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62ffb8-7b8c-448f-a818-af20d0d68cea None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:35.065619 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e8295-8839-4f7a-8afe-3b5985995b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:35.066776 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e8295-8839-4f7a-8afe-3b5985995b56 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:35.067049 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e8295-8839-4f7a-8afe-3b5985995b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:35.067326 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e8295-8839-4f7a-8afe-3b5985995b56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:35.077346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e8295-8839-4f7a-8afe-3b5985995b56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:35.078890 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e8295-8839-4f7a-8afe-3b5985995b56 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:35.093716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-c57e8295-8839-4f7a-8afe-3b5985995b56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:27:35.093716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:35.093716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:35.093716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:35.093716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:35.093716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:35.093716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:35.093716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:35.093716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:35.093716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:35.093716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:35.093716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:35.093716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:27:35.093716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:27:35.093716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:27:35.095090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:27:35.095090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:35.095090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:35.095090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:35.095090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:35.095090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:35.095090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:35.095090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:35.095090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:35.095090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:35.095090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:35.095090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:35.095090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:35.095090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:35.095090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:35.095090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:35.095090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:35.096415 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:27:35.096415 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:27:35.096415 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:27:35.096415 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:27:35.096415 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:27:35.096415 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:27:35.096415 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:27:35.096415 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:35.096415 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 617/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:27:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 15:27:35.100955 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ed97c-fa86-41bf-be19-35bbff5e7513 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:35.218456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ed97c-fa86-41bf-be19-35bbff5e7513 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:35.256622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae08dee-10f6-4c68-9935-3c154e030ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:35.257438 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae08dee-10f6-4c68-9935-3c154e030ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:35.257854 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae08dee-10f6-4c68-9935-3c154e030ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:35.258173 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae08dee-10f6-4c68-9935-3c154e030ee8 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:35.258970 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae08dee-10f6-4c68-9935-3c154e030ee8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:35.259297 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae08dee-10f6-4c68-9935-3c154e030ee8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:35.260733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae08dee-10f6-4c68-9935-3c154e030ee8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:35.274593 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 628/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:27:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:35.281608 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e8295-8839-4f7a-8afe-3b5985995b56 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:35.400712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e8295-8839-4f7a-8afe-3b5985995b56 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:35.444347 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca943adc-e355-43f5-9a37-7290eb21211f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:35.445006 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca943adc-e355-43f5-9a37-7290eb21211f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:35.445341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca943adc-e355-43f5-9a37-7290eb21211f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:35.445579 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca943adc-e355-43f5-9a37-7290eb21211f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:35.446459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca943adc-e355-43f5-9a37-7290eb21211f None admin] RBAC: Adding query filter params (role.id=1d73a20858554285862ec7d933eb6149, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=1d1dbca57a4c43ce9bc37c2303417d05) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:35.446776 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca943adc-e355-43f5-9a37-7290eb21211f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:35.448270 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca943adc-e355-43f5-9a37-7290eb21211f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:35.456200 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 618/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:27:35 2022] GET /identity/v3/role_assignments?user.id=1d1dbca57a4c43ce9bc37c2303417d05&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=1d73a20858554285862ec7d933eb6149 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:37.995450 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e652b41-5af3-4792-894b-f2d578dee4d9 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:37.996028 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e652b41-5af3-4792-894b-f2d578dee4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:37.996028 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e652b41-5af3-4792-894b-f2d578dee4d9 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:37.998168 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 629/1247] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:27:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:27:38.004253 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9119527-9d65-4d5a-806b-6efc49bed434 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:38.004817 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9119527-9d65-4d5a-806b-6efc49bed434 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:38.004817 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9119527-9d65-4d5a-806b-6efc49bed434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:38.010359 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:38.025593 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d9119527-9d65-4d5a-806b-6efc49bed434 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:38.027624 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d9119527-9d65-4d5a-806b-6efc49bed434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:38.113772 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 619/1248] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:27:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:27:38.139585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e652b41-5af3-4792-894b-f2d578dee4d9 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:38.165546 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:38.272408 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e652b41-5af3-4792-894b-f2d578dee4d9 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:38.306588 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46f4fb-a75d-459d-aeae-09c6aae8ac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:38.307372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46f4fb-a75d-459d-aeae-09c6aae8ac69 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:38.307654 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46f4fb-a75d-459d-aeae-09c6aae8ac69 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:38.307927 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46f4fb-a75d-459d-aeae-09c6aae8ac69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:38.320625 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46f4fb-a75d-459d-aeae-09c6aae8ac69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:27:38.328757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-8c46f4fb-a75d-459d-aeae-09c6aae8ac69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:27:38.328757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:38.328757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:38.328757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:38.328757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:38.328757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:38.328757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:38.328757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:38.328757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:38.328757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:38.328757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:38.328757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:38.328757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:27:38.328757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:27:38.328757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:27:38.328757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:27:38.329879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:27:38.329879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:27:38.329879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:27:38.329879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:27:38.329879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:38.329879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:38.329879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:38.329879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:38.329879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:38.329879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:38.329879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:38.329879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:38.329879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:38.329879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:38.329879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:38.329879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:38.331157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:38.331157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:38.331157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:38.331157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:38.331157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:27:38.331157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:27:38.331157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:27:38.331157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:27:38.331157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:27:38.331157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:27:38.331157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:27:38.331157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:27:38.331157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 630/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:27:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:38.336249 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9119527-9d65-4d5a-806b-6efc49bed434 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:38.455313 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9119527-9d65-4d5a-806b-6efc49bed434 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:38.488568 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:38.494886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafe257-fba2-4f16-ac74-2ea5f231c232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:38.495600 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafe257-fba2-4f16-ac74-2ea5f231c232 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:38.495883 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafe257-fba2-4f16-ac74-2ea5f231c232 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:38.496686 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafe257-fba2-4f16-ac74-2ea5f231c232 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:38.497529 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafe257-fba2-4f16-ac74-2ea5f231c232 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:38.497855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafe257-fba2-4f16-ac74-2ea5f231c232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:38.499277 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafe257-fba2-4f16-ac74-2ea5f231c232 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:38.513574 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 620/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:27:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:27:38.514924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46f4fb-a75d-459d-aeae-09c6aae8ac69 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:38.610573 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:38.635709 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46f4fb-a75d-459d-aeae-09c6aae8ac69 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:38.680502 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d653b-a438-4791-9da9-9281399ec1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:38.681375 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d653b-a438-4791-9da9-9281399ec1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:38.681667 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d653b-a438-4791-9da9-9281399ec1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:38.682044 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d653b-a438-4791-9da9-9281399ec1c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:38.695803 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d653b-a438-4791-9da9-9281399ec1c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:38.697754 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d653b-a438-4791-9da9-9281399ec1c1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:38.720035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-618d653b-a438-4791-9da9-9281399ec1c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:38.720035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:38.720035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:38.720035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:38.720035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:38.720035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:38.720035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:38.720035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:38.720035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:38.720035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:38.720035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:38.720035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:38.720035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:27:38.720035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:27:38.720035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:27:38.721207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:27:38.721207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:38.721207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:38.721207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:38.721207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:38.721207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:38.721207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:38.721207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:38.721207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:38.721207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:38.721207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:38.721207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:38.721207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:38.721207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:38.721207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:38.721207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:38.721207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:38.722254 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:27:38.722254 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:27:38.722254 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:38.722254 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:27:38.726841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 631/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:38.728080 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafe257-fba2-4f16-ac74-2ea5f231c232 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:38.836201 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafe257-fba2-4f16-ac74-2ea5f231c232 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:38.880230 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca67dd3-7118-4b37-bef3-ec0735c18ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:38.880991 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca67dd3-7118-4b37-bef3-ec0735c18ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:38.881460 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca67dd3-7118-4b37-bef3-ec0735c18ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:38.881707 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca67dd3-7118-4b37-bef3-ec0735c18ed3 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:38.882866 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca67dd3-7118-4b37-bef3-ec0735c18ed3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:38.883281 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca67dd3-7118-4b37-bef3-ec0735c18ed3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:38.884906 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca67dd3-7118-4b37-bef3-ec0735c18ed3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:38.900040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 621/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:38.906428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d653b-a438-4791-9da9-9281399ec1c1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:39.036333 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d653b-a438-4791-9da9-9281399ec1c1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:39.064334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:39.073173 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ecd14-8ac7-4c9f-86fe-e2ad9a0f2a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:39.074080 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ecd14-8ac7-4c9f-86fe-e2ad9a0f2a56 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:39.075141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ecd14-8ac7-4c9f-86fe-e2ad9a0f2a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:39.075417 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ecd14-8ac7-4c9f-86fe-e2ad9a0f2a56 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:39.083710 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ecd14-8ac7-4c9f-86fe-e2ad9a0f2a56 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:39.085180 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ecd14-8ac7-4c9f-86fe-e2ad9a0f2a56 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:39.101471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-523ecd14-8ac7-4c9f-86fe-e2ad9a0f2a56 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:27:39.101471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:39.101471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:39.101471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:39.101471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:39.101471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:39.101471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:39.101471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:39.101471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:39.101471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:39.101471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:39.101471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:39.101471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:27:39.101471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:27:39.101471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:27:39.101471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:27:39.102676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:39.102676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:39.102676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:27:39.102676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:27:39.102676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:27:39.102676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:27:39.102676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:39.102676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:39.102676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:39.102676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:39.102676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:39.102676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:39.102676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:39.102676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:39.102676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:39.102676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:39.102676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:39.102676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:39.108609 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:39.108609 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:39.108609 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:27:39.108609 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:27:39.108609 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:27:39.108609 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:27:39.108609 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:27:39.108609 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:27:39.108609 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:27:39.108609 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:27:39.108609 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 632/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:27:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:39.109322 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca67dd3-7118-4b37-bef3-ec0735c18ed3 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:39.174581 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:39.226571 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca67dd3-7118-4b37-bef3-ec0735c18ed3 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:39.269390 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cac1f4-1363-48a3-bc22-891dda5f0711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:39.270273 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cac1f4-1363-48a3-bc22-891dda5f0711 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:39.270539 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cac1f4-1363-48a3-bc22-891dda5f0711 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:39.270812 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cac1f4-1363-48a3-bc22-891dda5f0711 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:39.271648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cac1f4-1363-48a3-bc22-891dda5f0711 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:39.271957 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cac1f4-1363-48a3-bc22-891dda5f0711 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:39.273546 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cac1f4-1363-48a3-bc22-891dda5f0711 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:39.294421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 622/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jul 14 15:27:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:39.300899 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ecd14-8ac7-4c9f-86fe-e2ad9a0f2a56 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:39.415870 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ecd14-8ac7-4c9f-86fe-e2ad9a0f2a56 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:39.463225 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8a0e4-b5c4-4c7b-bd85-1b66c043dc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:39.464295 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8a0e4-b5c4-4c7b-bd85-1b66c043dc90 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:39.464859 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8a0e4-b5c4-4c7b-bd85-1b66c043dc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:39.465342 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8a0e4-b5c4-4c7b-bd85-1b66c043dc90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:39.534649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:39.548541 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8a0e4-b5c4-4c7b-bd85-1b66c043dc90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:39.550017 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8a0e4-b5c4-4c7b-bd85-1b66c043dc90 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:39.666129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 633/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:27:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:27:39.672990 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cac1f4-1363-48a3-bc22-891dda5f0711 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:39.782513 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cac1f4-1363-48a3-bc22-891dda5f0711 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:39.799745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:39.822331 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b73ec-3888-43ba-8e2d-911f41cb6e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:39.823142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b73ec-3888-43ba-8e2d-911f41cb6e4d None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:39.823532 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b73ec-3888-43ba-8e2d-911f41cb6e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:39.823817 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b73ec-3888-43ba-8e2d-911f41cb6e4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:39.835575 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b73ec-3888-43ba-8e2d-911f41cb6e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:39.837075 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b73ec-3888-43ba-8e2d-911f41cb6e4d None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:39.857578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-8d1b73ec-3888-43ba-8e2d-911f41cb6e4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:39.857578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:39.857578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:39.857578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:39.857578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:39.857578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:39.857578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:39.857578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:39.857578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:39.857578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:39.857578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:39.857578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:39.857578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:27:39.857578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:27:39.857578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:27:39.858649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:27:39.858649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:39.858649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:39.858649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:39.858649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:39.858649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:39.858649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:39.858649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:39.858649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:39.858649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:39.858649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:39.858649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:39.858649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:39.858649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:39.858649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:39.858649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:39.858649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:39.859580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:27:39.859580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:27:39.859580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:39.859580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:39.859580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 623/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:39.865091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8a0e4-b5c4-4c7b-bd85-1b66c043dc90 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:39.962873 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:39.976761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8a0e4-b5c4-4c7b-bd85-1b66c043dc90 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:40.014637 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd115332-17c8-4518-bff5-7c5a0d5b3796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:40.015324 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd115332-17c8-4518-bff5-7c5a0d5b3796 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:40.015614 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd115332-17c8-4518-bff5-7c5a0d5b3796 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:40.015929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd115332-17c8-4518-bff5-7c5a0d5b3796 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:40.016622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd115332-17c8-4518-bff5-7c5a0d5b3796 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:40.016934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd115332-17c8-4518-bff5-7c5a0d5b3796 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:40.018351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd115332-17c8-4518-bff5-7c5a0d5b3796 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:40.032036 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 634/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:27:40.037931 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b73ec-3888-43ba-8e2d-911f41cb6e4d None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:40.140445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b73ec-3888-43ba-8e2d-911f41cb6e4d None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:40.177168 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ce857-f993-4b70-a435-d685434c2f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:40.177959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ce857-f993-4b70-a435-d685434c2f81 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:40.178284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ce857-f993-4b70-a435-d685434c2f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:40.178560 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ce857-f993-4b70-a435-d685434c2f81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:40.186156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ce857-f993-4b70-a435-d685434c2f81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:40.187620 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ce857-f993-4b70-a435-d685434c2f81 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:40.201658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-5e2ce857-f993-4b70-a435-d685434c2f81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:27:40.201658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:40.201658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:40.201658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:40.201658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:40.201658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:40.201658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:40.201658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:40.201658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:40.201658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:40.201658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:40.201658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:40.201658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:27:40.201658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:27:40.201658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:27:40.202805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:27:40.202805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:40.202805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:40.202805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:40.202805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:40.202805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:40.202805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:40.202805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:40.202805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:40.202805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:40.202805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:40.202805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:40.202805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:40.202805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:40.202805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:40.202805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:40.202805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:40.203972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:27:40.203972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:27:40.203972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:27:40.203972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:27:40.203972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:27:40.203972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:27:40.203972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:27:40.203972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:40.203972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 624/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:27:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:40.209079 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd115332-17c8-4518-bff5-7c5a0d5b3796 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:40.316358 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd115332-17c8-4518-bff5-7c5a0d5b3796 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:40.351148 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f26198-36c6-4c62-9b69-90e1c946a805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:40.351813 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f26198-36c6-4c62-9b69-90e1c946a805 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:40.352103 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f26198-36c6-4c62-9b69-90e1c946a805 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:40.352385 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f26198-36c6-4c62-9b69-90e1c946a805 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:40.353175 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f26198-36c6-4c62-9b69-90e1c946a805 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:40.353494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f26198-36c6-4c62-9b69-90e1c946a805 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:40.355008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f26198-36c6-4c62-9b69-90e1c946a805 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:40.367989 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 635/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:27:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:40.374926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ce857-f993-4b70-a435-d685434c2f81 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:40.399971 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:40.477168 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ce857-f993-4b70-a435-d685434c2f81 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:40.510551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca2adf-2069-4ffc-a337-ad88bfbe3a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:40.511275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca2adf-2069-4ffc-a337-ad88bfbe3a90 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:40.511558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca2adf-2069-4ffc-a337-ad88bfbe3a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:40.511970 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca2adf-2069-4ffc-a337-ad88bfbe3a90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:40.512802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca2adf-2069-4ffc-a337-ad88bfbe3a90 None admin] RBAC: Adding query filter params (role.id=87f040877bfa47bda56305eb022af09e, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=1d1dbca57a4c43ce9bc37c2303417d05) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:40.513121 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca2adf-2069-4ffc-a337-ad88bfbe3a90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:40.514601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca2adf-2069-4ffc-a337-ad88bfbe3a90 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:40.520043 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 625/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:27:40 2022] GET /identity/v3/role_assignments?user.id=1d1dbca57a4c43ce9bc37c2303417d05&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=87f040877bfa47bda56305eb022af09e => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:42.576375 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f513559-e716-4378-bc5b-912ca75b86b6 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:42.576911 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f513559-e716-4378-bc5b-912ca75b86b6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:42.576911 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f513559-e716-4378-bc5b-912ca75b86b6 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:42.578316 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 636/1261] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:27:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:27:42.583509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b590765-36c3-4cd9-b5cf-8ea6dced8ab1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:42.583890 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b590765-36c3-4cd9-b5cf-8ea6dced8ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:42.584075 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b590765-36c3-4cd9-b5cf-8ea6dced8ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:42.602397 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9b590765-36c3-4cd9-b5cf-8ea6dced8ab1 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:42.603655 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9b590765-36c3-4cd9-b5cf-8ea6dced8ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:42.673516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 626/1262] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:27:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:27:42.698562 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f513559-e716-4378-bc5b-912ca75b86b6 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:42.709768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:42.800590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f513559-e716-4378-bc5b-912ca75b86b6 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:42.835436 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e792f5-877f-40fc-aba9-c0f9166ce648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:42.836214 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e792f5-877f-40fc-aba9-c0f9166ce648 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:42.836499 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e792f5-877f-40fc-aba9-c0f9166ce648 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:42.836779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e792f5-877f-40fc-aba9-c0f9166ce648 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:42.846792 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e792f5-877f-40fc-aba9-c0f9166ce648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:27:42.854519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-d4e792f5-877f-40fc-aba9-c0f9166ce648 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:27:42.854519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:42.854519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:42.854519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:42.854519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:42.854519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:42.854519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:42.854519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:42.854519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:42.854519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:42.854519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:42.854519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:42.854519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:27:42.854519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:27:42.854519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:27:42.854519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:27:42.855529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:27:42.855529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:27:42.855529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:27:42.855529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:27:42.855529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:42.855529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:42.855529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:42.855529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:42.855529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:42.855529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:42.855529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:42.855529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:42.855529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:42.855529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:42.855529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:42.855529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:42.856401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:42.856401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:42.856401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:42.856401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:42.856401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:27:42.856401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:27:42.856401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:27:42.856401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:27:42.856401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:27:42.856401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:27:42.856401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:27:42.856401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:27:42.856401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 637/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:27:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:42.862563 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b590765-36c3-4cd9-b5cf-8ea6dced8ab1 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:42.891473 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:42.989790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b590765-36c3-4cd9-b5cf-8ea6dced8ab1 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:43.022929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d5149-4e30-4cd0-b7ec-4299b809ae03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:43.023580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d5149-4e30-4cd0-b7ec-4299b809ae03 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:43.023861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d5149-4e30-4cd0-b7ec-4299b809ae03 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:43.024135 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d5149-4e30-4cd0-b7ec-4299b809ae03 None admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:43.024867 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d5149-4e30-4cd0-b7ec-4299b809ae03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:43.025172 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d5149-4e30-4cd0-b7ec-4299b809ae03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:43.026568 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d5149-4e30-4cd0-b7ec-4299b809ae03 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:43.034607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 627/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:27:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:43.040349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e792f5-877f-40fc-aba9-c0f9166ce648 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:43.107495 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:43.141109 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e792f5-877f-40fc-aba9-c0f9166ce648 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:43.174160 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77f71e-00bb-4df8-a60e-883dad5e0b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:43.174945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77f71e-00bb-4df8-a60e-883dad5e0b25 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:43.175230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77f71e-00bb-4df8-a60e-883dad5e0b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:43.175509 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77f71e-00bb-4df8-a60e-883dad5e0b25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:43.186015 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77f71e-00bb-4df8-a60e-883dad5e0b25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:43.187506 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f77f71e-00bb-4df8-a60e-883dad5e0b25 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:43.205211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-1f77f71e-00bb-4df8-a60e-883dad5e0b25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:43.205211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:43.205211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:43.205211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:43.205211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:43.205211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:43.205211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:43.205211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:43.205211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:43.205211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:43.205211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:43.205211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:43.205211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:27:43.205211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:27:43.205211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:27:43.206298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:27:43.206298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:43.206298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:43.206298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:43.206298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:43.206298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:43.206298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:43.206298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:43.206298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:43.206298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:43.206298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:43.206298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:43.206298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:43.206298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:43.206298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:43.206298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:43.206298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:43.207460 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:27:43.207460 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:27:43.207460 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:43.207460 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:27:43.207460 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 638/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:43.212264 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d5149-4e30-4cd0-b7ec-4299b809ae03 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:43.293882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:43.313396 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d5149-4e30-4cd0-b7ec-4299b809ae03 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:43.350873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49424029-5981-4ecf-ae5c-79810d594a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:43.351531 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49424029-5981-4ecf-ae5c-79810d594a02 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:43.351817 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49424029-5981-4ecf-ae5c-79810d594a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:43.352098 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49424029-5981-4ecf-ae5c-79810d594a02 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:43.352820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49424029-5981-4ecf-ae5c-79810d594a02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:43.353130 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49424029-5981-4ecf-ae5c-79810d594a02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:43.354535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49424029-5981-4ecf-ae5c-79810d594a02 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:43.367586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 628/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:43.373653 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77f71e-00bb-4df8-a60e-883dad5e0b25 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:43.474327 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77f71e-00bb-4df8-a60e-883dad5e0b25 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:43.493222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:43.507717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a6138-ea80-453f-be79-58342e9c8f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:43.508512 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a6138-ea80-453f-be79-58342e9c8f92 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:43.508797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a6138-ea80-453f-be79-58342e9c8f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:43.509072 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a6138-ea80-453f-be79-58342e9c8f92 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:43.516950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a6138-ea80-453f-be79-58342e9c8f92 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:43.518421 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a6138-ea80-453f-be79-58342e9c8f92 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:43.532414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-155a6138-ea80-453f-be79-58342e9c8f92 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:27:43.532414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:43.532414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:43.532414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:43.532414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:43.532414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:43.532414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:43.532414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:43.532414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:43.532414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:43.532414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:43.532414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:43.532414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:27:43.532414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:27:43.532414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:27:43.532414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:27:43.538162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:43.538162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:43.538162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:27:43.538162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:27:43.538162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:27:43.538162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:27:43.538162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:43.538162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:43.538162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:43.538162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:43.538162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:43.538162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:43.538162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:43.538162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:43.538162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:43.538162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:43.538162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:43.538162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:43.539469 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:43.539469 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:43.539469 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:27:43.539469 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:27:43.539469 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:27:43.539469 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:27:43.539469 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:27:43.539469 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:27:43.539469 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:27:43.539469 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:27:43.539469 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 639/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:27:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:43.540195 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49424029-5981-4ecf-ae5c-79810d594a02 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:43.641718 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49424029-5981-4ecf-ae5c-79810d594a02 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:43.674365 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0e14e-e0d7-4351-a942-ae404a6ed2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:43.675021 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0e14e-e0d7-4351-a942-ae404a6ed2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:43.675304 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0e14e-e0d7-4351-a942-ae404a6ed2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:43.675580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0e14e-e0d7-4351-a942-ae404a6ed2d3 None admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:43.676403 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0e14e-e0d7-4351-a942-ae404a6ed2d3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:43.676715 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0e14e-e0d7-4351-a942-ae404a6ed2d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:43.678198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0e14e-e0d7-4351-a942-ae404a6ed2d3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:43.687346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:43.696090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 629/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jul 14 15:27:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:43.703447 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a6138-ea80-453f-be79-58342e9c8f92 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:43.806155 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a6138-ea80-453f-be79-58342e9c8f92 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:43.845117 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316a959-7d6c-47df-809c-72e3834c498b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:43.846324 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316a959-7d6c-47df-809c-72e3834c498b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:43.846708 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316a959-7d6c-47df-809c-72e3834c498b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:43.847047 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316a959-7d6c-47df-809c-72e3834c498b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:43.861205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316a959-7d6c-47df-809c-72e3834c498b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:43.863364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316a959-7d6c-47df-809c-72e3834c498b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:43.882205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-0316a959-7d6c-47df-809c-72e3834c498b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:43.882205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:43.882205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:43.882205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:43.882205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:43.882205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:43.882205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:43.882205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:43.882205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:43.882205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:43.882205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:43.882205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:43.882205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:27:43.882205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:27:43.882205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:27:43.883162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:27:43.883162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:43.883162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:43.883162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:43.883162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:43.883162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:43.883162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:43.883162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:43.883162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:43.883162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:43.883162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:43.883162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:43.883162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:43.883162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:43.883162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:43.883162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:43.883162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:43.884270 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:27:43.884270 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:27:43.884270 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:43.884270 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:27:43.884270 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 640/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:43.889700 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0e14e-e0d7-4351-a942-ae404a6ed2d3 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:43.992946 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0e14e-e0d7-4351-a942-ae404a6ed2d3 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:44.026795 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01743a23-a126-475a-b6f2-27ee29c4d208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:44.027520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01743a23-a126-475a-b6f2-27ee29c4d208 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:44.027809 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01743a23-a126-475a-b6f2-27ee29c4d208 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:44.028084 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01743a23-a126-475a-b6f2-27ee29c4d208 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:44.028800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01743a23-a126-475a-b6f2-27ee29c4d208 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:44.029109 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01743a23-a126-475a-b6f2-27ee29c4d208 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:44.030591 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01743a23-a126-475a-b6f2-27ee29c4d208 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:44.041548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 630/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:44.048051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316a959-7d6c-47df-809c-72e3834c498b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:44.080260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:44.148832 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316a959-7d6c-47df-809c-72e3834c498b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:44.182350 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d1964-9643-4f47-8dbb-55fa2796da76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:44.183146 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d1964-9643-4f47-8dbb-55fa2796da76 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:44.183451 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d1964-9643-4f47-8dbb-55fa2796da76 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:44.183728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d1964-9643-4f47-8dbb-55fa2796da76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:44.190310 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d1964-9643-4f47-8dbb-55fa2796da76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:44.191773 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d1964-9643-4f47-8dbb-55fa2796da76 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:44.205698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-f30d1964-9643-4f47-8dbb-55fa2796da76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:27:44.205698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:44.205698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:44.205698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:44.205698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:44.205698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:44.205698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:44.205698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:44.205698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:44.205698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:44.205698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:44.205698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:44.205698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:27:44.205698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:27:44.205698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:27:44.206775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:27:44.206775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:44.206775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:44.206775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:44.206775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:44.206775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:44.206775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:44.206775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:44.206775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:44.206775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:44.206775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:44.206775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:44.206775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:44.206775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:44.206775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:44.206775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:44.206775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:44.207717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:27:44.207717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:27:44.207717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:27:44.207717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:27:44.207717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:27:44.207717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:27:44.207717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:27:44.207717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:27:44.207717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 641/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:27:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:44.212859 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01743a23-a126-475a-b6f2-27ee29c4d208 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:44.270762 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:44.312537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01743a23-a126-475a-b6f2-27ee29c4d208 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:44.345203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cae12c-4b32-43e6-a72f-436e51a84a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:44.345852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cae12c-4b32-43e6-a72f-436e51a84a64 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:44.346164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cae12c-4b32-43e6-a72f-436e51a84a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:44.346441 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cae12c-4b32-43e6-a72f-436e51a84a64 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:44.347216 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cae12c-4b32-43e6-a72f-436e51a84a64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:44.347525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cae12c-4b32-43e6-a72f-436e51a84a64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:44.348950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cae12c-4b32-43e6-a72f-436e51a84a64 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:44.362112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 631/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:27:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:44.368110 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d1964-9643-4f47-8dbb-55fa2796da76 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:44.461506 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:44.470824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d1964-9643-4f47-8dbb-55fa2796da76 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:44.504425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e48d17-aa5e-4496-8dc4-42acdbd2bf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:44.505332 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e48d17-aa5e-4496-8dc4-42acdbd2bf24 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:44.505618 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e48d17-aa5e-4496-8dc4-42acdbd2bf24 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:44.505895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e48d17-aa5e-4496-8dc4-42acdbd2bf24 None admin] PATH_INFO: `/v3/projects/ba19b660ef1442289fb322231ce26f07/users/1d1dbca57a4c43ce9bc37c2303417d05/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:44.507855 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e48d17-aa5e-4496-8dc4-42acdbd2bf24 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba19b660ef1442289fb322231ce26f07, user_id=1d1dbca57a4c43ce9bc37c2303417d05, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:44.509305 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e48d17-aa5e-4496-8dc4-42acdbd2bf24 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:44.522858 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 642/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Thu Jul 14 15:27:44 2022] PUT /identity/v3/projects/ba19b660ef1442289fb322231ce26f07/users/1d1dbca57a4c43ce9bc37c2303417d05/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:27:46.580557 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f13e97-6668-49c9-9e06-0a003df76090 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:46.581124 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f13e97-6668-49c9-9e06-0a003df76090 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:46.581124 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f13e97-6668-49c9-9e06-0a003df76090 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:46.582522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 632/1274] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:27:46.588671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29beaa0-e861-4649-905b-43d56c259223 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:46.589133 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29beaa0-e861-4649-905b-43d56c259223 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:46.589240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29beaa0-e861-4649-905b-43d56c259223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:46.607095 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d29beaa0-e861-4649-905b-43d56c259223 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:46.608271 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d29beaa0-e861-4649-905b-43d56c259223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:46.676931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 643/1275] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:27:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:27:46.700565 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f13e97-6668-49c9-9e06-0a003df76090 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:46.799561 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f13e97-6668-49c9-9e06-0a003df76090 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:46.815908 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:46.832893 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9acc55-53e9-459a-8471-3cdf5fad6298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:46.833663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9acc55-53e9-459a-8471-3cdf5fad6298 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:46.833943 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9acc55-53e9-459a-8471-3cdf5fad6298 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:46.834250 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9acc55-53e9-459a-8471-3cdf5fad6298 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:46.844789 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9acc55-53e9-459a-8471-3cdf5fad6298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 15:27:46.852341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-8b9acc55-53e9-459a-8471-3cdf5fad6298 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:27:46.852341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:46.852341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:46.852341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:46.852341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:46.852341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:46.852341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:46.852341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:46.852341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:46.852341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:46.852341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:46.852341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:46.852341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 15:27:46.852341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 15:27:46.852341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 15:27:46.852341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 15:27:46.853474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 15:27:46.853474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 15:27:46.853474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 15:27:46.853474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 15:27:46.853474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:46.853474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:46.853474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:46.853474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:46.853474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:46.853474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:46.853474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:46.853474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:46.853474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:46.853474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:46.853474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:46.853474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:46.854555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:46.854555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:46.854555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:46.854555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:46.854555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 15:27:46.854555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 15:27:46.854555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 15:27:46.854555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 15:27:46.854555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 15:27:46.854555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 15:27:46.854555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 15:27:46.854555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:46.854555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 633/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Thu Jul 14 15:27:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:46.859784 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29beaa0-e861-4649-905b-43d56c259223 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:46.958181 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:46.977428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29beaa0-e861-4649-905b-43d56c259223 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:47.012077 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb8d38-32f7-495b-a5b5-5d15c825fa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:47.012077 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb8d38-32f7-495b-a5b5-5d15c825fa1f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:47.012335 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb8d38-32f7-495b-a5b5-5d15c825fa1f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:47.012570 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb8d38-32f7-495b-a5b5-5d15c825fa1f None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:47.013296 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb8d38-32f7-495b-a5b5-5d15c825fa1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:47.013602 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb8d38-32f7-495b-a5b5-5d15c825fa1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:47.014990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb8d38-32f7-495b-a5b5-5d15c825fa1f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:47.023267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 644/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Thu Jul 14 15:27:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:47.029933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9acc55-53e9-459a-8471-3cdf5fad6298 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:47.126151 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9acc55-53e9-459a-8471-3cdf5fad6298 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:47.158924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240eb00d-de92-4fde-8d73-618d58a24396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:47.159686 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240eb00d-de92-4fde-8d73-618d58a24396 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:47.159965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240eb00d-de92-4fde-8d73-618d58a24396 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:47.160232 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240eb00d-de92-4fde-8d73-618d58a24396 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:47.170430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240eb00d-de92-4fde-8d73-618d58a24396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:47.171874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240eb00d-de92-4fde-8d73-618d58a24396 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:47.189141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-240eb00d-de92-4fde-8d73-618d58a24396 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:47.189141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:47.189141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:47.189141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:47.189141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:47.189141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:47.189141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:47.189141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:47.189141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:47.189141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:47.189141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:47.189141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:47.189141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:27:47.189141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:27:47.189141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:27:47.190335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:27:47.190335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:47.190335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:47.190335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:47.190335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:47.190335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:47.190335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:47.190335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:47.190335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:47.190335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:47.190335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:47.190335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:47.190335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:47.190335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:47.190335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:47.190335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:47.190335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:47.191320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:27:47.191320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:27:47.191320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:47.191320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:47.191320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 634/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:47.196119 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb8d38-32f7-495b-a5b5-5d15c825fa1f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:47.296651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb8d38-32f7-495b-a5b5-5d15c825fa1f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:47.331142 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daab25-9ae6-4764-ac83-979eaf5d894c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:47.331794 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daab25-9ae6-4764-ac83-979eaf5d894c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:47.332082 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daab25-9ae6-4764-ac83-979eaf5d894c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:47.332365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daab25-9ae6-4764-ac83-979eaf5d894c None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:47.333084 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30daab25-9ae6-4764-ac83-979eaf5d894c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:47.333394 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30daab25-9ae6-4764-ac83-979eaf5d894c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:47.334795 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30daab25-9ae6-4764-ac83-979eaf5d894c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:47.346637 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 645/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:47.352330 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240eb00d-de92-4fde-8d73-618d58a24396 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:47.382823 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:47.465023 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240eb00d-de92-4fde-8d73-618d58a24396 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:47.498316 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7eaf27-39d2-4648-81c4-5eedb3b79bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:47.499103 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7eaf27-39d2-4648-81c4-5eedb3b79bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:47.499391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7eaf27-39d2-4648-81c4-5eedb3b79bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:47.499662 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7eaf27-39d2-4648-81c4-5eedb3b79bb3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:47.507081 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7eaf27-39d2-4648-81c4-5eedb3b79bb3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:47.508505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7eaf27-39d2-4648-81c4-5eedb3b79bb3 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:47.523844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-5f7eaf27-39d2-4648-81c4-5eedb3b79bb3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:27:47.523844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:47.523844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:47.523844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:47.523844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:47.523844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:47.523844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:47.523844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:47.523844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:47.523844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:47.523844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:47.523844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:47.523844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 15:27:47.523844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 15:27:47.523844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 15:27:47.523844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 15:27:47.525073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:47.525073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:47.525073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 15:27:47.525073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:27:47.525073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 15:27:47.525073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 15:27:47.525073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:47.525073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:47.525073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:47.525073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:47.525073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:47.525073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:47.525073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:47.525073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:47.525073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:47.525073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:47.525073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:47.525073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:47.526091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:47.526091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:47.526091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 15:27:47.526091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 15:27:47.526091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 15:27:47.526091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 15:27:47.526091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 15:27:47.526091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 15:27:47.526091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 15:27:47.526091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:47.526091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 635/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:27:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:47.531074 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daab25-9ae6-4764-ac83-979eaf5d894c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:47.534854 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:47.633762 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daab25-9ae6-4764-ac83-979eaf5d894c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:47.666464 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10224959-8d25-48ea-aa93-37ebd45b1e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:47.667257 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10224959-8d25-48ea-aa93-37ebd45b1e7a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:47.668144 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10224959-8d25-48ea-aa93-37ebd45b1e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:47.668290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10224959-8d25-48ea-aa93-37ebd45b1e7a None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:47.669680 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10224959-8d25-48ea-aa93-37ebd45b1e7a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:47.670144 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10224959-8d25-48ea-aa93-37ebd45b1e7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:47.671440 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10224959-8d25-48ea-aa93-37ebd45b1e7a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:47.693458 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 646/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Thu Jul 14 15:27:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:47.699428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7eaf27-39d2-4648-81c4-5eedb3b79bb3 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:47.786694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:47.796784 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7eaf27-39d2-4648-81c4-5eedb3b79bb3 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:47.829692 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd5083-4b8c-44c5-8675-6a44f589e0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:47.830357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd5083-4b8c-44c5-8675-6a44f589e0ec None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:47.830649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd5083-4b8c-44c5-8675-6a44f589e0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:47.830926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd5083-4b8c-44c5-8675-6a44f589e0ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:47.900284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd5083-4b8c-44c5-8675-6a44f589e0ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:47.901654 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd5083-4b8c-44c5-8675-6a44f589e0ec None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:47.987971 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:47.998522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 636/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Thu Jul 14 15:27:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 15:27:48.004489 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10224959-8d25-48ea-aa93-37ebd45b1e7a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:48.066954 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:48.106023 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10224959-8d25-48ea-aa93-37ebd45b1e7a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:48.139095 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37da68b-6e53-4152-b8fb-ae882cb68e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:48.139877 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37da68b-6e53-4152-b8fb-ae882cb68e0b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:48.140162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37da68b-6e53-4152-b8fb-ae882cb68e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:48.140438 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37da68b-6e53-4152-b8fb-ae882cb68e0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:48.150356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37da68b-6e53-4152-b8fb-ae882cb68e0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:48.151837 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37da68b-6e53-4152-b8fb-ae882cb68e0b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:48.170428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-f37da68b-6e53-4152-b8fb-ae882cb68e0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:48.170428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:48.170428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:48.170428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:48.170428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:48.170428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:48.170428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:48.170428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:48.170428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:48.170428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:48.170428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:48.170428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:48.170428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 15:27:48.170428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 15:27:48.170428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 15:27:48.171497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 15:27:48.171497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:48.171497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:48.171497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:48.171497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:48.171497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:48.171497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:48.171497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:48.171497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:48.171497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:48.171497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:48.171497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:48.171497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:48.171497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:48.171497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:48.171497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:48.171497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:48.177733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 15:27:48.177733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 15:27:48.177733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 15:27:48.177733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:27:48.177733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 647/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:48.178244 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd5083-4b8c-44c5-8675-6a44f589e0ec None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:48.274430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd5083-4b8c-44c5-8675-6a44f589e0ec None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:48.308048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc32b3-3dfc-452e-ac1f-c4c8c7193582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:48.308726 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc32b3-3dfc-452e-ac1f-c4c8c7193582 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:48.309010 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc32b3-3dfc-452e-ac1f-c4c8c7193582 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:48.309286 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc32b3-3dfc-452e-ac1f-c4c8c7193582 None admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:48.310134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc32b3-3dfc-452e-ac1f-c4c8c7193582 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:48.310719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc32b3-3dfc-452e-ac1f-c4c8c7193582 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:48.312085 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc32b3-3dfc-452e-ac1f-c4c8c7193582 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:48.323022 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 637/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Thu Jul 14 15:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:48.329386 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37da68b-6e53-4152-b8fb-ae882cb68e0b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:48.427475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37da68b-6e53-4152-b8fb-ae882cb68e0b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:48.441860 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:48.462580 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e2add-dc9f-4212-9d41-69b92cd0a39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:48.463369 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e2add-dc9f-4212-9d41-69b92cd0a39b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:48.463656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e2add-dc9f-4212-9d41-69b92cd0a39b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:48.463936 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e2add-dc9f-4212-9d41-69b92cd0a39b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:48.471205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e2add-dc9f-4212-9d41-69b92cd0a39b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:48.472662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e2add-dc9f-4212-9d41-69b92cd0a39b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:48.486279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-b32e2add-dc9f-4212-9d41-69b92cd0a39b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:27:48.486279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:48.486279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:48.486279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:48.486279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:48.486279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:48.486279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:48.486279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:48.486279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:48.486279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:48.486279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:48.486279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:48.486279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 15:27:48.486279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 15:27:48.486279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 15:27:48.487347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 15:27:48.487347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:48.487347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:48.487347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:48.487347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:48.487347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:48.487347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:48.487347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:48.487347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:48.487347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:48.487347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:48.487347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:48.487347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:48.487347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:48.487347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:48.487347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:48.487347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:48.488766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 15:27:48.488766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 15:27:48.488766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 15:27:48.488766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 15:27:48.488766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 15:27:48.488766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 15:27:48.488766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 15:27:48.488766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 15:27:48.488766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 648/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Thu Jul 14 15:27:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:48.493292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc32b3-3dfc-452e-ac1f-c4c8c7193582 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:48.543824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:48.596446 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc32b3-3dfc-452e-ac1f-c4c8c7193582 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:48.628748 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863f84a0-b935-41b6-821d-efab72593ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:48.629395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f84a0-b935-41b6-821d-efab72593ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:48.629682 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f84a0-b935-41b6-821d-efab72593ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:48.629960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f84a0-b935-41b6-821d-efab72593ad9 None admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:48.630771 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f84a0-b935-41b6-821d-efab72593ad9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:48.631088 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f84a0-b935-41b6-821d-efab72593ad9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:48.632537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863f84a0-b935-41b6-821d-efab72593ad9 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:48.645090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 638/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Thu Jul 14 15:27:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:48.651245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e2add-dc9f-4212-9d41-69b92cd0a39b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:48.753238 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e2add-dc9f-4212-9d41-69b92cd0a39b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:48.786349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47756d7c-6052-4ecf-9cc8-629a3ef63461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:48.786990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47756d7c-6052-4ecf-9cc8-629a3ef63461 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:48.787273 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47756d7c-6052-4ecf-9cc8-629a3ef63461 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:48.787550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47756d7c-6052-4ecf-9cc8-629a3ef63461 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:48.788367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47756d7c-6052-4ecf-9cc8-629a3ef63461 None admin] RBAC: Adding query filter params (role.id=87f040877bfa47bda56305eb022af09e, scope.project.id=ba19b660ef1442289fb322231ce26f07, user.id=1d1dbca57a4c43ce9bc37c2303417d05) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:48.788681 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47756d7c-6052-4ecf-9cc8-629a3ef63461 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:48.790124 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47756d7c-6052-4ecf-9cc8-629a3ef63461 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:48.796314 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 649/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Thu Jul 14 15:27:48 2022] GET /identity/v3/role_assignments?user.id=1d1dbca57a4c43ce9bc37c2303417d05&scope.project.id=ba19b660ef1442289fb322231ce26f07&role.id=87f040877bfa47bda56305eb022af09e => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:51.054575 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5df130-4244-408e-a11d-607206aa225f None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:51.055124 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5df130-4244-408e-a11d-607206aa225f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:51.055124 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5df130-4244-408e-a11d-607206aa225f None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:51.056490 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 639/1288] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:27:51.061629 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2be2cd-9a66-464d-98b4-255c732f06b7 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:51.062121 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2be2cd-9a66-464d-98b4-255c732f06b7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:51.062241 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2be2cd-9a66-464d-98b4-255c732f06b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:51.079026 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-dc2be2cd-9a66-464d-98b4-255c732f06b7 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:51.080209 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dc2be2cd-9a66-464d-98b4-255c732f06b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:51.109567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:51.145797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 650/1289] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:27:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:27:51.168869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5df130-4244-408e-a11d-607206aa225f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:51.268703 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5df130-4244-408e-a11d-607206aa225f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:51.279669 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:51.302739 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee9cb5-850d-420a-9401-c8d8b86c8f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:51.303525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee9cb5-850d-420a-9401-c8d8b86c8f2f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:51.303809 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee9cb5-850d-420a-9401-c8d8b86c8f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:51.304083 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee9cb5-850d-420a-9401-c8d8b86c8f2f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:51.304773 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee9cb5-850d-420a-9401-c8d8b86c8f2f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:51.306118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee9cb5-850d-420a-9401-c8d8b86c8f2f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:51.317907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-99ee9cb5-850d-420a-9401-c8d8b86c8f2f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:27:51.317907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:51.317907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:27:51.317907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:27:51.317907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:27:51.317907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:27:51.317907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:27:51.317907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:27:51.317907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:27:51.317907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:51.317907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:27:51.317907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:51.317907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:51.317907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:51.317907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:51.317907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:51.317907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:51.319211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:51.319211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:51.319211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:51.319211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:51.319211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:51.319211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:51.319211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:27:51.319211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:27:51.319211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:27:51.319211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:27:51.319211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:51.319211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:51.319211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:51.319211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:51.319211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:51.319211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:51.320471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:51.320471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:51.320471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:51.320471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:51.320471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:51.320471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:51.320471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:51.320471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:51.320471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:51.320471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:51.320471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:27:51.320471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:27:51.320471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:27:51.320471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:51.320471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 640/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jul 14 15:27:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:51.325917 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2be2cd-9a66-464d-98b4-255c732f06b7 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:51.423713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2be2cd-9a66-464d-98b4-255c732f06b7 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:51.461578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca818388-fad8-4cb5-b782-84cffd7fe072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:51.462272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca818388-fad8-4cb5-b782-84cffd7fe072 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:51.462557 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca818388-fad8-4cb5-b782-84cffd7fe072 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:51.462836 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca818388-fad8-4cb5-b782-84cffd7fe072 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:51.463540 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca818388-fad8-4cb5-b782-84cffd7fe072 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:51.463852 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca818388-fad8-4cb5-b782-84cffd7fe072 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:51.465607 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca818388-fad8-4cb5-b782-84cffd7fe072 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:51.470642 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 651/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Thu Jul 14 15:27:51 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:51.476383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee9cb5-850d-420a-9401-c8d8b86c8f2f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:51.573963 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee9cb5-850d-420a-9401-c8d8b86c8f2f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:51.606443 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7183cee-d9cc-4ebb-933a-8d6c92c54cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:51.607090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7183cee-d9cc-4ebb-933a-8d6c92c54cfe None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:51.607376 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7183cee-d9cc-4ebb-933a-8d6c92c54cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:51.607651 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7183cee-d9cc-4ebb-933a-8d6c92c54cfe None admin] PATH_INFO: `/v3/services` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:51.608343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7183cee-d9cc-4ebb-933a-8d6c92c54cfe None admin] RBAC: Adding query filter params (type=placement) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:51.608649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7183cee-d9cc-4ebb-933a-8d6c92c54cfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:51.610014 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7183cee-d9cc-4ebb-933a-8d6c92c54cfe None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:51.614455 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 641/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Thu Jul 14 15:27:51 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:53.657916 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b053fff-994c-4b5e-a5b5-060d28bcdb54 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:53.658546 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b053fff-994c-4b5e-a5b5-060d28bcdb54 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:53.658546 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b053fff-994c-4b5e-a5b5-060d28bcdb54 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:53.659886 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 652/1293] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:27:53.665077 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57a563-77b4-48dc-b485-23f7bd540780 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:53.665526 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57a563-77b4-48dc-b485-23f7bd540780 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:53.665629 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57a563-77b4-48dc-b485-23f7bd540780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:53.683986 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3b57a563-77b4-48dc-b485-23f7bd540780 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:53.685129 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3b57a563-77b4-48dc-b485-23f7bd540780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:53.716187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:53.754974 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 642/1294] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:27:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:27:53.778755 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b053fff-994c-4b5e-a5b5-060d28bcdb54 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:53.811170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:53.883978 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b053fff-994c-4b5e-a5b5-060d28bcdb54 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:53.941222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ec04c-1fc3-4482-9ba4-9afb348d1875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:53.942229 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ec04c-1fc3-4482-9ba4-9afb348d1875 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:53.942910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ec04c-1fc3-4482-9ba4-9afb348d1875 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:53.943387 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ec04c-1fc3-4482-9ba4-9afb348d1875 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:53.945066 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ec04c-1fc3-4482-9ba4-9afb348d1875 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:53.947473 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ec04c-1fc3-4482-9ba4-9afb348d1875 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:53.961895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 653/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Thu Jul 14 15:27:53 2022] POST /identity/v3/services => generated 246 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:27:56.030611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b774a8-0c1c-439e-a17a-c4210255981f None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:56.031227 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b774a8-0c1c-439e-a17a-c4210255981f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:56.031227 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b774a8-0c1c-439e-a17a-c4210255981f None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:56.032550 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 643/1296] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:27:56.037784 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53a4e9-82d9-4d38-813c-76c6c6855d68 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:56.038236 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53a4e9-82d9-4d38-813c-76c6c6855d68 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:56.038377 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53a4e9-82d9-4d38-813c-76c6c6855d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:56.055721 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7b53a4e9-82d9-4d38-813c-76c6c6855d68 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:56.056907 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7b53a4e9-82d9-4d38-813c-76c6c6855d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:56.129260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 654/1297] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:27:56 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:27:56.152817 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b774a8-0c1c-439e-a17a-c4210255981f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:56.252642 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b774a8-0c1c-439e-a17a-c4210255981f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:56.285556 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd72e9-b24a-43e3-bfad-eae92270c01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:56.286375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd72e9-b24a-43e3-bfad-eae92270c01f None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:56.286658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd72e9-b24a-43e3-bfad-eae92270c01f None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:56.286930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd72e9-b24a-43e3-bfad-eae92270c01f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:56.287570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd72e9-b24a-43e3-bfad-eae92270c01f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:56.288930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dd72e9-b24a-43e3-bfad-eae92270c01f None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:56.301461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-a3dd72e9-b24a-43e3-bfad-eae92270c01f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:27:56.301461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:56.301461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:27:56.301461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:27:56.301461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:27:56.301461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:27:56.301461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:27:56.301461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:27:56.301461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:27:56.301461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:56.301461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:27:56.301461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:56.301461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:56.301461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:56.301461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:56.301461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:56.301461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:56.302818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:56.302818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:56.302818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:56.302818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:56.302818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:56.302818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:56.302818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:27:56.302818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:27:56.302818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:27:56.302818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:27:56.302818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:56.302818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:56.302818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:56.302818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:56.302818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:56.302818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:56.303860 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:56.303860 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:56.303860 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:56.303860 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:56.303860 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:56.303860 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:56.303860 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:56.303860 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:56.303860 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:56.303860 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:56.303860 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:27:56.303860 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:27:56.303860 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:27:56.303860 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:56.303860 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 644/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jul 14 15:27:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:56.308826 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53a4e9-82d9-4d38-813c-76c6c6855d68 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:56.326955 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:56.407874 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53a4e9-82d9-4d38-813c-76c6c6855d68 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:56.443062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1eeb0-db28-4751-8cf6-8a56acfe94a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:56.443755 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1eeb0-db28-4751-8cf6-8a56acfe94a1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:56.444041 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1eeb0-db28-4751-8cf6-8a56acfe94a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:56.444322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1eeb0-db28-4751-8cf6-8a56acfe94a1 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:56.445027 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1eeb0-db28-4751-8cf6-8a56acfe94a1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:56.445338 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1eeb0-db28-4751-8cf6-8a56acfe94a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:56.446750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1eeb0-db28-4751-8cf6-8a56acfe94a1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:56.452324 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 655/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Thu Jul 14 15:27:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:56.458219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd72e9-b24a-43e3-bfad-eae92270c01f None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:56.490673 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:56.565971 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dd72e9-b24a-43e3-bfad-eae92270c01f None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:56.598529 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace97809-fccf-420b-bd4a-ad06381983a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:56.599171 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace97809-fccf-420b-bd4a-ad06381983a5 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:56.599452 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace97809-fccf-420b-bd4a-ad06381983a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:56.599724 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace97809-fccf-420b-bd4a-ad06381983a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:56.600500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace97809-fccf-420b-bd4a-ad06381983a5 None admin] RBAC: Adding query filter params (interface=public, service_id=d5ccd40d1d9e413e966f40bdae20ffda, region_id=RegionOne) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:56.600808 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace97809-fccf-420b-bd4a-ad06381983a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:56.602198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace97809-fccf-420b-bd4a-ad06381983a5 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:56.607273 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 645/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Thu Jul 14 15:27:56 2022] GET /identity/v3/endpoints?service_id=d5ccd40d1d9e413e966f40bdae20ffda&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:56.612942 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1eeb0-db28-4751-8cf6-8a56acfe94a1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:56.693442 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:56.712152 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1eeb0-db28-4751-8cf6-8a56acfe94a1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:56.747098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54d6be-8ea0-4ac9-b040-9d9ce25dcd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:56.747754 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54d6be-8ea0-4ac9-b040-9d9ce25dcd10 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:56.748043 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54d6be-8ea0-4ac9-b040-9d9ce25dcd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:56.748326 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54d6be-8ea0-4ac9-b040-9d9ce25dcd10 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:56.749002 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54d6be-8ea0-4ac9-b040-9d9ce25dcd10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:56.750405 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54d6be-8ea0-4ac9-b040-9d9ce25dcd10 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:56.757058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 656/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Thu Jul 14 15:27:56 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:27:58.861882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3260f2-b172-42a1-b6a6-4a431db9c0ec None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:58.862503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3260f2-b172-42a1-b6a6-4a431db9c0ec None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:58.862503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3260f2-b172-42a1-b6a6-4a431db9c0ec None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:58.863833 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 646/1302] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:27:58.868890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d17dc6-e83c-4e0e-8738-b4bd3340b96d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:58.869286 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d17dc6-e83c-4e0e-8738-b4bd3340b96d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:58.869465 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d17dc6-e83c-4e0e-8738-b4bd3340b96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:58.886618 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-43d17dc6-e83c-4e0e-8738-b4bd3340b96d None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:27:58.887811 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-43d17dc6-e83c-4e0e-8738-b4bd3340b96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:27:58.954223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 657/1303] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:27:58 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 15:27:58.977958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3260f2-b172-42a1-b6a6-4a431db9c0ec None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:59.072493 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:59.079706 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3260f2-b172-42a1-b6a6-4a431db9c0ec None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:59.112458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97f1cd-81df-49fb-87b9-0032bed99041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:59.113178 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97f1cd-81df-49fb-87b9-0032bed99041 None admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:59.113463 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97f1cd-81df-49fb-87b9-0032bed99041 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:59.113740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97f1cd-81df-49fb-87b9-0032bed99041 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:59.114440 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97f1cd-81df-49fb-87b9-0032bed99041 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:59.115811 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97f1cd-81df-49fb-87b9-0032bed99041 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:59.128102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-9d97f1cd-81df-49fb-87b9-0032bed99041 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:27:59.128102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:59.128102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 15:27:59.128102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 15:27:59.128102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 15:27:59.128102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 15:27:59.128102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 15:27:59.128102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:27:59.128102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:27:59.128102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:59.128102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 15:27:59.128102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:59.128102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 15:27:59.128102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 15:27:59.128102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 15:27:59.128102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 15:27:59.128102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 15:27:59.129324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 15:27:59.129324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 15:27:59.129324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 15:27:59.129324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 15:27:59.129324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 15:27:59.129324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 15:27:59.129324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 15:27:59.129324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 15:27:59.129324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 15:27:59.129324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 15:27:59.129324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 15:27:59.129324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 15:27:59.129324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 15:27:59.129324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 15:27:59.129324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 15:27:59.129324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 15:27:59.130611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 15:27:59.130611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 15:27:59.130611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 15:27:59.130611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 15:27:59.130611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 15:27:59.130611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 15:27:59.130611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 15:27:59.130611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 15:27:59.130611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 15:27:59.130611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 15:27:59.130611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 15:27:59.130611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 15:27:59.130611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 15:27:59.130611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 15:27:59.130611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 647/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Thu Jul 14 15:27:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 15:27:59.135441 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d17dc6-e83c-4e0e-8738-b4bd3340b96d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:59.210257 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:59.234585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d17dc6-e83c-4e0e-8738-b4bd3340b96d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:59.267318 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72b20d-1bed-42e6-ba34-596a74404c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:59.267976 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72b20d-1bed-42e6-ba34-596a74404c34 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:59.268263 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72b20d-1bed-42e6-ba34-596a74404c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:59.268542 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72b20d-1bed-42e6-ba34-596a74404c34 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:59.269240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72b20d-1bed-42e6-ba34-596a74404c34 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:27:59.269545 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72b20d-1bed-42e6-ba34-596a74404c34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:59.270941 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72b20d-1bed-42e6-ba34-596a74404c34 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:59.275974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 658/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Thu Jul 14 15:27:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:27:59.282707 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97f1cd-81df-49fb-87b9-0032bed99041 None admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:27:59.380035 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97f1cd-81df-49fb-87b9-0032bed99041 None admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:27:59.412304 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a4419-453b-450e-b074-d6e5528b0747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:27:59.412948 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a4419-453b-450e-b074-d6e5528b0747 None admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:27:59.413230 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a4419-453b-450e-b074-d6e5528b0747 None admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:27:59.413504 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a4419-453b-450e-b074-d6e5528b0747 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:27:59.414273 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a4419-453b-450e-b074-d6e5528b0747 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:27:59.415644 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a4419-453b-450e-b074-d6e5528b0747 None admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:27:59.435202 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 648/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Thu Jul 14 15:27:59 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:28:09.273162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=30 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:09.430693 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:06.017338 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a26020-c226-4155-86d4-5c9a67a5e917 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:06.017788 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a26020-c226-4155-86d4-5c9a67a5e917 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:06.017885 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a26020-c226-4155-86d4-5c9a67a5e917 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:06.019314 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 659/1307] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:29:06.029271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535475b0-4a2c-400f-be89-3bbf8cfe6e6e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:06.030657 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535475b0-4a2c-400f-be89-3bbf8cfe6e6e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:06.031471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535475b0-4a2c-400f-be89-3bbf8cfe6e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:06.159275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-535475b0-4a2c-400f-be89-3bbf8cfe6e6e None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:06.160868 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-535475b0-4a2c-400f-be89-3bbf8cfe6e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:06.292621 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 649/1308] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:06.349447 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed433e5-a14d-4b28-817d-71791bcfeb56 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:06.349734 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed433e5-a14d-4b28-817d-71791bcfeb56 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:06.350303 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed433e5-a14d-4b28-817d-71791bcfeb56 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:06.351804 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 660/1309] 10.222.0.39 () {54 vars in 964 bytes} [Thu Jul 14 15:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:29:06.362812 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a76a11-f23b-4661-8464-cb2b6e51cf4b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:06.363157 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a76a11-f23b-4661-8464-cb2b6e51cf4b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:06.363392 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a76a11-f23b-4661-8464-cb2b6e51cf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:06.457752 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-92a76a11-f23b-4661-8464-cb2b6e51cf4b None None] MFA Rules not processed for user `7b82de4816a244c0b62b5f9f894ccaf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:06.459323 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-92a76a11-f23b-4661-8464-cb2b6e51cf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:06.482364 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:06.543826 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 650/1310] 10.222.0.39 () {58 vars in 1061 bytes} [Thu Jul 14 15:29:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:06.553172 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed433e5-a14d-4b28-817d-71791bcfeb56 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:06.555012 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-eed433e5-a14d-4b28-817d-71791bcfeb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:06.684080 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed433e5-a14d-4b28-817d-71791bcfeb56 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:06.772156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10202ff-8e02-4355-8729-e5228653e13e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:06.772815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10202ff-8e02-4355-8729-e5228653e13e service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:06.773108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10202ff-8e02-4355-8729-e5228653e13e service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:06.773385 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10202ff-8e02-4355-8729-e5228653e13e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:06.775898 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a10202ff-8e02-4355-8729-e5228653e13e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:06.837535 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:06.905250 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10202ff-8e02-4355-8729-e5228653e13e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:06.906749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10202ff-8e02-4355-8729-e5228653e13e service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:06.929465 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 661/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:29:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:09.343178 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d50e82-9239-4b96-a210-aced590e3639 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:09.343697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d50e82-9239-4b96-a210-aced590e3639 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:09.343697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d50e82-9239-4b96-a210-aced590e3639 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:09.345007 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 651/1312] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:29:09.350306 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a8c6c-7f35-464c-b2dd-4d29f3b140c5 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:09.350727 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a8c6c-7f35-464c-b2dd-4d29f3b140c5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:09.350874 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a8c6c-7f35-464c-b2dd-4d29f3b140c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:09.436717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-cb6a8c6c-7f35-464c-b2dd-4d29f3b140c5 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:09.437936 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cb6a8c6c-7f35-464c-b2dd-4d29f3b140c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:09.538589 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 662/1313] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:09.578328 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d50e82-9239-4b96-a210-aced590e3639 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:09.580001 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e7d50e82-9239-4b96-a210-aced590e3639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:09.686716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d50e82-9239-4b96-a210-aced590e3639 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:09.758551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:09.762279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f51ab-d3a4-467a-b704-8418aefe01bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:09.763354 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f51ab-d3a4-467a-b704-8418aefe01bd service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:09.763695 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f51ab-d3a4-467a-b704-8418aefe01bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:09.763976 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f51ab-d3a4-467a-b704-8418aefe01bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:09.765662 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cf8f51ab-d3a4-467a-b704-8418aefe01bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:09.878655 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f51ab-d3a4-467a-b704-8418aefe01bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:09.880132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f51ab-d3a4-467a-b704-8418aefe01bd service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:09.900849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 652/1314] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:12.286970 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8c2a9-44d0-4065-85d1-ec6c9f045a79 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:12.287523 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8c2a9-44d0-4065-85d1-ec6c9f045a79 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:12.287523 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8c2a9-44d0-4065-85d1-ec6c9f045a79 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:12.288900 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 663/1315] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:29:12.294257 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98245fdf-9898-4032-a6be-31436c4b6662 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:12.294678 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98245fdf-9898-4032-a6be-31436c4b6662 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:12.294859 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98245fdf-9898-4032-a6be-31436c4b6662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:12.359170 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-98245fdf-9898-4032-a6be-31436c4b6662 None None] MFA Rules not processed for user `a2d7884a8ac747abb51f87cce5fefa29`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:12.360390 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-98245fdf-9898-4032-a6be-31436c4b6662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:12.412304 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:12.460380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 653/1316] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:29:12 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:12.514145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4150a1-8db0-436f-947e-8c8abd41087b None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:12.514443 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4150a1-8db0-436f-947e-8c8abd41087b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:12.514722 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4150a1-8db0-436f-947e-8c8abd41087b None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:12.516118 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 664/1317] 10.222.0.39 () {54 vars in 964 bytes} [Thu Jul 14 15:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:29:12.522605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818991f2-236b-4113-a98f-0fbe0e107cda None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:12.522900 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818991f2-236b-4113-a98f-0fbe0e107cda None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:12.523190 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818991f2-236b-4113-a98f-0fbe0e107cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:12.598419 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-818991f2-236b-4113-a98f-0fbe0e107cda None None] MFA Rules not processed for user `7b82de4816a244c0b62b5f9f894ccaf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:12.599548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-818991f2-236b-4113-a98f-0fbe0e107cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:12.672859 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 654/1318] 10.222.0.39 () {58 vars in 1061 bytes} [Thu Jul 14 15:29:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:29:12.682806 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4150a1-8db0-436f-947e-8c8abd41087b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:12.684398 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2e4150a1-8db0-436f-947e-8c8abd41087b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:12.694140 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:12.789641 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4150a1-8db0-436f-947e-8c8abd41087b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:12.864742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa15ce5-abb9-4df1-9759-33f339f94a67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:12.865312 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa15ce5-abb9-4df1-9759-33f339f94a67 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:12.865597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa15ce5-abb9-4df1-9759-33f339f94a67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:12.865876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa15ce5-abb9-4df1-9759-33f339f94a67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:12.867602 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2fa15ce5-abb9-4df1-9759-33f339f94a67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:12.934170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:12.981456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa15ce5-abb9-4df1-9759-33f339f94a67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:12.982947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa15ce5-abb9-4df1-9759-33f339f94a67 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:13.002042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 665/1319] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:29:12 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:16.041017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e103a0-94f9-403f-b71f-2c8af63e1193 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:16.041570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e103a0-94f9-403f-b71f-2c8af63e1193 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:16.041570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e103a0-94f9-403f-b71f-2c8af63e1193 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:16.043028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 655/1320] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:29:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:29:16.048673 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fc3ae-e861-4a78-a2df-82a07550f639 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:16.049066 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fc3ae-e861-4a78-a2df-82a07550f639 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:16.049221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fc3ae-e861-4a78-a2df-82a07550f639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:16.112726 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ca8fc3ae-e861-4a78-a2df-82a07550f639 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:16.113935 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ca8fc3ae-e861-4a78-a2df-82a07550f639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:16.209134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 666/1321] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:29:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:16.249569 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e103a0-94f9-403f-b71f-2c8af63e1193 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:16.251173 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b0e103a0-94f9-403f-b71f-2c8af63e1193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:16.301835 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:16.358478 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e103a0-94f9-403f-b71f-2c8af63e1193 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:16.435314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6d951-6aad-45a9-9053-6a07e45aa743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:16.435963 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6d951-6aad-45a9-9053-6a07e45aa743 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:16.436245 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6d951-6aad-45a9-9053-6a07e45aa743 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:16.438315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6d951-6aad-45a9-9053-6a07e45aa743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:16.438842 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-edf6d951-6aad-45a9-9053-6a07e45aa743 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:16.543716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:16.559232 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf6d951-6aad-45a9-9053-6a07e45aa743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:16.560611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf6d951-6aad-45a9-9053-6a07e45aa743 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:16.583424 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 656/1322] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:29:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:19.477203 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfeb9f-96cc-4c38-b8fa-a7ccadbbcd2e None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:19.477760 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfeb9f-96cc-4c38-b8fa-a7ccadbbcd2e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:19.477930 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfeb9f-96cc-4c38-b8fa-a7ccadbbcd2e None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:19.479362 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 667/1323] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:29:19.484848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba232e-6e9b-4d40-bde9-e242c08e3a11 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:19.485287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba232e-6e9b-4d40-bde9-e242c08e3a11 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:19.485408 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba232e-6e9b-4d40-bde9-e242c08e3a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:19.553208 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8bba232e-6e9b-4d40-bde9-e242c08e3a11 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:19.554471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8bba232e-6e9b-4d40-bde9-e242c08e3a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:19.659724 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 657/1324] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:19.697671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfeb9f-96cc-4c38-b8fa-a7ccadbbcd2e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:19.699383 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-65cfeb9f-96cc-4c38-b8fa-a7ccadbbcd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:19.722467 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:19.815065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfeb9f-96cc-4c38-b8fa-a7ccadbbcd2e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:19.891071 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d57210-4121-4695-948f-bbd0d5d571e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:19.891719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d57210-4121-4695-948f-bbd0d5d571e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:19.891995 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d57210-4121-4695-948f-bbd0d5d571e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:19.892264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d57210-4121-4695-948f-bbd0d5d571e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:19.893904 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-35d57210-4121-4695-948f-bbd0d5d571e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:19.967731 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:20.008004 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d57210-4121-4695-948f-bbd0d5d571e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:20.010131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d57210-4121-4695-948f-bbd0d5d571e2 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:20.029443 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 668/1325] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:29:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:22.176889 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09192e50-8593-401c-81b3-d812c4776fba None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:22.177427 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09192e50-8593-401c-81b3-d812c4776fba None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:22.177427 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09192e50-8593-401c-81b3-d812c4776fba None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:22.178756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 658/1326] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:29:22.184962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc2ec9-d925-45f1-92e2-bcec64382f73 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:22.185435 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc2ec9-d925-45f1-92e2-bcec64382f73 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:22.185534 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc2ec9-d925-45f1-92e2-bcec64382f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:22.251137 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d3dc2ec9-d925-45f1-92e2-bcec64382f73 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:22.252421 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d3dc2ec9-d925-45f1-92e2-bcec64382f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:22.350641 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 669/1327] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:22.389095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09192e50-8593-401c-81b3-d812c4776fba None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:22.390744 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-09192e50-8593-401c-81b3-d812c4776fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:22.453727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:22.498666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09192e50-8593-401c-81b3-d812c4776fba None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:22.573796 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b540b68-7b1d-41f8-9b35-c222ea217067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:22.574489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b540b68-7b1d-41f8-9b35-c222ea217067 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:22.574775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b540b68-7b1d-41f8-9b35-c222ea217067 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:22.575054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b540b68-7b1d-41f8-9b35-c222ea217067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:22.576754 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2b540b68-7b1d-41f8-9b35-c222ea217067 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:22.689982 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:22.692331 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b540b68-7b1d-41f8-9b35-c222ea217067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:22.694089 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b540b68-7b1d-41f8-9b35-c222ea217067 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:22.712703 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 659/1328] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:29:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:24.881431 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e2ffd-66b2-4e38-b63f-ac3b38347a7f None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:24.881981 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e2ffd-66b2-4e38-b63f-ac3b38347a7f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:24.881981 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e2ffd-66b2-4e38-b63f-ac3b38347a7f None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:24.883426 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 670/1329] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:29:24.892799 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b9d36-ef2b-478f-8406-1773d4c453ac None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:24.893274 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b9d36-ef2b-478f-8406-1773d4c453ac None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:24.893399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b9d36-ef2b-478f-8406-1773d4c453ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:24.960187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-086b9d36-ef2b-478f-8406-1773d4c453ac None None] MFA Rules not processed for user `a2d7884a8ac747abb51f87cce5fefa29`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:24.961466 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-086b9d36-ef2b-478f-8406-1773d4c453ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:25.075489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 660/1330] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:29:24 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:25.116398 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e2ffd-66b2-4e38-b63f-ac3b38347a7f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:25.118340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-240e2ffd-66b2-4e38-b63f-ac3b38347a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:25.149516 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:25.227802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e2ffd-66b2-4e38-b63f-ac3b38347a7f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:25.305667 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90454b8-c1fa-454d-ba03-9eab5b02b543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:25.306461 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90454b8-c1fa-454d-ba03-9eab5b02b543 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:25.306740 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90454b8-c1fa-454d-ba03-9eab5b02b543 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:25.307022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90454b8-c1fa-454d-ba03-9eab5b02b543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:25.308721 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c90454b8-c1fa-454d-ba03-9eab5b02b543 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:25.387430 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:25.421158 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90454b8-c1fa-454d-ba03-9eab5b02b543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:25.422660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90454b8-c1fa-454d-ba03-9eab5b02b543 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:25.443068 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 671/1331] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:29:25 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:27.809688 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae274c7-082c-4024-9159-b9a37eb220bf None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:27.810338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae274c7-082c-4024-9159-b9a37eb220bf None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:27.810338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae274c7-082c-4024-9159-b9a37eb220bf None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:27.811690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 661/1332] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:29:27.816938 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3d0c1-e0c9-4c7d-a030-166757336e5f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:27.817346 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3d0c1-e0c9-4c7d-a030-166757336e5f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:27.817494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3d0c1-e0c9-4c7d-a030-166757336e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:27.881391 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a2c3d0c1-e0c9-4c7d-a030-166757336e5f None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:27.882618 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a2c3d0c1-e0c9-4c7d-a030-166757336e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:27.979489 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 672/1333] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:28.016529 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae274c7-082c-4024-9159-b9a37eb220bf None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:28.018144 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0ae274c7-082c-4024-9159-b9a37eb220bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:28.087711 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:28.122620 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae274c7-082c-4024-9159-b9a37eb220bf None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:28.195046 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98281e69-3bd8-4069-a2ca-99be90cfc93b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:28.195756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98281e69-3bd8-4069-a2ca-99be90cfc93b service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:28.196064 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98281e69-3bd8-4069-a2ca-99be90cfc93b service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:28.196333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98281e69-3bd8-4069-a2ca-99be90cfc93b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:28.197990 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-98281e69-3bd8-4069-a2ca-99be90cfc93b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:28.306645 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98281e69-3bd8-4069-a2ca-99be90cfc93b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:28.308413 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98281e69-3bd8-4069-a2ca-99be90cfc93b service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:28.318473 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:28.327245 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 662/1334] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:29:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:30.505740 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b7206-b975-4a0c-9887-a4f690b235fd None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:30.506325 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b7206-b975-4a0c-9887-a4f690b235fd None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:30.506325 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b7206-b975-4a0c-9887-a4f690b235fd None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:30.507722 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 673/1335] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:29:30.514008 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e1474-bf3f-44bc-ba19-a4b381f1a477 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:30.514500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e1474-bf3f-44bc-ba19-a4b381f1a477 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:30.514610 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e1474-bf3f-44bc-ba19-a4b381f1a477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:30.580371 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ed9e1474-bf3f-44bc-ba19-a4b381f1a477 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:30.581597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ed9e1474-bf3f-44bc-ba19-a4b381f1a477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:30.677716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 663/1336] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:30.718422 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b7206-b975-4a0c-9887-a4f690b235fd None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:30.719964 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-697b7206-b975-4a0c-9887-a4f690b235fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:30.761648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:30.842948 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b7206-b975-4a0c-9887-a4f690b235fd None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:30.917382 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b011ce-68cc-4b95-a619-dfc26b6f480a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:30.918026 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b011ce-68cc-4b95-a619-dfc26b6f480a service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:30.918340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b011ce-68cc-4b95-a619-dfc26b6f480a service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:30.918617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b011ce-68cc-4b95-a619-dfc26b6f480a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:30.920268 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-18b011ce-68cc-4b95-a619-dfc26b6f480a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:31.008036 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:31.034652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b011ce-68cc-4b95-a619-dfc26b6f480a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:31.036108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b011ce-68cc-4b95-a619-dfc26b6f480a service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:31.054746 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 674/1337] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:29:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:33.625843 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f37ef-7217-4cba-9d9c-974e15971391 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:33.626654 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f37ef-7217-4cba-9d9c-974e15971391 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:33.626654 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f37ef-7217-4cba-9d9c-974e15971391 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:33.627811 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 664/1338] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:29:33.633293 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b7bd1-f9ff-44a0-8f81-6d14c77cffb8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:33.633720 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b7bd1-f9ff-44a0-8f81-6d14c77cffb8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:33.634497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b7bd1-f9ff-44a0-8f81-6d14c77cffb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:33.699721 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-fd5b7bd1-f9ff-44a0-8f81-6d14c77cffb8 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:33.700857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-fd5b7bd1-f9ff-44a0-8f81-6d14c77cffb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:33.796398 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 675/1339] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:29:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:33.833980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f37ef-7217-4cba-9d9c-974e15971391 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:33.835561 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6f1f37ef-7217-4cba-9d9c-974e15971391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:33.918993 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:33.947278 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f37ef-7217-4cba-9d9c-974e15971391 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:34.017957 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad5ab6-25ff-4334-a001-696c2e4cc20c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:34.018644 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad5ab6-25ff-4334-a001-696c2e4cc20c service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:34.018899 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad5ab6-25ff-4334-a001-696c2e4cc20c service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:34.019167 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad5ab6-25ff-4334-a001-696c2e4cc20c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:34.020796 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-68ad5ab6-25ff-4334-a001-696c2e4cc20c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:34.129946 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad5ab6-25ff-4334-a001-696c2e4cc20c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:34.131461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad5ab6-25ff-4334-a001-696c2e4cc20c service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:34.149904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 665/1340] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:29:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:38.269871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f6766-e5ab-441e-a6dc-56016238a288 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:38.270466 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f6766-e5ab-441e-a6dc-56016238a288 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:38.270466 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f6766-e5ab-441e-a6dc-56016238a288 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:38.271849 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 676/1341] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:29:38.278395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69ad4a-3ecc-4df0-9f5a-ec67b5f2f294 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:38.278879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69ad4a-3ecc-4df0-9f5a-ec67b5f2f294 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:38.278970 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69ad4a-3ecc-4df0-9f5a-ec67b5f2f294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:38.283175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:38.346039 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ed69ad4a-3ecc-4df0-9f5a-ec67b5f2f294 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:38.347283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ed69ad4a-3ecc-4df0-9f5a-ec67b5f2f294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:38.443509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 666/1342] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:38.483917 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f6766-e5ab-441e-a6dc-56016238a288 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:38.485550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5a5f6766-e5ab-441e-a6dc-56016238a288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:38.536386 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:38.593863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f6766-e5ab-441e-a6dc-56016238a288 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:38.671637 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7270c71-b249-4d77-affa-cf54ba9771ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:38.672282 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7270c71-b249-4d77-affa-cf54ba9771ab service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:38.672562 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7270c71-b249-4d77-affa-cf54ba9771ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:38.672837 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7270c71-b249-4d77-affa-cf54ba9771ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:38.674506 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d7270c71-b249-4d77-affa-cf54ba9771ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:38.771149 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:38.788365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7270c71-b249-4d77-affa-cf54ba9771ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:38.790302 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7270c71-b249-4d77-affa-cf54ba9771ab service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:38.811128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 677/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:29:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:41.572119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f394760-27cc-495e-948f-e2e7a2ae286e None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:41.572732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f394760-27cc-495e-948f-e2e7a2ae286e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:41.572732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f394760-27cc-495e-948f-e2e7a2ae286e None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:41.574276 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 667/1344] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:29:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:29:41.580011 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e38c6-d9da-4a36-8e55-ca2dd59d7575 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:41.580541 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e38c6-d9da-4a36-8e55-ca2dd59d7575 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:41.580634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e38c6-d9da-4a36-8e55-ca2dd59d7575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:41.653708 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7e2e38c6-d9da-4a36-8e55-ca2dd59d7575 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:41.654970 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7e2e38c6-d9da-4a36-8e55-ca2dd59d7575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:41.759080 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 678/1345] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:29:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:41.796745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f394760-27cc-495e-948f-e2e7a2ae286e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:41.798350 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8f394760-27cc-495e-948f-e2e7a2ae286e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:41.887335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:41.906285 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f394760-27cc-495e-948f-e2e7a2ae286e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:41.987285 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4591363-b3c0-4d27-b756-32dc12e981e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:41.987937 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4591363-b3c0-4d27-b756-32dc12e981e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:41.988228 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4591363-b3c0-4d27-b756-32dc12e981e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:41.988501 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4591363-b3c0-4d27-b756-32dc12e981e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:41.990205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b4591363-b3c0-4d27-b756-32dc12e981e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:42.104122 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4591363-b3c0-4d27-b756-32dc12e981e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:42.105483 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4591363-b3c0-4d27-b756-32dc12e981e5 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:42.125394 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 668/1346] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:29:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:46.507259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a760c-10c5-4949-bbcc-276e33955f8b None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:46.508452 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a760c-10c5-4949-bbcc-276e33955f8b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:46.508563 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a760c-10c5-4949-bbcc-276e33955f8b None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:46.509891 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 679/1347] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:29:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:29:46.515561 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf3df4-280e-40ce-a34e-2a40417bd9ba None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:46.515990 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf3df4-280e-40ce-a34e-2a40417bd9ba None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:46.516120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf3df4-280e-40ce-a34e-2a40417bd9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:46.542641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:46.613099 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9fcf3df4-280e-40ce-a34e-2a40417bd9ba None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:46.614376 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9fcf3df4-280e-40ce-a34e-2a40417bd9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:46.726060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 669/1348] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:46.765072 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a760c-10c5-4949-bbcc-276e33955f8b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:29:46.766709 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e33a760c-10c5-4949-bbcc-276e33955f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:46.829602 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:46.889315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a760c-10c5-4949-bbcc-276e33955f8b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:29:46.994411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c7fe5-aff1-42dc-9a99-5ec083f4ed52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:29:46.995147 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c7fe5-aff1-42dc-9a99-5ec083f4ed52 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:46.995529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c7fe5-aff1-42dc-9a99-5ec083f4ed52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:46.995914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c7fe5-aff1-42dc-9a99-5ec083f4ed52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:46.997894 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d71c7fe5-aff1-42dc-9a99-5ec083f4ed52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:47.122596 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c7fe5-aff1-42dc-9a99-5ec083f4ed52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:29:47.123412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:47.124866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c7fe5-aff1-42dc-9a99-5ec083f4ed52 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:29:47.149933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 680/1349] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:29:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:52.482798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066435e-e547-4588-b015-db4eb05f5714 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:52.483288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066435e-e547-4588-b015-db4eb05f5714 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:52.483380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066435e-e547-4588-b015-db4eb05f5714 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:52.486035 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 670/1350] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jul 14 15:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:29:52.493743 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34da80-9a94-4bb4-abfe-b80c899da5cf None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:52.493743 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34da80-9a94-4bb4-abfe-b80c899da5cf None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:52.493743 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34da80-9a94-4bb4-abfe-b80c899da5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:52.620683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-0f34da80-9a94-4bb4-abfe-b80c899da5cf None None] MFA Rules not processed for user `1d1dbca57a4c43ce9bc37c2303417d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:52.622218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0f34da80-9a94-4bb4-abfe-b80c899da5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:52.775878 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 681/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jul 14 15:29:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:56.724152 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=59 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:57.223294 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bd3ba-f667-4988-adaf-47332536554b None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:57.223897 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bd3ba-f667-4988-adaf-47332536554b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:57.224236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bd3ba-f667-4988-adaf-47332536554b None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:57.226585 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 671/1352] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jul 14 15:29:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:29:57.232074 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093210e-3cd7-4adb-9a45-af2f0bf287e3 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:57.232556 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093210e-3cd7-4adb-9a45-af2f0bf287e3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:57.232650 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093210e-3cd7-4adb-9a45-af2f0bf287e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:57.291318 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:57.321702 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2093210e-3cd7-4adb-9a45-af2f0bf287e3 None None] MFA Rules not processed for user `1d1dbca57a4c43ce9bc37c2303417d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:57.323067 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2093210e-3cd7-4adb-9a45-af2f0bf287e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:57.447220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 682/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jul 14 15:29:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:29:58.864985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd721c-8db6-4582-9080-e6bd628b903d None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:58.865605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd721c-8db6-4582-9080-e6bd628b903d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:58.865605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd721c-8db6-4582-9080-e6bd628b903d None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:58.867308 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 672/1354] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jul 14 15:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:29:58.872482 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dd5e0-7576-4866-9d34-2405de6eab18 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:29:58.872917 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dd5e0-7576-4866-9d34-2405de6eab18 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:29:58.873024 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dd5e0-7576-4866-9d34-2405de6eab18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:29:58.954726 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b78dd5e0-7576-4866-9d34-2405de6eab18 None None] MFA Rules not processed for user `1d1dbca57a4c43ce9bc37c2303417d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:29:58.956082 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b78dd5e0-7576-4866-9d34-2405de6eab18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:29:58.999429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:59.071079 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 683/1355] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jul 14 15:29:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:30:02.734590 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55137f96-6eae-46f5-892e-1bea81217727 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:02.735103 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55137f96-6eae-46f5-892e-1bea81217727 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:02.735103 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55137f96-6eae-46f5-892e-1bea81217727 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:02.736430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 673/1356] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:30:02.741950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf1e6d-52a1-4f6e-815b-a95b953fc511 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:02.742513 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf1e6d-52a1-4f6e-815b-a95b953fc511 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:02.742758 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf1e6d-52a1-4f6e-815b-a95b953fc511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:02.834060 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2dbf1e6d-52a1-4f6e-815b-a95b953fc511 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:02.836109 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2dbf1e6d-52a1-4f6e-815b-a95b953fc511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:02.998626 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 684/1357] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:03.065759 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da827f84-9f7d-41ef-8e79-cd0f4826e419 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:03.066317 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da827f84-9f7d-41ef-8e79-cd0f4826e419 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:03.066786 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da827f84-9f7d-41ef-8e79-cd0f4826e419 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:03.068402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 674/1358] 10.222.0.39 () {54 vars in 961 bytes} [Thu Jul 14 15:30:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:30:03.081248 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85df3f-086a-4c2b-93ba-4c013a1be8cc None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:03.081933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85df3f-086a-4c2b-93ba-4c013a1be8cc None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:03.082524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85df3f-086a-4c2b-93ba-4c013a1be8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:03.109925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:03.181765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-9a85df3f-086a-4c2b-93ba-4c013a1be8cc None None] MFA Rules not processed for user `64f6b597a47c4a0eb08d1eabc4c0305c`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:03.183122 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9a85df3f-086a-4c2b-93ba-4c013a1be8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:03.310691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 685/1359] 10.222.0.39 () {58 vars in 1058 bytes} [Thu Jul 14 15:30:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:30:03.318833 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da827f84-9f7d-41ef-8e79-cd0f4826e419 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:03.320782 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-da827f84-9f7d-41ef-8e79-cd0f4826e419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:03.489920 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da827f84-9f7d-41ef-8e79-cd0f4826e419 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:03.568863 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:03.612622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0e204-b730-40d2-984c-36ba50f75a1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:03.613279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0e204-b730-40d2-984c-36ba50f75a1b service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:03.613570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0e204-b730-40d2-984c-36ba50f75a1b service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:03.613853 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0e204-b730-40d2-984c-36ba50f75a1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:03.615527 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-17c0e204-b730-40d2-984c-36ba50f75a1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:03.711845 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0e204-b730-40d2-984c-36ba50f75a1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:03.713461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0e204-b730-40d2-984c-36ba50f75a1b service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:03.732685 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 675/1360] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:30:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:06.022320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b9912-1047-4377-8cf5-378d9ebd0365 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:06.022922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b9912-1047-4377-8cf5-378d9ebd0365 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:06.022922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b9912-1047-4377-8cf5-378d9ebd0365 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:06.024922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 686/1361] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:30:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:30:06.030442 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45286867-ab51-4f7e-86a8-1cfd5ba70206 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:06.030916 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45286867-ab51-4f7e-86a8-1cfd5ba70206 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:06.031019 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45286867-ab51-4f7e-86a8-1cfd5ba70206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:06.100480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-45286867-ab51-4f7e-86a8-1cfd5ba70206 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:06.102269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-45286867-ab51-4f7e-86a8-1cfd5ba70206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:06.141270 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:06.208704 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 676/1362] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:30:06.256593 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b9912-1047-4377-8cf5-378d9ebd0365 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:06.258297 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ff0b9912-1047-4377-8cf5-378d9ebd0365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:06.328505 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:06.422909 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b9912-1047-4377-8cf5-378d9ebd0365 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:06.567189 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5eb89f-8431-44d1-8baf-1afeb26d92f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:06.567849 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5eb89f-8431-44d1-8baf-1afeb26d92f8 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:06.568166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5eb89f-8431-44d1-8baf-1afeb26d92f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:06.568410 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5eb89f-8431-44d1-8baf-1afeb26d92f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:06.570454 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8d5eb89f-8431-44d1-8baf-1afeb26d92f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:06.609330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:06.700603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5eb89f-8431-44d1-8baf-1afeb26d92f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:06.702328 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5eb89f-8431-44d1-8baf-1afeb26d92f8 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:06.733211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 687/1363] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:30:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:09.595724 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e411896-06b8-4459-9bc7-acaa2b38d5c6 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:09.596233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e411896-06b8-4459-9bc7-acaa2b38d5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:09.596233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e411896-06b8-4459-9bc7-acaa2b38d5c6 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:09.597560 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 677/1364] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:30:09.605008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8fb10-dd6f-4805-9b3d-0bdf5966d947 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:09.605008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8fb10-dd6f-4805-9b3d-0bdf5966d947 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:09.605622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8fb10-dd6f-4805-9b3d-0bdf5966d947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:09.686104 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-27a8fb10-dd6f-4805-9b3d-0bdf5966d947 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:09.687515 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-27a8fb10-dd6f-4805-9b3d-0bdf5966d947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:09.808452 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:09.821364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 688/1365] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:09.863461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492517d4-339c-43ad-be65-e4b564bdcfbf None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:09.863797 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492517d4-339c-43ad-be65-e4b564bdcfbf None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:09.864068 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492517d4-339c-43ad-be65-e4b564bdcfbf None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:09.865540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 678/1366] 10.222.0.39 () {54 vars in 961 bytes} [Thu Jul 14 15:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:30:09.872026 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca9feb-4f64-490b-bfb8-228e77570eb8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:09.872621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca9feb-4f64-490b-bfb8-228e77570eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:09.873062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca9feb-4f64-490b-bfb8-228e77570eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:09.976248 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-14ca9feb-4f64-490b-bfb8-228e77570eb8 None None] MFA Rules not processed for user `64f6b597a47c4a0eb08d1eabc4c0305c`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:09.977482 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-14ca9feb-4f64-490b-bfb8-228e77570eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:10.150285 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 689/1367] 10.222.0.39 () {58 vars in 1058 bytes} [Thu Jul 14 15:30:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:10.159176 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492517d4-339c-43ad-be65-e4b564bdcfbf None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:10.160714 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-492517d4-339c-43ad-be65-e4b564bdcfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:10.338519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492517d4-339c-43ad-be65-e4b564bdcfbf None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:10.362455 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:10.478180 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543c683-c639-449d-ba35-d20e210abf7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:10.478830 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543c683-c639-449d-ba35-d20e210abf7a service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:10.479113 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543c683-c639-449d-ba35-d20e210abf7a service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:10.479388 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543c683-c639-449d-ba35-d20e210abf7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:10.481060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7543c683-c639-449d-ba35-d20e210abf7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:10.581591 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543c683-c639-449d-ba35-d20e210abf7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:10.583366 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543c683-c639-449d-ba35-d20e210abf7a service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:10.604253 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 679/1368] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:30:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:11.759732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3ba38-cef4-4f4e-bacb-050f255b2635 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:11.760294 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3ba38-cef4-4f4e-bacb-050f255b2635 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:11.760294 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3ba38-cef4-4f4e-bacb-050f255b2635 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:11.767373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520ce36-2a01-4d22-a156-7a3874ba859c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:11.767842 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520ce36-2a01-4d22-a156-7a3874ba859c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:11.767925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520ce36-2a01-4d22-a156-7a3874ba859c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:11.782020 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 690/1369] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:30:11 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:30:11.806509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:11.846719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8520ce36-2a01-4d22-a156-7a3874ba859c None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:11.848338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8520ce36-2a01-4d22-a156-7a3874ba859c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:11.978470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 680/1370] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:12.307505 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d756432-e946-4c38-8c77-15684509d9a9 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:12.307865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d756432-e946-4c38-8c77-15684509d9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:12.308085 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d756432-e946-4c38-8c77-15684509d9a9 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:12.309767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 691/1371] 10.222.0.39 () {54 vars in 963 bytes} [Thu Jul 14 15:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:30:12.315215 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00343b53-0bef-4720-b1cd-a330e6f3af4c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:12.315799 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00343b53-0bef-4720-b1cd-a330e6f3af4c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:12.316315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00343b53-0bef-4720-b1cd-a330e6f3af4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:12.400862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-00343b53-0bef-4720-b1cd-a330e6f3af4c None None] MFA Rules not processed for user `78d5b8b2802a44eead863280df22b027`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:12.402514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-00343b53-0bef-4720-b1cd-a330e6f3af4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:12.509658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 681/1372] 10.222.0.39 () {58 vars in 1060 bytes} [Thu Jul 14 15:30:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:12.514522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:12.521298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d756432-e946-4c38-8c77-15684509d9a9 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:12.522207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3d756432-e946-4c38-8c77-15684509d9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:12.589285 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:12.669189 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d756432-e946-4c38-8c77-15684509d9a9 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:12.765226 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479cec5d-9701-432d-b754-b0fb6598a0d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:12.766058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cec5d-9701-432d-b754-b0fb6598a0d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:12.766462 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cec5d-9701-432d-b754-b0fb6598a0d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:12.766843 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cec5d-9701-432d-b754-b0fb6598a0d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:12.768780 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-479cec5d-9701-432d-b754-b0fb6598a0d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:12.895565 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea9c33-a8c7-47b2-bb2a-b37412475856 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:12.896083 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea9c33-a8c7-47b2-bb2a-b37412475856 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:12.896188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea9c33-a8c7-47b2-bb2a-b37412475856 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:12.902116 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 682/1373] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:30:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:30:12.903703 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ab96d-fbd0-4612-b184-203143d24ed8 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:12.904173 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ab96d-fbd0-4612-b184-203143d24ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:12.904515 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ab96d-fbd0-4612-b184-203143d24ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:12.925268 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:12.974138 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479cec5d-9701-432d-b754-b0fb6598a0d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:12.978783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479cec5d-9701-432d-b754-b0fb6598a0d3 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:13.016349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b24ab96d-fbd0-4612-b184-203143d24ed8 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:13.018101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b24ab96d-fbd0-4612-b184-203143d24ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:13.030229 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 692/1374] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:30:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:13.317667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 683/1375] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:30:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:13.364414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479cec5d-9701-432d-b754-b0fb6598a0d3 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:13.365650 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-479cec5d-9701-432d-b754-b0fb6598a0d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:13.477013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479cec5d-9701-432d-b754-b0fb6598a0d3 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:13.594113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:13.608531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4ef00-4c63-475b-a4cd-4777f6079483 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:13.609278 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4ef00-4c63-475b-a4cd-4777f6079483 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:13.609564 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4ef00-4c63-475b-a4cd-4777f6079483 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:13.609840 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4ef00-4c63-475b-a4cd-4777f6079483 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:13.611545 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-10c4ef00-4c63-475b-a4cd-4777f6079483 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:13.722240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4ef00-4c63-475b-a4cd-4777f6079483 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:13.723867 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4ef00-4c63-475b-a4cd-4777f6079483 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:13.745408 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 693/1376] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:30:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:15.935541 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f152-f701-4424-bc70-636d6f9350d5 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:15.936079 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f152-f701-4424-bc70-636d6f9350d5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:15.936239 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f152-f701-4424-bc70-636d6f9350d5 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:15.938335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 684/1377] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:30:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:30:15.945451 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ff089-6ea3-48f9-93be-a8632edabdfb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:15.945890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ff089-6ea3-48f9-93be-a8632edabdfb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:15.946701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ff089-6ea3-48f9-93be-a8632edabdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:16.027377 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a72ff089-6ea3-48f9-93be-a8632edabdfb None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:16.028611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a72ff089-6ea3-48f9-93be-a8632edabdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:16.115793 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:16.188082 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 694/1378] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:16.234224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20f152-f701-4424-bc70-636d6f9350d5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:16.235750 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7e20f152-f701-4424-bc70-636d6f9350d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:16.297447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:16.446874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20f152-f701-4424-bc70-636d6f9350d5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:16.588980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef0a19-0079-4360-9e1b-f100fba55967 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:16.589630 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef0a19-0079-4360-9e1b-f100fba55967 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:16.589920 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef0a19-0079-4360-9e1b-f100fba55967 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:16.590235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef0a19-0079-4360-9e1b-f100fba55967 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:16.591898 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5aef0a19-0079-4360-9e1b-f100fba55967 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:16.605315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:16.690826 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef0a19-0079-4360-9e1b-f100fba55967 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:16.692472 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef0a19-0079-4360-9e1b-f100fba55967 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:16.712014 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 685/1379] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:30:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:18.922047 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f756b8-fc49-4b40-9a84-fd6d1bc57e50 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:18.922611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f756b8-fc49-4b40-9a84-fd6d1bc57e50 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:18.922611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f756b8-fc49-4b40-9a84-fd6d1bc57e50 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:18.924170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 695/1380] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:30:18.930021 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1def5e4-d32b-475d-961e-fe2811e08f30 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:18.930530 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1def5e4-d32b-475d-961e-fe2811e08f30 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:18.930530 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1def5e4-d32b-475d-961e-fe2811e08f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:19.002566 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f1def5e4-d32b-475d-961e-fe2811e08f30 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:19.003761 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f1def5e4-d32b-475d-961e-fe2811e08f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:19.102845 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:19.120647 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 686/1381] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:19.167407 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f756b8-fc49-4b40-9a84-fd6d1bc57e50 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:19.169223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-75f756b8-fc49-4b40-9a84-fd6d1bc57e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:19.341060 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f756b8-fc49-4b40-9a84-fd6d1bc57e50 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:19.397384 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:19.495382 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761b55d-c457-4bef-be87-9a003c550701 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:19.496128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761b55d-c457-4bef-be87-9a003c550701 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:19.496401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761b55d-c457-4bef-be87-9a003c550701 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:19.496619 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761b55d-c457-4bef-be87-9a003c550701 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:19.498391 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2761b55d-c457-4bef-be87-9a003c550701 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:19.597908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761b55d-c457-4bef-be87-9a003c550701 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:19.599473 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761b55d-c457-4bef-be87-9a003c550701 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:19.622084 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 696/1382] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:30:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:21.953915 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90a838-f25c-4e37-8ea9-c0530c94335b None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:21.954707 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90a838-f25c-4e37-8ea9-c0530c94335b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:21.955236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90a838-f25c-4e37-8ea9-c0530c94335b None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:21.957107 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 687/1383] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:30:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:30:21.965484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349bf86-84cb-4ebc-9085-cee8a7fca8ea None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:21.966359 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349bf86-84cb-4ebc-9085-cee8a7fca8ea None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:21.966759 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349bf86-84cb-4ebc-9085-cee8a7fca8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:22.046057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6349bf86-84cb-4ebc-9085-cee8a7fca8ea None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:22.047383 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6349bf86-84cb-4ebc-9085-cee8a7fca8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:22.049820 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:22.151607 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 697/1384] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:22.196517 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90a838-f25c-4e37-8ea9-c0530c94335b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:22.198546 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7e90a838-f25c-4e37-8ea9-c0530c94335b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:22.362602 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90a838-f25c-4e37-8ea9-c0530c94335b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:22.438620 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:22.495181 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f26013-e8ab-4870-b3d2-535f806b1b29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:22.496059 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26013-e8ab-4870-b3d2-535f806b1b29 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:22.496415 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26013-e8ab-4870-b3d2-535f806b1b29 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:22.496762 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26013-e8ab-4870-b3d2-535f806b1b29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:22.498988 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-15f26013-e8ab-4870-b3d2-535f806b1b29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:22.601523 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f26013-e8ab-4870-b3d2-535f806b1b29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:22.603587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f26013-e8ab-4870-b3d2-535f806b1b29 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:22.627821 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 688/1385] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:30:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:24.751343 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef1a3e-a435-498d-95a8-eaa30ebe700b None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:24.751343 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef1a3e-a435-498d-95a8-eaa30ebe700b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:24.751343 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef1a3e-a435-498d-95a8-eaa30ebe700b None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:24.751343 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 698/1386] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:30:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:30:24.757742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a93a2e-118f-493c-806f-0b2c29cb729a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:24.757742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a93a2e-118f-493c-806f-0b2c29cb729a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:24.757742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a93a2e-118f-493c-806f-0b2c29cb729a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:24.827037 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f5a93a2e-118f-493c-806f-0b2c29cb729a None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:24.828636 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f5a93a2e-118f-493c-806f-0b2c29cb729a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:24.862152 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:24.939955 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 689/1387] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:30:25.005165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef1a3e-a435-498d-95a8-eaa30ebe700b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:25.007719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7bef1a3e-a435-498d-95a8-eaa30ebe700b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:25.210363 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:25.232220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef1a3e-a435-498d-95a8-eaa30ebe700b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:25.356894 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf1aea-f840-4be4-a066-92676d94a07b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:25.357422 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf1aea-f840-4be4-a066-92676d94a07b service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:25.357699 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf1aea-f840-4be4-a066-92676d94a07b service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:25.357998 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf1aea-f840-4be4-a066-92676d94a07b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:25.359682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3ebf1aea-f840-4be4-a066-92676d94a07b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:25.482257 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf1aea-f840-4be4-a066-92676d94a07b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:25.483889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf1aea-f840-4be4-a066-92676d94a07b service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:25.489001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:25.504885 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 699/1388] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:30:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:27.750248 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92e245-d9b1-4cc8-97a4-3df6ea1775de None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:27.750833 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92e245-d9b1-4cc8-97a4-3df6ea1775de None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:27.750833 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92e245-d9b1-4cc8-97a4-3df6ea1775de None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:27.752194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 690/1389] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:30:27.757900 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3477da-85c6-4765-a9fb-70452bc8b956 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:27.758755 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3477da-85c6-4765-a9fb-70452bc8b956 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:27.758755 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3477da-85c6-4765-a9fb-70452bc8b956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:27.831689 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7a3477da-85c6-4765-a9fb-70452bc8b956 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:27.833013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7a3477da-85c6-4765-a9fb-70452bc8b956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:27.969737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 700/1390] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:30:28.013225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92e245-d9b1-4cc8-97a4-3df6ea1775de None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:28.015389 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2d92e245-d9b1-4cc8-97a4-3df6ea1775de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:28.183280 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92e245-d9b1-4cc8-97a4-3df6ea1775de None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:28.202732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:28.338048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ec64f-216b-4ee3-a9e4-7af98b7b2533 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:28.338755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ec64f-216b-4ee3-a9e4-7af98b7b2533 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:28.339048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ec64f-216b-4ee3-a9e4-7af98b7b2533 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:28.339328 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ec64f-216b-4ee3-a9e4-7af98b7b2533 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:28.341158 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ee1ec64f-216b-4ee3-a9e4-7af98b7b2533 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:28.446689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ec64f-216b-4ee3-a9e4-7af98b7b2533 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:28.448317 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ec64f-216b-4ee3-a9e4-7af98b7b2533 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:28.474499 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 691/1391] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:28.884988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3476f-3822-40f7-a110-7dfcbdb759e2 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:28.885675 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3476f-3822-40f7-a110-7dfcbdb759e2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:28.886089 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3476f-3822-40f7-a110-7dfcbdb759e2 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:28.888253 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 701/1392] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:30:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:30:28.893864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7513879-3306-4961-b556-2f0553d18377 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:28.894559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7513879-3306-4961-b556-2f0553d18377 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:28.894559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7513879-3306-4961-b556-2f0553d18377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:28.911216 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:28.969902 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e7513879-3306-4961-b556-2f0553d18377 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:28.971449 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e7513879-3306-4961-b556-2f0553d18377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:29.079518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 692/1393] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:29.137923 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c672bb0-3359-46cd-a145-5e3662a79872 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:29.138239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c672bb0-3359-46cd-a145-5e3662a79872 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:29.138528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c672bb0-3359-46cd-a145-5e3662a79872 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:29.139955 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 702/1394] 10.222.0.39 () {54 vars in 962 bytes} [Thu Jul 14 15:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:30:29.145387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5754bdb-5502-4621-a3ce-14d075c9b480 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:29.145680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5754bdb-5502-4621-a3ce-14d075c9b480 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:29.145960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5754bdb-5502-4621-a3ce-14d075c9b480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:29.238537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b5754bdb-5502-4621-a3ce-14d075c9b480 None None] MFA Rules not processed for user `14c582c1127142f8a4ebf64bb7b34516`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:29.239791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b5754bdb-5502-4621-a3ce-14d075c9b480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:29.281461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:29.329001 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 693/1395] 10.222.0.39 () {58 vars in 1059 bytes} [Thu Jul 14 15:30:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:29.337138 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c672bb0-3359-46cd-a145-5e3662a79872 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:29.339059 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4c672bb0-3359-46cd-a145-5e3662a79872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:29.423602 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:29.459381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c672bb0-3359-46cd-a145-5e3662a79872 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:29.544410 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcce3b9-0cfc-40ec-b61e-2d77b0bc8c8a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14c582c1127142f8a4ebf64bb7b34516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:29.545335 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcce3b9-0cfc-40ec-b61e-2d77b0bc8c8a service glance] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:29.545648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcce3b9-0cfc-40ec-b61e-2d77b0bc8c8a service glance] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:29.545897 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcce3b9-0cfc-40ec-b61e-2d77b0bc8c8a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:29.547594 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-fbcce3b9-0cfc-40ec-b61e-2d77b0bc8c8a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:29.678316 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcce3b9-0cfc-40ec-b61e-2d77b0bc8c8a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:29.681064 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcce3b9-0cfc-40ec-b61e-2d77b0bc8c8a service glance] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:29.699090 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:29.703134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 703/1396] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:30:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:30.519377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8c0c3-b35e-4fae-b0dc-2b766e2b7da8 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:30.519885 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8c0c3-b35e-4fae-b0dc-2b766e2b7da8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:30.520033 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8c0c3-b35e-4fae-b0dc-2b766e2b7da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:30.596892 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-6ac8c0c3-b35e-4fae-b0dc-2b766e2b7da8 None None] MFA Rules not processed for user `8103402ac83c4b4191a3ec4d55038e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:30.598179 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6ac8c0c3-b35e-4fae-b0dc-2b766e2b7da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:30.612973 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1697820-0a42-426a-b2af-04bb97910a69 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:30.613531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1697820-0a42-426a-b2af-04bb97910a69 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:30.613531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1697820-0a42-426a-b2af-04bb97910a69 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:30.614950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 704/1397] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:30:30.620953 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db31253-a709-4cd2-95f8-67c15427998a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:30.621180 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db31253-a709-4cd2-95f8-67c15427998a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:30.621471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db31253-a709-4cd2-95f8-67c15427998a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:30.695841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4db31253-a709-4cd2-95f8-67c15427998a None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:30.697300 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4db31253-a709-4cd2-95f8-67c15427998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:30.702508 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 694/1398] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jul 14 15:30:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:30.752237 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9df0e-b816-4f79-b4d7-e24ac013f55b None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:30.752618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9df0e-b816-4f79-b4d7-e24ac013f55b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:30.752821 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9df0e-b816-4f79-b4d7-e24ac013f55b None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:30.754576 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 695/1399] 10.222.0.39 () {54 vars in 942 bytes} [Thu Jul 14 15:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:30:30.762099 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410de2f-1b18-4f46-9330-d83e9cc67ca9 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:30.762394 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410de2f-1b18-4f46-9330-d83e9cc67ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:30.762678 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410de2f-1b18-4f46-9330-d83e9cc67ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:30.827975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:30.828697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 705/1400] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:30:30.849109 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-1410de2f-1b18-4f46-9330-d83e9cc67ca9 None None] MFA Rules not processed for user `edbbc94ca71c42c0aac562c8c2ec83db`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:30.850905 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1410de2f-1b18-4f46-9330-d83e9cc67ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:30.876444 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db31253-a709-4cd2-95f8-67c15427998a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:30.878023 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4db31253-a709-4cd2-95f8-67c15427998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:30.979416 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:30.994242 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 696/1401] 10.222.0.39 () {58 vars in 1039 bytes} [Thu Jul 14 15:30:30 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:30:31.001614 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410de2f-1b18-4f46-9330-d83e9cc67ca9 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:31.012648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410de2f-1b18-4f46-9330-d83e9cc67ca9 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:31.028963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db31253-a709-4cd2-95f8-67c15427998a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:31.132447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:31.139613 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6263f0-44e3-477f-ba85-37315c43a498 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edbbc94ca71c42c0aac562c8c2ec83db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:31.140271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6263f0-44e3-477f-ba85-37315c43a498 service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:31.140847 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6263f0-44e3-477f-ba85-37315c43a498 service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:31.141134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6263f0-44e3-477f-ba85-37315c43a498 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:31.142879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ea6263f0-44e3-477f-ba85-37315c43a498 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:31.166263 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827d909-be28-47a2-83eb-682174496ee8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:31.167147 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827d909-be28-47a2-83eb-682174496ee8 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:31.167581 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827d909-be28-47a2-83eb-682174496ee8 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:31.167860 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827d909-be28-47a2-83eb-682174496ee8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:31.169706 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a827d909-be28-47a2-83eb-682174496ee8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:31.241766 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6263f0-44e3-477f-ba85-37315c43a498 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:31.243791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6263f0-44e3-477f-ba85-37315c43a498 service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:31.254374 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 697/1402] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jul 14 15:30:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 14 15:30:31.277555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:31.297505 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827d909-be28-47a2-83eb-682174496ee8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:31.299520 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827d909-be28-47a2-83eb-682174496ee8 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:31.324716 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 706/1403] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:30:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:30:33.528272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb01901-b90c-4097-bfb8-4399640cb3d4 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:33.528863 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb01901-b90c-4097-bfb8-4399640cb3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:33.528863 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb01901-b90c-4097-bfb8-4399640cb3d4 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:33.530272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 698/1404] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:30:33.535874 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3340160-2130-4871-b733-fb0dafdc6b87 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:33.536328 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3340160-2130-4871-b733-fb0dafdc6b87 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:33.536533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3340160-2130-4871-b733-fb0dafdc6b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:33.627246 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f3340160-2130-4871-b733-fb0dafdc6b87 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:33.628853 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f3340160-2130-4871-b733-fb0dafdc6b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:33.761033 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 707/1405] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:33.814776 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb01901-b90c-4097-bfb8-4399640cb3d4 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:33.816595 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4cb01901-b90c-4097-bfb8-4399640cb3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:34.019774 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:34.032311 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb01901-b90c-4097-bfb8-4399640cb3d4 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:34.181171 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3c6ee-1311-4d08-8684-c86a8b775acd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:34.181825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3c6ee-1311-4d08-8684-c86a8b775acd service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:34.182203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3c6ee-1311-4d08-8684-c86a8b775acd service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:34.182413 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3c6ee-1311-4d08-8684-c86a8b775acd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:34.184231 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a7b3c6ee-1311-4d08-8684-c86a8b775acd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:34.298150 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3c6ee-1311-4d08-8684-c86a8b775acd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:34.299999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3c6ee-1311-4d08-8684-c86a8b775acd service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:34.320823 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:34.334528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 699/1406] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:30:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:36.536488 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880325b-88cf-46f9-8e1c-6823a9e0c119 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:36.537208 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880325b-88cf-46f9-8e1c-6823a9e0c119 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:36.537299 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880325b-88cf-46f9-8e1c-6823a9e0c119 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:36.539167 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 708/1407] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:30:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:30:36.545481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3959f2-e066-4d74-8998-8b3003203e87 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:36.545945 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3959f2-e066-4d74-8998-8b3003203e87 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:36.546055 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3959f2-e066-4d74-8998-8b3003203e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:36.638702 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ff3959f2-e066-4d74-8998-8b3003203e87 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:36.639927 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ff3959f2-e066-4d74-8998-8b3003203e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:36.773888 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 700/1408] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:36.821824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880325b-88cf-46f9-8e1c-6823a9e0c119 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:36.823435 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0880325b-88cf-46f9-8e1c-6823a9e0c119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:36.917835 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:37.059648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880325b-88cf-46f9-8e1c-6823a9e0c119 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:37.227323 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1ceb7-dd3a-415b-bd95-005ba7a24d4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:37.228060 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1ceb7-dd3a-415b-bd95-005ba7a24d4c service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:37.228332 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1ceb7-dd3a-415b-bd95-005ba7a24d4c service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:37.228621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1ceb7-dd3a-415b-bd95-005ba7a24d4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:37.230369 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-94f1ceb7-dd3a-415b-bd95-005ba7a24d4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:37.250259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:37.405444 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1ceb7-dd3a-415b-bd95-005ba7a24d4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:37.407383 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1ceb7-dd3a-415b-bd95-005ba7a24d4c service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:37.437565 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 709/1409] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:30:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:46.768505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=67 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:47.434262 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=39 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:55.031193 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f415fc-c966-4716-bdf2-a3352f7c30ee None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:55.031759 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f415fc-c966-4716-bdf2-a3352f7c30ee None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:55.031759 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f415fc-c966-4716-bdf2-a3352f7c30ee None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:55.033110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 701/1410] 10.222.0.39 () {54 vars in 918 bytes} [Thu Jul 14 15:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:30:55.039423 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e6a50-c908-4e43-bf41-c30bfe440c54 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:55.039855 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e6a50-c908-4e43-bf41-c30bfe440c54 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:55.039958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e6a50-c908-4e43-bf41-c30bfe440c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:55.239263 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5d3e6a50-c908-4e43-bf41-c30bfe440c54 None None] MFA Rules not processed for user `1d1dbca57a4c43ce9bc37c2303417d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:55.240534 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5d3e6a50-c908-4e43-bf41-c30bfe440c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:55.348582 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 710/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Thu Jul 14 15:30:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:55.363739 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386970a7-50e0-40a9-bb31-6f00248e7e21 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:55.364032 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386970a7-50e0-40a9-bb31-6f00248e7e21 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:55.364314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386970a7-50e0-40a9-bb31-6f00248e7e21 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:55.365829 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 702/1412] 10.222.0.39 () {54 vars in 918 bytes} [Thu Jul 14 15:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:30:55.371105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacfe90-825a-4c13-84c1-2aff4046a6f2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:55.371399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacfe90-825a-4c13-84c1-2aff4046a6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:55.371683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacfe90-825a-4c13-84c1-2aff4046a6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:55.447068 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:55.450014 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2bacfe90-825a-4c13-84c1-2aff4046a6f2 None None] MFA Rules not processed for user `64f6b597a47c4a0eb08d1eabc4c0305c`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:55.451846 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2bacfe90-825a-4c13-84c1-2aff4046a6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:55.571064 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 711/1413] 10.222.0.39 () {58 vars in 1015 bytes} [Thu Jul 14 15:30:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:58.143817 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426999c5-0c40-44d2-ab31-7959791c4a34 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:58.144418 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426999c5-0c40-44d2-ab31-7959791c4a34 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:58.144418 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426999c5-0c40-44d2-ab31-7959791c4a34 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:58.145794 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:30:58.151614 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278a8b5-4104-44ee-ae6d-ddedcc4308cb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:58.152075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278a8b5-4104-44ee-ae6d-ddedcc4308cb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:58.152195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278a8b5-4104-44ee-ae6d-ddedcc4308cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:58.218504 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3278a8b5-4104-44ee-ae6d-ddedcc4308cb None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:58.219724 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3278a8b5-4104-44ee-ae6d-ddedcc4308cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:58.275285 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:58.320155 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:30:58.363634 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426999c5-0c40-44d2-ab31-7959791c4a34 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:30:58.365333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-426999c5-0c40-44d2-ab31-7959791c4a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:58.515855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426999c5-0c40-44d2-ab31-7959791c4a34 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:30:58.587863 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:58.630345 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495069d-7614-48cb-9f71-fe82a1bf937d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:30:58.630997 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495069d-7614-48cb-9f71-fe82a1bf937d service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:58.631367 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495069d-7614-48cb-9f71-fe82a1bf937d service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:58.631631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495069d-7614-48cb-9f71-fe82a1bf937d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:58.633321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2495069d-7614-48cb-9f71-fe82a1bf937d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:58.722969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495069d-7614-48cb-9f71-fe82a1bf937d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:30:58.724519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495069d-7614-48cb-9f71-fe82a1bf937d service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:30:58.744293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 704/1416] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:30:59.667261 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c994d0-f9dc-4d89-b013-1f3c4f8d64a7 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:59.667813 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c994d0-f9dc-4d89-b013-1f3c4f8d64a7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:59.667813 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c994d0-f9dc-4d89-b013-1f3c4f8d64a7 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:59.669208 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:30:59.674465 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a6375-7144-4548-aa78-5f753cc5f17e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:30:59.674908 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a6375-7144-4548-aa78-5f753cc5f17e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:30:59.675041 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a6375-7144-4548-aa78-5f753cc5f17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:30:59.752495 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-659a6375-7144-4548-aa78-5f753cc5f17e None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:30:59.753720 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-659a6375-7144-4548-aa78-5f753cc5f17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:30:59.781142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:59.855830 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:00.007637 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c994d0-f9dc-4d89-b013-1f3c4f8d64a7 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:00.009283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-07c994d0-f9dc-4d89-b013-1f3c4f8d64a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:00.158483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c994d0-f9dc-4d89-b013-1f3c4f8d64a7 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:00.198831 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:00.273524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5cb73d-c874-42d9-91ad-fe25e7eac9e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:00.274106 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cb73d-c874-42d9-91ad-fe25e7eac9e8 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:00.274394 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cb73d-c874-42d9-91ad-fe25e7eac9e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:00.274667 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cb73d-c874-42d9-91ad-fe25e7eac9e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:00.276343 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-bb5cb73d-c874-42d9-91ad-fe25e7eac9e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:00.364265 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5cb73d-c874-42d9-91ad-fe25e7eac9e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:00.366420 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5cb73d-c874-42d9-91ad-fe25e7eac9e8 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:00.384760 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 714/1419] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:01.301169 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cf0d2-82d3-4f32-8c54-f2c43dc373f4 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:01.301743 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cf0d2-82d3-4f32-8c54-f2c43dc373f4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:01.301743 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cf0d2-82d3-4f32-8c54-f2c43dc373f4 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:01.303859 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:31:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:31:01.308885 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2e353-8bc4-40e5-8ccb-e633c1443b9e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:01.309386 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2e353-8bc4-40e5-8ccb-e633c1443b9e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:01.309491 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2e353-8bc4-40e5-8ccb-e633c1443b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:01.363253 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:01.386740 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e7f2e353-8bc4-40e5-8ccb-e633c1443b9e None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:01.388021 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e7f2e353-8bc4-40e5-8ccb-e633c1443b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:01.499090 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:01.648475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cf0d2-82d3-4f32-8c54-f2c43dc373f4 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:01.650000 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d99cf0d2-82d3-4f32-8c54-f2c43dc373f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:01.797042 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cf0d2-82d3-4f32-8c54-f2c43dc373f4 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:01.809429 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:01.914581 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e19b9-61e3-4df6-bc5d-ebab80b87aff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:01.915113 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e19b9-61e3-4df6-bc5d-ebab80b87aff service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:01.915395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e19b9-61e3-4df6-bc5d-ebab80b87aff service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:01.915670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e19b9-61e3-4df6-bc5d-ebab80b87aff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:01.917344 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-fd4e19b9-61e3-4df6-bc5d-ebab80b87aff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:02.005849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e19b9-61e3-4df6-bc5d-ebab80b87aff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:02.007597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e19b9-61e3-4df6-bc5d-ebab80b87aff service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:02.026398 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 707/1422] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:02.903023 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bebaa-637d-4049-a090-3cdb664c6218 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:02.903611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bebaa-637d-4049-a090-3cdb664c6218 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:02.903611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bebaa-637d-4049-a090-3cdb664c6218 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:02.905005 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:31:02.910007 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22b722-4f72-4477-a14f-241fcfefd80f None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:02.910474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22b722-4f72-4477-a14f-241fcfefd80f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:02.910728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22b722-4f72-4477-a14f-241fcfefd80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:02.930551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:02.988874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2b22b722-4f72-4477-a14f-241fcfefd80f None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:02.990207 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2b22b722-4f72-4477-a14f-241fcfefd80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:03.093173 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:03.245750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bebaa-637d-4049-a090-3cdb664c6218 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:03.247350 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2e2bebaa-637d-4049-a090-3cdb664c6218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:03.359849 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:03.395623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bebaa-637d-4049-a090-3cdb664c6218 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:03.512763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab29e3f-d6d2-4c93-beb5-b61b9843f0eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:03.513332 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab29e3f-d6d2-4c93-beb5-b61b9843f0eb service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:03.513615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab29e3f-d6d2-4c93-beb5-b61b9843f0eb service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:03.513894 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab29e3f-d6d2-4c93-beb5-b61b9843f0eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:03.515587 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-fab29e3f-d6d2-4c93-beb5-b61b9843f0eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:03.592576 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:03.607373 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab29e3f-d6d2-4c93-beb5-b61b9843f0eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:03.609073 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab29e3f-d6d2-4c93-beb5-b61b9843f0eb service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:03.627110 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 717/1425] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:04.532673 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624e343-0293-4b00-bc48-ac5d7c582878 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:04.533292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624e343-0293-4b00-bc48-ac5d7c582878 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:04.533292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624e343-0293-4b00-bc48-ac5d7c582878 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:04.534666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:31:04.539881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44c04a-a950-4e5d-b6ee-29865ae6c6e6 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:04.540336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44c04a-a950-4e5d-b6ee-29865ae6c6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:04.540445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44c04a-a950-4e5d-b6ee-29865ae6c6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:04.619251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-dc44c04a-a950-4e5d-b6ee-29865ae6c6e6 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:04.620475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dc44c04a-a950-4e5d-b6ee-29865ae6c6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:04.717531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:04.873750 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624e343-0293-4b00-bc48-ac5d7c582878 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:04.875366 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9624e343-0293-4b00-bc48-ac5d7c582878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:04.961813 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:05.023552 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624e343-0293-4b00-bc48-ac5d7c582878 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:05.136788 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7db80f-738f-4615-bbba-30f6a3662ea4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:05.137354 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7db80f-738f-4615-bbba-30f6a3662ea4 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:05.137634 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7db80f-738f-4615-bbba-30f6a3662ea4 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:05.137904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7db80f-738f-4615-bbba-30f6a3662ea4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:05.139574 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-be7db80f-738f-4615-bbba-30f6a3662ea4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:05.188750 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:05.229594 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7db80f-738f-4615-bbba-30f6a3662ea4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:05.231237 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7db80f-738f-4615-bbba-30f6a3662ea4 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:05.249509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 710/1428] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:06.103179 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ac8e3-ff40-4175-8a5c-810a6068835f None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:06.103778 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ac8e3-ff40-4175-8a5c-810a6068835f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:06.103778 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ac8e3-ff40-4175-8a5c-810a6068835f None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:06.105149 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:31:06.109972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbc582-54f2-4321-8b39-9e5b9df66f5e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:06.110408 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbc582-54f2-4321-8b39-9e5b9df66f5e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:06.110564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbc582-54f2-4321-8b39-9e5b9df66f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:06.190200 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d8fbc582-54f2-4321-8b39-9e5b9df66f5e None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:06.191435 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d8fbc582-54f2-4321-8b39-9e5b9df66f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:06.287760 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:06.439835 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ac8e3-ff40-4175-8a5c-810a6068835f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:06.441361 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7d5ac8e3-ff40-4175-8a5c-810a6068835f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:06.491617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:06.589344 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ac8e3-ff40-4175-8a5c-810a6068835f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:06.704057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f182f2-5f3d-4471-89cd-2eeb236d1717 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:06.704624 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f182f2-5f3d-4471-89cd-2eeb236d1717 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:06.704913 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f182f2-5f3d-4471-89cd-2eeb236d1717 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:06.705194 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f182f2-5f3d-4471-89cd-2eeb236d1717 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:06.706912 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a9f182f2-5f3d-4471-89cd-2eeb236d1717 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:06.714036 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:06.798895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f182f2-5f3d-4471-89cd-2eeb236d1717 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:06.800509 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f182f2-5f3d-4471-89cd-2eeb236d1717 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:06.819777 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 720/1431] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:07.642645 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87f20d-ad08-4dc7-a4e8-c8d446472645 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:07.643203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87f20d-ad08-4dc7-a4e8-c8d446472645 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:07.643304 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87f20d-ad08-4dc7-a4e8-c8d446472645 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:07.644640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:31:07.650322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f730c-5102-4e75-a3cb-5a0736b4fe52 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:07.650774 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f730c-5102-4e75-a3cb-5a0736b4fe52 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:07.650885 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f730c-5102-4e75-a3cb-5a0736b4fe52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:07.727268 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-501f730c-5102-4e75-a3cb-5a0736b4fe52 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:07.728413 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-501f730c-5102-4e75-a3cb-5a0736b4fe52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:07.801080 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:07.831950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:07.985958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87f20d-ad08-4dc7-a4e8-c8d446472645 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:07.987452 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6d87f20d-ad08-4dc7-a4e8-c8d446472645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:08.005589 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:08.141387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87f20d-ad08-4dc7-a4e8-c8d446472645 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:08.229867 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:08.256735 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f2d0f-8c3a-4c81-a993-7d4f600ab892 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:08.257383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f2d0f-8c3a-4c81-a993-7d4f600ab892 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:08.257672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f2d0f-8c3a-4c81-a993-7d4f600ab892 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:08.257952 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f2d0f-8c3a-4c81-a993-7d4f600ab892 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:08.259670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-345f2d0f-8c3a-4c81-a993-7d4f600ab892 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:08.351295 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f2d0f-8c3a-4c81-a993-7d4f600ab892 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:08.352938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f2d0f-8c3a-4c81-a993-7d4f600ab892 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:08.371347 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 713/1434] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:09.190478 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68793c63-59a3-4468-8e1c-104bbdca96b3 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:09.191049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68793c63-59a3-4468-8e1c-104bbdca96b3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:09.191049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68793c63-59a3-4468-8e1c-104bbdca96b3 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:09.192449 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:31:09.198050 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303ea20-cdaf-4467-9429-61787bcb6733 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:09.198493 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303ea20-cdaf-4467-9429-61787bcb6733 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:09.198656 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303ea20-cdaf-4467-9429-61787bcb6733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:09.273663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d303ea20-cdaf-4467-9429-61787bcb6733 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:09.274961 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d303ea20-cdaf-4467-9429-61787bcb6733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:09.316642 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:09.372183 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:09.529171 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68793c63-59a3-4468-8e1c-104bbdca96b3 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:09.530711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-68793c63-59a3-4468-8e1c-104bbdca96b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:09.679706 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68793c63-59a3-4468-8e1c-104bbdca96b3 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:09.733969 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:09.794937 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbbe39-8d29-430c-8005-c5f3e6d2b2b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:09.795840 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbbe39-8d29-430c-8005-c5f3e6d2b2b8 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:09.796123 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbbe39-8d29-430c-8005-c5f3e6d2b2b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:09.796402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbbe39-8d29-430c-8005-c5f3e6d2b2b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:09.798042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-31cbbe39-8d29-430c-8005-c5f3e6d2b2b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:09.890807 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbbe39-8d29-430c-8005-c5f3e6d2b2b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:09.892423 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbbe39-8d29-430c-8005-c5f3e6d2b2b8 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:09.911198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 723/1437] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:10.737631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cb756-9e9c-4838-a4e4-a3e56f9adbe7 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:10.738186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cb756-9e9c-4838-a4e4-a3e56f9adbe7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:10.738186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cb756-9e9c-4838-a4e4-a3e56f9adbe7 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:10.739510 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:31:10.744974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b88eca-8e6a-4ce6-b007-4fa112a7224b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:10.745522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b88eca-8e6a-4ce6-b007-4fa112a7224b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:10.745522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b88eca-8e6a-4ce6-b007-4fa112a7224b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:10.822583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f5b88eca-8e6a-4ce6-b007-4fa112a7224b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:10.823805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f5b88eca-8e6a-4ce6-b007-4fa112a7224b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:10.825843 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:10.925324 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:11.078430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cb756-9e9c-4838-a4e4-a3e56f9adbe7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:11.079966 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9e6cb756-9e9c-4838-a4e4-a3e56f9adbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:11.226529 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cb756-9e9c-4838-a4e4-a3e56f9adbe7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:11.253351 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:11.340303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce5b98-6739-40ff-97a9-c9893dd5cca1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:11.340857 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce5b98-6739-40ff-97a9-c9893dd5cca1 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:11.341143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce5b98-6739-40ff-97a9-c9893dd5cca1 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:11.341419 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce5b98-6739-40ff-97a9-c9893dd5cca1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:11.343105 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-68ce5b98-6739-40ff-97a9-c9893dd5cca1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:11.434462 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce5b98-6739-40ff-97a9-c9893dd5cca1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:11.436101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce5b98-6739-40ff-97a9-c9893dd5cca1 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:11.454044 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 716/1440] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:13.482872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b4500-9ed9-4464-aa4e-e54acf457d27 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:13.483458 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b4500-9ed9-4464-aa4e-e54acf457d27 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:13.483458 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b4500-9ed9-4464-aa4e-e54acf457d27 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:13.484857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:31:13.490003 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479d0a7-a8ce-46a1-a24d-fb1cb08fb9c5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:13.490524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479d0a7-a8ce-46a1-a24d-fb1cb08fb9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:13.490778 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479d0a7-a8ce-46a1-a24d-fb1cb08fb9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:13.530280 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:13.556419 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-6479d0a7-a8ce-46a1-a24d-fb1cb08fb9c5 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:13.557630 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6479d0a7-a8ce-46a1-a24d-fb1cb08fb9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:13.655569 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:13.694942 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b4500-9ed9-4464-aa4e-e54acf457d27 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:13.696519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cd8b4500-9ed9-4464-aa4e-e54acf457d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:13.799475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b4500-9ed9-4464-aa4e-e54acf457d27 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:13.839659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:13.882683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d421117-b93f-4bc4-9190-014c69cfd2e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:13.883338 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d421117-b93f-4bc4-9190-014c69cfd2e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:13.883623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d421117-b93f-4bc4-9190-014c69cfd2e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:13.883903 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d421117-b93f-4bc4-9190-014c69cfd2e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:13.885554 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7d421117-b93f-4bc4-9190-014c69cfd2e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:13.997085 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d421117-b93f-4bc4-9190-014c69cfd2e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:13.998567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d421117-b93f-4bc4-9190-014c69cfd2e8 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:14.019997 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 726/1443] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:16.244894 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a122c24-60f1-44d6-8760-4665898b70f7 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:16.245470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a122c24-60f1-44d6-8760-4665898b70f7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:16.245470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a122c24-60f1-44d6-8760-4665898b70f7 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:16.246874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:31:16.252275 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd010523-9334-4bf5-bf42-9ea037ab57f4 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:16.252737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd010523-9334-4bf5-bf42-9ea037ab57f4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:16.252838 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd010523-9334-4bf5-bf42-9ea037ab57f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:16.320905 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-cd010523-9334-4bf5-bf42-9ea037ab57f4 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:16.322164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cd010523-9334-4bf5-bf42-9ea037ab57f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:16.336042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:16.424590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:16.464646 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a122c24-60f1-44d6-8760-4665898b70f7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:16.466291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4a122c24-60f1-44d6-8760-4665898b70f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:16.573248 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a122c24-60f1-44d6-8760-4665898b70f7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:16.586038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:16.648119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6dfe67-b061-43dc-b630-e34ad8fd6c88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:16.648761 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dfe67-b061-43dc-b630-e34ad8fd6c88 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:16.649047 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dfe67-b061-43dc-b630-e34ad8fd6c88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:16.649353 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dfe67-b061-43dc-b630-e34ad8fd6c88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:16.651051 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0e6dfe67-b061-43dc-b630-e34ad8fd6c88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:16.759615 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6dfe67-b061-43dc-b630-e34ad8fd6c88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:16.761069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6dfe67-b061-43dc-b630-e34ad8fd6c88 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:16.779769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 719/1446] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:19.175881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620684b7-d698-436d-8422-cf6543e5d785 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:19.176435 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620684b7-d698-436d-8422-cf6543e5d785 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:19.176559 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620684b7-d698-436d-8422-cf6543e5d785 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:19.178615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:31:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:31:19.183965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d43343-637c-4eb1-8386-6a69275ca12d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:19.184382 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d43343-637c-4eb1-8386-6a69275ca12d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:19.184524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d43343-637c-4eb1-8386-6a69275ca12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:19.232100 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:19.250321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-02d43343-637c-4eb1-8386-6a69275ca12d None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:19.251544 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-02d43343-637c-4eb1-8386-6a69275ca12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:19.356565 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:19.397139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620684b7-d698-436d-8422-cf6543e5d785 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:19.398904 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-620684b7-d698-436d-8422-cf6543e5d785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:19.511710 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620684b7-d698-436d-8422-cf6543e5d785 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:19.556248 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:19.591401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182aaf0-b5f7-46f8-ac79-18831ef11ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:19.592054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182aaf0-b5f7-46f8-ac79-18831ef11ffc service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:19.592336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182aaf0-b5f7-46f8-ac79-18831ef11ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:19.592612 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182aaf0-b5f7-46f8-ac79-18831ef11ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:19.594321 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b182aaf0-b5f7-46f8-ac79-18831ef11ffc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:19.737915 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182aaf0-b5f7-46f8-ac79-18831ef11ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:19.739348 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182aaf0-b5f7-46f8-ac79-18831ef11ffc service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:19.762224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 729/1449] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:21.963169 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2c591-ae2d-47aa-a157-cabbeb3aece0 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:21.963763 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2c591-ae2d-47aa-a157-cabbeb3aece0 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:21.963763 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2c591-ae2d-47aa-a157-cabbeb3aece0 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:21.965158 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:31:21.970785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca262ce-9338-44b4-87f4-6f54c9b6ae4c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:21.971244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca262ce-9338-44b4-87f4-6f54c9b6ae4c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:21.971356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca262ce-9338-44b4-87f4-6f54c9b6ae4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:22.036912 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-cca262ce-9338-44b4-87f4-6f54c9b6ae4c None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:22.038327 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cca262ce-9338-44b4-87f4-6f54c9b6ae4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:22.059716 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:22.139729 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:22.180354 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2c591-ae2d-47aa-a157-cabbeb3aece0 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:22.181934 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5ff2c591-ae2d-47aa-a157-cabbeb3aece0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:22.286094 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2c591-ae2d-47aa-a157-cabbeb3aece0 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:22.306727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:22.362558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c83a8e-6d81-4752-bc7a-05a2150163cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:22.363569 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c83a8e-6d81-4752-bc7a-05a2150163cd service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:22.363852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c83a8e-6d81-4752-bc7a-05a2150163cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:22.364134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c83a8e-6d81-4752-bc7a-05a2150163cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:22.366496 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-84c83a8e-6d81-4752-bc7a-05a2150163cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:22.475189 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c83a8e-6d81-4752-bc7a-05a2150163cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:22.476621 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c83a8e-6d81-4752-bc7a-05a2150163cd service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:22.495828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 722/1452] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:24.690790 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2945229-b573-4a95-88c2-0797bdb789e0 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:24.691345 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2945229-b573-4a95-88c2-0797bdb789e0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:24.691345 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2945229-b573-4a95-88c2-0797bdb789e0 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:24.692622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:31:24.698177 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0d8de-d721-4220-9411-d57ac505e6b1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:24.698654 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0d8de-d721-4220-9411-d57ac505e6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:24.698801 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0d8de-d721-4220-9411-d57ac505e6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:24.762262 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:24.765380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-81a0d8de-d721-4220-9411-d57ac505e6b1 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:24.767224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-81a0d8de-d721-4220-9411-d57ac505e6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:24.868749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:24.908462 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2945229-b573-4a95-88c2-0797bdb789e0 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:24.910019 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d2945229-b573-4a95-88c2-0797bdb789e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:25.018585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2945229-b573-4a95-88c2-0797bdb789e0 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:25.069733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:25.096120 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571a1cf-ffc4-4640-bc87-606822f935ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:25.096776 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571a1cf-ffc4-4640-bc87-606822f935ec service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:25.097057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571a1cf-ffc4-4640-bc87-606822f935ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:25.097332 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571a1cf-ffc4-4640-bc87-606822f935ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:25.099019 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1571a1cf-ffc4-4640-bc87-606822f935ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:25.214460 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571a1cf-ffc4-4640-bc87-606822f935ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:25.215915 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571a1cf-ffc4-4640-bc87-606822f935ec service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:25.234788 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 732/1455] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:27.348197 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d82638-c0fd-441c-b537-a7667452213e None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:27.348748 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d82638-c0fd-441c-b537-a7667452213e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:27.348748 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d82638-c0fd-441c-b537-a7667452213e None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:27.350231 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:31:27.355654 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1df0f2-5aa6-4cb6-be0d-9d6b273157bf None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:27.356126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1df0f2-5aa6-4cb6-be0d-9d6b273157bf None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:27.356227 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1df0f2-5aa6-4cb6-be0d-9d6b273157bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:27.421814 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8a1df0f2-5aa6-4cb6-be0d-9d6b273157bf None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:27.423114 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8a1df0f2-5aa6-4cb6-be0d-9d6b273157bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:27.455649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:27.524356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:27.563585 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d82638-c0fd-441c-b537-a7667452213e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:27.565158 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d3d82638-c0fd-441c-b537-a7667452213e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:27.668112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d82638-c0fd-441c-b537-a7667452213e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:27.699872 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:27.751328 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c19622-824b-45b6-847b-b93f17d91402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:27.751983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c19622-824b-45b6-847b-b93f17d91402 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:27.752269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c19622-824b-45b6-847b-b93f17d91402 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:27.752546 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c19622-824b-45b6-847b-b93f17d91402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:27.754246 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-15c19622-824b-45b6-847b-b93f17d91402 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:27.871035 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c19622-824b-45b6-847b-b93f17d91402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:27.872508 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c19622-824b-45b6-847b-b93f17d91402 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:27.890877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 725/1458] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:30.033782 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4ed46-25ba-433f-acb7-c6c3bc73fd5e None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:30.034376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4ed46-25ba-433f-acb7-c6c3bc73fd5e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:30.034376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4ed46-25ba-433f-acb7-c6c3bc73fd5e None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:30.035875 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:31:30.041906 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82a91d-7831-426f-a609-ba87b7186df1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:30.042388 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82a91d-7831-426f-a609-ba87b7186df1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:30.042487 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82a91d-7831-426f-a609-ba87b7186df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:30.107870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-cb82a91d-7831-426f-a609-ba87b7186df1 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:30.109073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cb82a91d-7831-426f-a609-ba87b7186df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:30.118010 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:30.205129 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:30.245479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4ed46-25ba-433f-acb7-c6c3bc73fd5e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:30.248005 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c0e4ed46-25ba-433f-acb7-c6c3bc73fd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:30.352774 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4ed46-25ba-433f-acb7-c6c3bc73fd5e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:30.407597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:30.427470 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ee15e-2ccd-48f4-b53c-35611b9b2aee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:30.428414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ee15e-2ccd-48f4-b53c-35611b9b2aee service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:30.428697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ee15e-2ccd-48f4-b53c-35611b9b2aee service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:30.428977 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ee15e-2ccd-48f4-b53c-35611b9b2aee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:30.430686 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-045ee15e-2ccd-48f4-b53c-35611b9b2aee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:30.544442 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ee15e-2ccd-48f4-b53c-35611b9b2aee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:30.546171 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ee15e-2ccd-48f4-b53c-35611b9b2aee service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:30.564470 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 735/1461] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:32.685543 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d93766-8d37-4956-af3c-6958ac2918c7 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:32.686092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d93766-8d37-4956-af3c-6958ac2918c7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:32.686092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d93766-8d37-4956-af3c-6958ac2918c7 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:32.687513 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:31:32.692836 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2b89e-344f-4c83-a45f-1e687a1997ee None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:32.693890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2b89e-344f-4c83-a45f-1e687a1997ee None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:32.694134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2b89e-344f-4c83-a45f-1e687a1997ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:32.759959 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-edc2b89e-344f-4c83-a45f-1e687a1997ee None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:32.761170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-edc2b89e-344f-4c83-a45f-1e687a1997ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:32.800575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:32.867790 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:32.907473 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d93766-8d37-4956-af3c-6958ac2918c7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:32.909032 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-23d93766-8d37-4956-af3c-6958ac2918c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:33.017682 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d93766-8d37-4956-af3c-6958ac2918c7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:33.056701 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:33.093073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a008337-6351-40ec-85e3-aa6eb789c4c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:33.093723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a008337-6351-40ec-85e3-aa6eb789c4c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:33.094011 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a008337-6351-40ec-85e3-aa6eb789c4c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:33.094327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a008337-6351-40ec-85e3-aa6eb789c4c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:33.096019 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8a008337-6351-40ec-85e3-aa6eb789c4c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:33.209998 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a008337-6351-40ec-85e3-aa6eb789c4c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:33.211478 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a008337-6351-40ec-85e3-aa6eb789c4c0 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:33.229861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 728/1464] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:35.357428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41e0e0-7b1a-475e-8af9-77b64fc87ef8 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:35.358009 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41e0e0-7b1a-475e-8af9-77b64fc87ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:35.358009 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41e0e0-7b1a-475e-8af9-77b64fc87ef8 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:35.359323 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:31:35.364567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51687515-a5f5-48c3-b331-ff6c1d886fc5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:35.365898 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51687515-a5f5-48c3-b331-ff6c1d886fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:35.365898 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51687515-a5f5-48c3-b331-ff6c1d886fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:35.431215 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-51687515-a5f5-48c3-b331-ff6c1d886fc5 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:35.432440 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-51687515-a5f5-48c3-b331-ff6c1d886fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:35.450383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:35.530220 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:35.574254 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41e0e0-7b1a-475e-8af9-77b64fc87ef8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:35.575820 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ca41e0e0-7b1a-475e-8af9-77b64fc87ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:35.683812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41e0e0-7b1a-475e-8af9-77b64fc87ef8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:35.751920 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:35.760430 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2264fcf8-a884-4f01-9141-51a9bf27b7f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:35.761080 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264fcf8-a884-4f01-9141-51a9bf27b7f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:35.761386 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264fcf8-a884-4f01-9141-51a9bf27b7f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:35.761662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264fcf8-a884-4f01-9141-51a9bf27b7f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:35.763350 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2264fcf8-a884-4f01-9141-51a9bf27b7f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:35.874711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264fcf8-a884-4f01-9141-51a9bf27b7f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:35.876194 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2264fcf8-a884-4f01-9141-51a9bf27b7f6 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:35.895919 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 738/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:38.001844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88c3e5-8c11-4403-b732-0df6c940b65f None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:38.002483 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88c3e5-8c11-4403-b732-0df6c940b65f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:38.002483 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88c3e5-8c11-4403-b732-0df6c940b65f None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:38.003823 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:31:38.009443 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b4071-2a9b-46c8-b363-2164175dbba5 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:38.009895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b4071-2a9b-46c8-b363-2164175dbba5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:38.010039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b4071-2a9b-46c8-b363-2164175dbba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:38.076384 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6a5b4071-2a9b-46c8-b363-2164175dbba5 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:38.077771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6a5b4071-2a9b-46c8-b363-2164175dbba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:38.126105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:38.174745 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:38.211996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88c3e5-8c11-4403-b732-0df6c940b65f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:38.213626 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-dc88c3e5-8c11-4403-b732-0df6c940b65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:38.325282 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88c3e5-8c11-4403-b732-0df6c940b65f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:38.375362 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:38.403106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b0e54-8e3c-4463-944f-7a3c4ab20fc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:38.403679 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b0e54-8e3c-4463-944f-7a3c4ab20fc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:38.403961 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b0e54-8e3c-4463-944f-7a3c4ab20fc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:38.404233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b0e54-8e3c-4463-944f-7a3c4ab20fc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:38.405889 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ae9b0e54-8e3c-4463-944f-7a3c4ab20fc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:38.515113 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b0e54-8e3c-4463-944f-7a3c4ab20fc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:38.516561 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b0e54-8e3c-4463-944f-7a3c4ab20fc2 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:38.536697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 731/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:31:48.172960 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=22 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:48.534410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=66 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:59.022380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85182ac5-cef2-4bfd-8b01-feda5c2ad99a None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:59.022948 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85182ac5-cef2-4bfd-8b01-feda5c2ad99a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:59.022948 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85182ac5-cef2-4bfd-8b01-feda5c2ad99a None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:59.024325 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 740/1471] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:31:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:31:59.029591 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcda17f-6b90-4d00-ab25-4de466b96b13 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:59.030091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcda17f-6b90-4d00-ab25-4de466b96b13 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:59.030209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcda17f-6b90-4d00-ab25-4de466b96b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:59.096678 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-7fcda17f-6b90-4d00-ab25-4de466b96b13 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:59.097955 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7fcda17f-6b90-4d00-ab25-4de466b96b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:59.195111 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 732/1472] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:59.280015 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d8eae-7365-40d8-99ab-e60295512830 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:59.280310 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d8eae-7365-40d8-99ab-e60295512830 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:59.280595 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d8eae-7365-40d8-99ab-e60295512830 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:59.281959 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 741/1473] 10.222.0.39 () {54 vars in 962 bytes} [Thu Jul 14 15:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:31:59.287260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a6faf-42b4-4719-b499-9a67d92b0709 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:59.287260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a6faf-42b4-4719-b499-9a67d92b0709 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:59.287572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a6faf-42b4-4719-b499-9a67d92b0709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:59.363457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ce1a6faf-42b4-4719-b499-9a67d92b0709 None None] MFA Rules not processed for user `14c582c1127142f8a4ebf64bb7b34516`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:31:59.364800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ce1a6faf-42b4-4719-b499-9a67d92b0709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:59.386970 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:59.461024 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 733/1474] 10.222.0.39 () {58 vars in 1059 bytes} [Thu Jul 14 15:31:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:31:59.468387 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d8eae-7365-40d8-99ab-e60295512830 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:31:59.469946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-634d8eae-7365-40d8-99ab-e60295512830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:59.576016 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d8eae-7365-40d8-99ab-e60295512830 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:31:59.648700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588ebe3-d1e9-45bf-9965-16392e1ac7db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14c582c1127142f8a4ebf64bb7b34516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:31:59.649346 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588ebe3-d1e9-45bf-9965-16392e1ac7db service glance] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:31:59.649626 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588ebe3-d1e9-45bf-9965-16392e1ac7db service glance] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:31:59.649897 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588ebe3-d1e9-45bf-9965-16392e1ac7db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:31:59.651568 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e588ebe3-d1e9-45bf-9965-16392e1ac7db service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:31:59.706052 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:59.765273 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588ebe3-d1e9-45bf-9965-16392e1ac7db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:31:59.766777 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588ebe3-d1e9-45bf-9965-16392e1ac7db service glance] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:31:59.785480 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 742/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:32:01.966384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba07fb6-13d9-4e34-bb3a-d2ffbc4b5dfe None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:01.967040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba07fb6-13d9-4e34-bb3a-d2ffbc4b5dfe None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:01.967040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba07fb6-13d9-4e34-bb3a-d2ffbc4b5dfe None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:01.968347 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 734/1476] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:32:01.973943 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910df36-5e8c-44c1-9730-f3123dd99c03 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:01.974746 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910df36-5e8c-44c1-9730-f3123dd99c03 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:01.974746 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910df36-5e8c-44c1-9730-f3123dd99c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:02.041937 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5910df36-5e8c-44c1-9730-f3123dd99c03 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:32:02.043176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5910df36-5e8c-44c1-9730-f3123dd99c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:02.139739 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 743/1477] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:32:02.164581 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba07fb6-13d9-4e34-bb3a-d2ffbc4b5dfe None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:02.166173 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1ba07fb6-13d9-4e34-bb3a-d2ffbc4b5dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:02.295920 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba07fb6-13d9-4e34-bb3a-d2ffbc4b5dfe None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:02.345059 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:02.391063 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bf010-bfb3-4d1d-a50b-584f47234f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:02.391719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bf010-bfb3-4d1d-a50b-584f47234f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:02.392031 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bf010-bfb3-4d1d-a50b-584f47234f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:02.392306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bf010-bfb3-4d1d-a50b-584f47234f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:02.393030 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6bf010-bfb3-4d1d-a50b-584f47234f0a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:02.394828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-ce6bf010-bfb3-4d1d-a50b-584f47234f0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:32:02.394828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: warnings.warn(msg) Jul 14 15:32:02.394828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: Jul 14 15:32:02.396564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6bf010-bfb3-4d1d-a50b-584f47234f0a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:02.415091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 735/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Thu Jul 14 15:32:02 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:32:04.530441 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a6cd0-0e05-4f4a-b2e7-59d166079ec8 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:04.531040 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a6cd0-0e05-4f4a-b2e7-59d166079ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:04.531040 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a6cd0-0e05-4f4a-b2e7-59d166079ec8 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:04.532381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 744/1479] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:32:04.537650 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83d8b4-94e2-46e3-b27b-680a112317c5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:04.538120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83d8b4-94e2-46e3-b27b-680a112317c5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:04.538230 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83d8b4-94e2-46e3-b27b-680a112317c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:04.602680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-bb83d8b4-94e2-46e3-b27b-680a112317c5 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:32:04.603903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bb83d8b4-94e2-46e3-b27b-680a112317c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:04.699880 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 736/1480] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:32:04.743544 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a6cd0-0e05-4f4a-b2e7-59d166079ec8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:04.745267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e55a6cd0-0e05-4f4a-b2e7-59d166079ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:04.755761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:04.908512 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a6cd0-0e05-4f4a-b2e7-59d166079ec8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:04.991782 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:05.025165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07726eaa-3783-4cc4-b5b8-6d0fee03d3c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:05.025809 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07726eaa-3783-4cc4-b5b8-6d0fee03d3c6 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:05.026114 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07726eaa-3783-4cc4-b5b8-6d0fee03d3c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:05.026399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07726eaa-3783-4cc4-b5b8-6d0fee03d3c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:05.028060 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-07726eaa-3783-4cc4-b5b8-6d0fee03d3c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:05.118297 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07726eaa-3783-4cc4-b5b8-6d0fee03d3c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:05.120081 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07726eaa-3783-4cc4-b5b8-6d0fee03d3c6 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:05.138209 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 745/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:32:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:32:07.470976 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0ca59-c373-400b-b40b-52996196361f None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:07.471569 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0ca59-c373-400b-b40b-52996196361f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:07.471569 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0ca59-c373-400b-b40b-52996196361f None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:07.472914 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 737/1482] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:32:07.478484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d1b68-1dcb-4089-b716-41dde28e1d36 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:07.478973 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d1b68-1dcb-4089-b716-41dde28e1d36 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:07.479081 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d1b68-1dcb-4089-b716-41dde28e1d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:07.556042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2e9d1b68-1dcb-4089-b716-41dde28e1d36 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:32:07.557247 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2e9d1b68-1dcb-4089-b716-41dde28e1d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:07.606105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:07.659498 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 746/1483] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:32:07.697455 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0ca59-c373-400b-b40b-52996196361f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:07.699084 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-68b0ca59-c373-400b-b40b-52996196361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:07.725594 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:07.811007 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0ca59-c373-400b-b40b-52996196361f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:07.896461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726c4d8-1ed3-4e89-9f23-b6ce077ab2ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:07.897538 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726c4d8-1ed3-4e89-9f23-b6ce077ab2ef service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:07.897830 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726c4d8-1ed3-4e89-9f23-b6ce077ab2ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:07.898145 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726c4d8-1ed3-4e89-9f23-b6ce077ab2ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:07.899857 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f726c4d8-1ed3-4e89-9f23-b6ce077ab2ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:07.983347 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:08.023068 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726c4d8-1ed3-4e89-9f23-b6ce077ab2ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:08.024595 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726c4d8-1ed3-4e89-9f23-b6ce077ab2ef service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:08.048574 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 738/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:32:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:32:10.228771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341cf53-6de1-4ef8-bc5f-4881af8449fe None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:10.229300 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341cf53-6de1-4ef8-bc5f-4881af8449fe None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:10.229300 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341cf53-6de1-4ef8-bc5f-4881af8449fe None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:10.230707 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 747/1485] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:32:10.236326 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3d0ca-d5bd-44e0-8c6c-dbc2ee371ccc None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:10.236785 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3d0ca-d5bd-44e0-8c6c-dbc2ee371ccc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:10.236897 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3d0ca-d5bd-44e0-8c6c-dbc2ee371ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:10.306013 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e9b3d0ca-d5bd-44e0-8c6c-dbc2ee371ccc None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:32:10.307359 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e9b3d0ca-d5bd-44e0-8c6c-dbc2ee371ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:10.408695 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 739/1486] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:32:10.448740 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341cf53-6de1-4ef8-bc5f-4881af8449fe None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:10.450406 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e341cf53-6de1-4ef8-bc5f-4881af8449fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:10.562401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341cf53-6de1-4ef8-bc5f-4881af8449fe None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:10.641991 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:10.644102 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b7b15-5624-446f-afc6-231f1352bb62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:10.644768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b7b15-5624-446f-afc6-231f1352bb62 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:10.645147 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b7b15-5624-446f-afc6-231f1352bb62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:10.646259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b7b15-5624-446f-afc6-231f1352bb62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:10.648343 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-646b7b15-5624-446f-afc6-231f1352bb62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:10.765835 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b7b15-5624-446f-afc6-231f1352bb62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:10.767382 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b7b15-5624-446f-afc6-231f1352bb62 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:10.787703 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 748/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:32:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:32:12.996484 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e4f2a-ffe4-4f32-95b8-009b843524e6 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:12.997052 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e4f2a-ffe4-4f32-95b8-009b843524e6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:12.997052 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e4f2a-ffe4-4f32-95b8-009b843524e6 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:12.998511 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 740/1488] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:32:13.003994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae8a52-0434-4b11-a078-4dd1ff568925 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:13.004493 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae8a52-0434-4b11-a078-4dd1ff568925 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:13.005430 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae8a52-0434-4b11-a078-4dd1ff568925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:13.077537 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a6ae8a52-0434-4b11-a078-4dd1ff568925 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:32:13.078946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a6ae8a52-0434-4b11-a078-4dd1ff568925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:13.138493 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:13.188967 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 749/1489] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:32:13.231761 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e4f2a-ffe4-4f32-95b8-009b843524e6 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:13.233329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-425e4f2a-ffe4-4f32-95b8-009b843524e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:13.272417 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:13.345631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e4f2a-ffe4-4f32-95b8-009b843524e6 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:13.422952 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fc068-7fab-4beb-8a2f-3f01c0165c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:13.423614 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fc068-7fab-4beb-8a2f-3f01c0165c94 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:13.423895 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fc068-7fab-4beb-8a2f-3f01c0165c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:13.424177 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fc068-7fab-4beb-8a2f-3f01c0165c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:13.425954 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-fd6fc068-7fab-4beb-8a2f-3f01c0165c94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:13.515550 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:13.548211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fc068-7fab-4beb-8a2f-3f01c0165c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:13.549602 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fc068-7fab-4beb-8a2f-3f01c0165c94 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:13.569038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 741/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:32:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:32:15.873347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8838e0-ac83-440c-8308-35374e1515e5 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:15.873941 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8838e0-ac83-440c-8308-35374e1515e5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:15.873941 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8838e0-ac83-440c-8308-35374e1515e5 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:15.875325 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 750/1491] 10.222.0.39 () {54 vars in 926 bytes} [Thu Jul 14 15:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:32:15.881193 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241f33d-0ebb-4671-9ed2-a2c92591d639 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:15.881663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241f33d-0ebb-4671-9ed2-a2c92591d639 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:15.881764 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241f33d-0ebb-4671-9ed2-a2c92591d639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:15.947850 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-5241f33d-0ebb-4671-9ed2-a2c92591d639 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:32:15.949089 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5241f33d-0ebb-4671-9ed2-a2c92591d639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:16.045673 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 742/1492] 10.222.0.39 () {58 vars in 1023 bytes} [Thu Jul 14 15:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:32:16.087408 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8838e0-ac83-440c-8308-35374e1515e5 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:32:16.089038 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9c8838e0-ac83-440c-8308-35374e1515e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:16.193817 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8838e0-ac83-440c-8308-35374e1515e5 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:32:16.265836 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7652c4-bccd-4b59-8917-b87ac7d769e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:32:16.266510 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7652c4-bccd-4b59-8917-b87ac7d769e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:32:16.266790 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7652c4-bccd-4b59-8917-b87ac7d769e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:32:16.267064 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7652c4-bccd-4b59-8917-b87ac7d769e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:32:16.268706 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4d7652c4-bccd-4b59-8917-b87ac7d769e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:32:16.277813 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:16.383033 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7652c4-bccd-4b59-8917-b87ac7d769e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:32:16.384542 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7652c4-bccd-4b59-8917-b87ac7d769e2 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:32:16.402617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 751/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:32:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:32:26.043545 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=82 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:26.400170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=50 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:45.705212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e34b95-8792-49c5-b663-15a0e018825b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:45.705824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e34b95-8792-49c5-b663-15a0e018825b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:45.705824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e34b95-8792-49c5-b663-15a0e018825b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:45.780518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-70e34b95-8792-49c5-b663-15a0e018825b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:33:45.781749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-70e34b95-8792-49c5-b663-15a0e018825b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:45.881180 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 743/1494] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:33:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:33:45.889365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41052c4-c508-42cd-b964-fbacd88ac799 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:45.889890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41052c4-c508-42cd-b964-fbacd88ac799 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:45.889989 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41052c4-c508-42cd-b964-fbacd88ac799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:45.966874 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b41052c4-c508-42cd-b964-fbacd88ac799 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:33:45.968041 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b41052c4-c508-42cd-b964-fbacd88ac799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:46.066510 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 752/1495] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:33:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:33:46.071378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e34b95-8792-49c5-b663-15a0e018825b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:46.072882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-70e34b95-8792-49c5-b663-15a0e018825b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:46.085093 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e34b95-8792-49c5-b663-15a0e018825b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:46.146574 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:46.180853 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fc9fb-89fe-42d3-9770-9bb7d968b7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:46.181512 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fc9fb-89fe-42d3-9770-9bb7d968b7eb admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:46.181792 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fc9fb-89fe-42d3-9770-9bb7d968b7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:46.182062 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fc9fb-89fe-42d3-9770-9bb7d968b7eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:46.182799 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fc9fb-89fe-42d3-9770-9bb7d968b7eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:33:46.183102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fc9fb-89fe-42d3-9770-9bb7d968b7eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:46.184115 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-5e4fc9fb-89fe-42d3-9770-9bb7d968b7eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:33:46.184115 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: warnings.warn(msg) Jul 14 15:33:46.184115 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: Jul 14 15:33:46.185651 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fc9fb-89fe-42d3-9770-9bb7d968b7eb admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:46.196589 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 744/1496] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:33:46.204803 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41052c4-c508-42cd-b964-fbacd88ac799 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:46.214721 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41052c4-c508-42cd-b964-fbacd88ac799 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:46.278045 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:46.312663 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0c625-1e75-4de3-8ca9-1dd7007bf393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:46.313318 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0c625-1e75-4de3-8ca9-1dd7007bf393 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:46.313599 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0c625-1e75-4de3-8ca9-1dd7007bf393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:46.313876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e0c625-1e75-4de3-8ca9-1dd7007bf393 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:46.314600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0c625-1e75-4de3-8ca9-1dd7007bf393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:46.316457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: WARNING py.warnings [None req-d8e0c625-1e75-4de3-8ca9-1dd7007bf393 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:33:46.316457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: warnings.warn(msg) Jul 14 15:33:46.316457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: Jul 14 15:33:46.317639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e0c625-1e75-4de3-8ca9-1dd7007bf393 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:46.373038 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 753/1497] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:33:46 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:33:46.377299 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fc9fb-89fe-42d3-9770-9bb7d968b7eb admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:46.379125 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5e4fc9fb-89fe-42d3-9770-9bb7d968b7eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:46.413746 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fc9fb-89fe-42d3-9770-9bb7d968b7eb admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:46.512232 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7c7cb-30b3-498f-9f61-e452d76e7df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:46.512900 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7c7cb-30b3-498f-9f61-e452d76e7df3 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:46.513182 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7c7cb-30b3-498f-9f61-e452d76e7df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:46.513457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7c7cb-30b3-498f-9f61-e452d76e7df3 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:46.514169 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7c7cb-30b3-498f-9f61-e452d76e7df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:46.515186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-a7e7c7cb-30b3-498f-9f61-e452d76e7df3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:33:46.515186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: warnings.warn(msg) Jul 14 15:33:46.515186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: Jul 14 15:33:46.516391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7c7cb-30b3-498f-9f61-e452d76e7df3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:46.557417 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 745/1498] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:33:46 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:33:46.561584 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0c625-1e75-4de3-8ca9-1dd7007bf393 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:46.563153 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d8e0c625-1e75-4de3-8ca9-1dd7007bf393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:46.625625 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e0c625-1e75-4de3-8ca9-1dd7007bf393 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:46.713172 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:46.725128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09061d6c-b000-4322-94eb-730709092535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:46.725794 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09061d6c-b000-4322-94eb-730709092535 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:46.726094 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09061d6c-b000-4322-94eb-730709092535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:46.726377 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09061d6c-b000-4322-94eb-730709092535 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:46.727096 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09061d6c-b000-4322-94eb-730709092535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:46.728112 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: WARNING py.warnings [None req-09061d6c-b000-4322-94eb-730709092535 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:33:46.728112 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: warnings.warn(msg) Jul 14 15:33:46.728112 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: Jul 14 15:33:46.728990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09061d6c-b000-4322-94eb-730709092535 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:46.741841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 754/1499] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:33:46.746008 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7c7cb-30b3-498f-9f61-e452d76e7df3 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:46.749234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a7e7c7cb-30b3-498f-9f61-e452d76e7df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:46.769862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7c7cb-30b3-498f-9f61-e452d76e7df3 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:46.796384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:46.867170 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4602784-af06-4f62-9d4d-89f54cbc259c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:46.867779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4602784-af06-4f62-9d4d-89f54cbc259c admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:46.868084 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4602784-af06-4f62-9d4d-89f54cbc259c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:46.868338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4602784-af06-4f62-9d4d-89f54cbc259c admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:46.869058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4602784-af06-4f62-9d4d-89f54cbc259c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:46.870099 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-c4602784-af06-4f62-9d4d-89f54cbc259c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:33:46.870099 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: warnings.warn(msg) Jul 14 15:33:46.870099 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: Jul 14 15:33:46.871030 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4602784-af06-4f62-9d4d-89f54cbc259c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:46.884287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 746/1500] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:33:46.888663 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09061d6c-b000-4322-94eb-730709092535 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:46.890273 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-09061d6c-b000-4322-94eb-730709092535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:46.923557 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09061d6c-b000-4322-94eb-730709092535 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:47.019226 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc086c30-22bc-4e46-858c-1c9873678064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:47.020111 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc086c30-22bc-4e46-858c-1c9873678064 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:47.020396 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc086c30-22bc-4e46-858c-1c9873678064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:47.020673 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc086c30-22bc-4e46-858c-1c9873678064 admin admin] PATH_INFO: `/v3/projects/d03513b6db15428e9cb5f3ca3acae64b/users/cb5d9e3c6af743248ca78f7678dea3c6/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:47.043028 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc086c30-22bc-4e46-858c-1c9873678064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d03513b6db15428e9cb5f3ca3acae64b, user_id=cb5d9e3c6af743248ca78f7678dea3c6, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:47.044082 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: WARNING py.warnings [None req-cc086c30-22bc-4e46-858c-1c9873678064 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:33:47.044082 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: warnings.warn(msg) Jul 14 15:33:47.044082 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: Jul 14 15:33:47.046312 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc086c30-22bc-4e46-858c-1c9873678064 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:47.074481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 755/1501] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:33:46 2022] PUT /identity/v3/projects/d03513b6db15428e9cb5f3ca3acae64b/users/cb5d9e3c6af743248ca78f7678dea3c6/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:33:47.087032 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371fe90-a417-4461-9fa7-258cb0a88934 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:47.087327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371fe90-a417-4461-9fa7-258cb0a88934 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:47.087607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371fe90-a417-4461-9fa7-258cb0a88934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:47.143252 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3371fe90-a417-4461-9fa7-258cb0a88934 None None] MFA Rules not processed for user `cb5d9e3c6af743248ca78f7678dea3c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:33:47.144508 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3371fe90-a417-4461-9fa7-258cb0a88934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:47.223738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 747/1502] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:33:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:33:47.237004 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23981b7c-4a75-4454-a3d3-8261eff4cf9e None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:47.237846 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23981b7c-4a75-4454-a3d3-8261eff4cf9e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:47.238155 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23981b7c-4a75-4454-a3d3-8261eff4cf9e None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:47.239611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 756/1503] 10.222.0.39 () {54 vars in 963 bytes} [Thu Jul 14 15:33:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:33:47.244445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205f3e5-5b8f-4f4c-a2c2-4673d0151a01 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:47.244741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205f3e5-5b8f-4f4c-a2c2-4673d0151a01 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:47.245023 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205f3e5-5b8f-4f4c-a2c2-4673d0151a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:47.274997 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:47.321322 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-6205f3e5-5b8f-4f4c-a2c2-4673d0151a01 None None] MFA Rules not processed for user `78d5b8b2802a44eead863280df22b027`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:33:47.322580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6205f3e5-5b8f-4f4c-a2c2-4673d0151a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:47.397120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 748/1504] 10.222.0.39 () {58 vars in 1060 bytes} [Thu Jul 14 15:33:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:33:47.405117 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23981b7c-4a75-4454-a3d3-8261eff4cf9e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:47.406795 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-23981b7c-4a75-4454-a3d3-8261eff4cf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:47.464118 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:47.521243 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23981b7c-4a75-4454-a3d3-8261eff4cf9e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:47.595692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af18040-6182-4f49-9342-6a939b9e3c18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:47.596403 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af18040-6182-4f49-9342-6a939b9e3c18 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:47.597138 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af18040-6182-4f49-9342-6a939b9e3c18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:47.597548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af18040-6182-4f49-9342-6a939b9e3c18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:47.599170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9af18040-6182-4f49-9342-6a939b9e3c18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:47.700230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af18040-6182-4f49-9342-6a939b9e3c18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:47.701602 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af18040-6182-4f49-9342-6a939b9e3c18 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:47.705150 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:47.720206 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 757/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:33:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:33:47.764659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004d3aa-eee5-40a3-aa90-021fbb76deb5 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:47.765131 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004d3aa-eee5-40a3-aa90-021fbb76deb5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:47.765239 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004d3aa-eee5-40a3-aa90-021fbb76deb5 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:47.766572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 749/1506] 10.222.0.39 () {52 vars in 829 bytes} [Thu Jul 14 15:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:33:47.770947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af18040-6182-4f49-9342-6a939b9e3c18 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:47.772229 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9af18040-6182-4f49-9342-6a939b9e3c18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:47.877233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af18040-6182-4f49-9342-6a939b9e3c18 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:47.978953 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bd189-ece8-4b81-9261-031989d2b058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:47.979714 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bd189-ece8-4b81-9261-031989d2b058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:47.979992 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bd189-ece8-4b81-9261-031989d2b058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:47.980271 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bd189-ece8-4b81-9261-031989d2b058 admin admin] PATH_INFO: `/v3/users/cb5d9e3c6af743248ca78f7678dea3c6` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:47.994141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331bd189-ece8-4b81-9261-031989d2b058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb5d9e3c6af743248ca78f7678dea3c6)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:47.995181 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: WARNING py.warnings [None req-331bd189-ece8-4b81-9261-031989d2b058 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:33:47.995181 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: warnings.warn(msg) Jul 14 15:33:47.995181 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: Jul 14 15:33:47.996393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331bd189-ece8-4b81-9261-031989d2b058 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:48.006774 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:48.062583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-331bd189-ece8-4b81-9261-031989d2b058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb5d9e3c6af743248ca78f7678dea3c6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:48.063029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-331bd189-ece8-4b81-9261-031989d2b058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb5d9e3c6af743248ca78f7678dea3c6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:48.076232 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-331bd189-ece8-4b81-9261-031989d2b058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb5d9e3c6af743248ca78f7678dea3c6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:48.085950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-331bd189-ece8-4b81-9261-031989d2b058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb5d9e3c6af743248ca78f7678dea3c6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:48.104210 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-331bd189-ece8-4b81-9261-031989d2b058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb5d9e3c6af743248ca78f7678dea3c6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:48.109850 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 758/1507] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:33:47 2022] DELETE /identity/v3/users/cb5d9e3c6af743248ca78f7678dea3c6 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:33:48.114450 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58553855-112c-4a12-b70d-ab2ae396967d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:48.114738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58553855-112c-4a12-b70d-ab2ae396967d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:48.115015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58553855-112c-4a12-b70d-ab2ae396967d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:48.172841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-58553855-112c-4a12-b70d-ab2ae396967d None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:33:48.174185 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-58553855-112c-4a12-b70d-ab2ae396967d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:48.248239 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:48.262740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 750/1508] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:33:48.273021 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bd189-ece8-4b81-9261-031989d2b058 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:48.274344 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-331bd189-ece8-4b81-9261-031989d2b058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:48.380465 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bd189-ece8-4b81-9261-031989d2b058 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:48.442452 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:48.463513 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649489d-7915-4a26-9b9f-1191957c4df9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:48.464204 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649489d-7915-4a26-9b9f-1191957c4df9 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:48.464489 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649489d-7915-4a26-9b9f-1191957c4df9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:48.464768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649489d-7915-4a26-9b9f-1191957c4df9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:48.466449 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2649489d-7915-4a26-9b9f-1191957c4df9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:48.576649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649489d-7915-4a26-9b9f-1191957c4df9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:48.578023 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649489d-7915-4a26-9b9f-1191957c4df9 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:48.596404 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 759/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:33:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:33:48.927003 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58553855-112c-4a12-b70d-ab2ae396967d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:33:48.928285 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-58553855-112c-4a12-b70d-ab2ae396967d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:33:48.939615 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58553855-112c-4a12-b70d-ab2ae396967d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:33:49.038122 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c9120e-10c0-40c5-8d8d-fc7af2cb1290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:33:49.038989 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9120e-10c0-40c5-8d8d-fc7af2cb1290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:33:49.039273 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9120e-10c0-40c5-8d8d-fc7af2cb1290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:33:49.039550 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c9120e-10c0-40c5-8d8d-fc7af2cb1290 admin admin] PATH_INFO: `/v3/projects/d03513b6db15428e9cb5f3ca3acae64b` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:33:49.049774 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9120e-10c0-40c5-8d8d-fc7af2cb1290 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d03513b6db15428e9cb5f3ca3acae64b)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:33:49.050841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-58c9120e-10c0-40c5-8d8d-fc7af2cb1290 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:33:49.050841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: warnings.warn(msg) Jul 14 15:33:49.050841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: Jul 14 15:33:49.052053 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c9120e-10c0-40c5-8d8d-fc7af2cb1290 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:33:49.110153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-58c9120e-10c0-40c5-8d8d-fc7af2cb1290 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd03513b6db15428e9cb5f3ca3acae64b', 'request_id': 'req-58c9120e-10c0-40c5-8d8d-fc7af2cb1290'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:49.123453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-58c9120e-10c0-40c5-8d8d-fc7af2cb1290 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd03513b6db15428e9cb5f3ca3acae64b', 'request_id': 'req-58c9120e-10c0-40c5-8d8d-fc7af2cb1290'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:49.129799 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-58c9120e-10c0-40c5-8d8d-fc7af2cb1290 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd03513b6db15428e9cb5f3ca3acae64b', 'request_id': 'req-58c9120e-10c0-40c5-8d8d-fc7af2cb1290'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:49.155762 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-58c9120e-10c0-40c5-8d8d-fc7af2cb1290 admin admin] The token cache is being invalidate because project d03513b6db15428e9cb5f3ca3acae64b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:33:49.156052 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-58c9120e-10c0-40c5-8d8d-fc7af2cb1290 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:49.156481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-58c9120e-10c0-40c5-8d8d-fc7af2cb1290 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:33:49.157932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 751/1510] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:33:48 2022] DELETE /identity/v3/projects/d03513b6db15428e9cb5f3ca3acae64b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:33:58.594087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=62 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:59.153790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:36.179691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af2557-eec6-4dca-b70f-68fd643d2b6a None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:36.180319 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af2557-eec6-4dca-b70f-68fd643d2b6a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:36.180319 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af2557-eec6-4dca-b70f-68fd643d2b6a None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:36.181679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:35:36.186827 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc744d4d-b9d1-4c0a-a5f9-1dceedea6265 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:36.187327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc744d4d-b9d1-4c0a-a5f9-1dceedea6265 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:36.187536 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc744d4d-b9d1-4c0a-a5f9-1dceedea6265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:36.271759 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-dc744d4d-b9d1-4c0a-a5f9-1dceedea6265 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:36.273028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-dc744d4d-b9d1-4c0a-a5f9-1dceedea6265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:36.386601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:35:36.542133 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af2557-eec6-4dca-b70f-68fd643d2b6a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:36.544525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-98af2557-eec6-4dca-b70f-68fd643d2b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:36.665719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af2557-eec6-4dca-b70f-68fd643d2b6a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:36.671664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561d71a-70b7-4ced-9cad-658f667605ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:36.672307 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561d71a-70b7-4ced-9cad-658f667605ec service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:36.672596 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561d71a-70b7-4ced-9cad-658f667605ec service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:36.672885 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561d71a-70b7-4ced-9cad-658f667605ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:36.681081 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561d71a-70b7-4ced-9cad-658f667605ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:36.682717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561d71a-70b7-4ced-9cad-658f667605ec service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:36.692860 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 761/1513] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:35:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:35:37.545810 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108d526-676e-4254-b817-a53912a4c977 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:37.546484 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108d526-676e-4254-b817-a53912a4c977 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:37.546484 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108d526-676e-4254-b817-a53912a4c977 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:37.547830 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:35:37.552603 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2542f5-d052-4e0f-bf2b-605fb0c9b144 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:37.552888 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2542f5-d052-4e0f-bf2b-605fb0c9b144 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:37.553006 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49409c0e-d4c2-4fa1-b7f8-ab8c293a27ac None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:37.553430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2542f5-d052-4e0f-bf2b-605fb0c9b144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:37.553570 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49409c0e-d4c2-4fa1-b7f8-ab8c293a27ac None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:37.553570 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49409c0e-d4c2-4fa1-b7f8-ab8c293a27ac None None] PATH_INFO: `/v3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:37.554966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 762/1515] 10.222.0.117 () {54 vars in 926 bytes} [Thu Jul 14 15:35:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:35:37.560768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d4edd-cb19-4bf9-94fa-182308870d8d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:37.561058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d4edd-cb19-4bf9-94fa-182308870d8d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:37.561373 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d4edd-cb19-4bf9-94fa-182308870d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:37.572744 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-fe2542f5-d052-4e0f-bf2b-605fb0c9b144 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:37.573971 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-fe2542f5-d052-4e0f-bf2b-605fb0c9b144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:37.581911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 754/1516] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:35:37.623095 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-283d4edd-cb19-4bf9-94fa-182308870d8d None None] MFA Rules not processed for user `1d1dbca57a4c43ce9bc37c2303417d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:37.624317 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-283d4edd-cb19-4bf9-94fa-182308870d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:37.696337 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:37.702167 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 763/1517] 10.222.0.117 () {58 vars in 1016 bytes} [Thu Jul 14 15:35:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:35:37.737623 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2542f5-d052-4e0f-bf2b-605fb0c9b144 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:37.750687 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2542f5-d052-4e0f-bf2b-605fb0c9b144 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:37.756892 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c6140-545d-4e70-9bdf-1e0defc7630c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:37.757527 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c6140-545d-4e70-9bdf-1e0defc7630c service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:37.757810 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c6140-545d-4e70-9bdf-1e0defc7630c service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:37.758115 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c6140-545d-4e70-9bdf-1e0defc7630c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:37.766354 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c6140-545d-4e70-9bdf-1e0defc7630c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:37.767955 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c6140-545d-4e70-9bdf-1e0defc7630c service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:37.777610 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 755/1518] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:35:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:35:46.891483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84a16a-ed01-4f66-b0ed-0462de32da1b None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:46.892094 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84a16a-ed01-4f66-b0ed-0462de32da1b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:46.892094 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84a16a-ed01-4f66-b0ed-0462de32da1b None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:46.893389 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 764/1519] 10.222.0.39 () {54 vars in 960 bytes} [Thu Jul 14 15:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:35:46.898336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a0441-6834-4ba3-872b-7055234d23c5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:46.898789 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a0441-6834-4ba3-872b-7055234d23c5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:46.898930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a0441-6834-4ba3-872b-7055234d23c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:46.916767 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-7c6a0441-6834-4ba3-872b-7055234d23c5 None None] MFA Rules not processed for user `1d1dbca57a4c43ce9bc37c2303417d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:46.918316 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7c6a0441-6834-4ba3-872b-7055234d23c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:46.927572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 756/1520] 10.222.0.39 () {58 vars in 1057 bytes} [Thu Jul 14 15:35:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:35:46.934918 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84a16a-ed01-4f66-b0ed-0462de32da1b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:46.948881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84a16a-ed01-4f66-b0ed-0462de32da1b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:46.953889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9370f6-6255-4c11-a228-909e3bfb985a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:46.954554 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9370f6-6255-4c11-a228-909e3bfb985a service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:46.954842 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9370f6-6255-4c11-a228-909e3bfb985a service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:46.955120 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9370f6-6255-4c11-a228-909e3bfb985a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:46.963392 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9370f6-6255-4c11-a228-909e3bfb985a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:46.964979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9370f6-6255-4c11-a228-909e3bfb985a service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:46.974633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 765/1521] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:35:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:35:49.023104 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e275b-c8ca-4ee8-9a49-7607d0afe767 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:49.023690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e275b-c8ca-4ee8-9a49-7607d0afe767 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:49.023690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e275b-c8ca-4ee8-9a49-7607d0afe767 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:49.025044 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:35:49.029830 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73408a42-3c11-404f-bab0-2a2867f3cd3b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:49.030262 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73408a42-3c11-404f-bab0-2a2867f3cd3b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:49.030433 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73408a42-3c11-404f-bab0-2a2867f3cd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:49.049300 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-73408a42-3c11-404f-bab0-2a2867f3cd3b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:49.050627 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-73408a42-3c11-404f-bab0-2a2867f3cd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:49.059457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:35:49.214598 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e275b-c8ca-4ee8-9a49-7607d0afe767 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:49.230018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e275b-c8ca-4ee8-9a49-7607d0afe767 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:49.235517 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856fffa-2604-4df0-b4ea-d18bb9f2d11f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:49.236149 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856fffa-2604-4df0-b4ea-d18bb9f2d11f service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:49.236438 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856fffa-2604-4df0-b4ea-d18bb9f2d11f service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:49.236718 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856fffa-2604-4df0-b4ea-d18bb9f2d11f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:49.246108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856fffa-2604-4df0-b4ea-d18bb9f2d11f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:49.247779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856fffa-2604-4df0-b4ea-d18bb9f2d11f service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:49.257478 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 758/1524] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:35:50.096883 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f56f46-57a1-446d-9c27-9113d26f1c79 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:50.097470 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f56f46-57a1-446d-9c27-9113d26f1c79 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:50.097470 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f56f46-57a1-446d-9c27-9113d26f1c79 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:50.099147 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 15:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:35:50.104130 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49d5ae-2229-47ff-9fec-bf5982fda49e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:50.104661 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49d5ae-2229-47ff-9fec-bf5982fda49e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:50.104773 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49d5ae-2229-47ff-9fec-bf5982fda49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:50.122915 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-cf49d5ae-2229-47ff-9fec-bf5982fda49e None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:50.124130 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cf49d5ae-2229-47ff-9fec-bf5982fda49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:50.132694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 15:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:35:50.286236 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f56f46-57a1-446d-9c27-9113d26f1c79 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:50.300806 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f56f46-57a1-446d-9c27-9113d26f1c79 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:50.306900 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d633c4-0d51-4f3b-955c-028baaa88059 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:50.307534 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d633c4-0d51-4f3b-955c-028baaa88059 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:50.307826 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d633c4-0d51-4f3b-955c-028baaa88059 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:50.308108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d633c4-0d51-4f3b-955c-028baaa88059 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:50.316303 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d633c4-0d51-4f3b-955c-028baaa88059 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:50.318786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d633c4-0d51-4f3b-955c-028baaa88059 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:50.328261 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 768/1527] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:35:54.402833 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fad91e-edd9-4b09-82b1-3d12f78cfaca None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:54.403430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fad91e-edd9-4b09-82b1-3d12f78cfaca None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:54.403534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fad91e-edd9-4b09-82b1-3d12f78cfaca None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:54.405094 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:35:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:35:54.410682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd53793-b2e5-4f70-af7f-130564440200 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:54.411444 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd53793-b2e5-4f70-af7f-130564440200 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:54.411444 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd53793-b2e5-4f70-af7f-130564440200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:54.430416 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ddd53793-b2e5-4f70-af7f-130564440200 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:54.431621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ddd53793-b2e5-4f70-af7f-130564440200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:54.439368 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:35:54.517643 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fad91e-edd9-4b09-82b1-3d12f78cfaca None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:54.519398 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-44fad91e-edd9-4b09-82b1-3d12f78cfaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:54.546659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:54.601236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fad91e-edd9-4b09-82b1-3d12f78cfaca None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:54.604817 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf975a-55a2-4c76-95bd-9df3c05798ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:54.605458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf975a-55a2-4c76-95bd-9df3c05798ac service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:54.605749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf975a-55a2-4c76-95bd-9df3c05798ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:54.606023 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf975a-55a2-4c76-95bd-9df3c05798ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:54.615910 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf975a-55a2-4c76-95bd-9df3c05798ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:54.617353 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf975a-55a2-4c76-95bd-9df3c05798ac service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:54.626728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 761/1530] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:35:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:35:56.858580 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8533724-305f-497c-934c-4b0c583f98c4 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:56.859212 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8533724-305f-497c-934c-4b0c583f98c4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:56.859212 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8533724-305f-497c-934c-4b0c583f98c4 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:56.860610 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:35:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:35:56.867901 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e93e02-bcb2-4e67-9ace-fdfae6b1ca7c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:56.868406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e93e02-bcb2-4e67-9ace-fdfae6b1ca7c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:56.868931 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e93e02-bcb2-4e67-9ace-fdfae6b1ca7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:56.893001 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-25e93e02-bcb2-4e67-9ace-fdfae6b1ca7c None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:35:56.895480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-25e93e02-bcb2-4e67-9ace-fdfae6b1ca7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:35:56.909129 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:35:56.947470 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8533724-305f-497c-934c-4b0c583f98c4 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:35:56.958858 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8533724-305f-497c-934c-4b0c583f98c4 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:35:56.962449 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a737086-6cf2-42e3-b270-52f2be657662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:35:56.963086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a737086-6cf2-42e3-b270-52f2be657662 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:35:56.963368 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a737086-6cf2-42e3-b270-52f2be657662 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:35:56.963645 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a737086-6cf2-42e3-b270-52f2be657662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:35:56.972620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a737086-6cf2-42e3-b270-52f2be657662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:35:56.975222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a737086-6cf2-42e3-b270-52f2be657662 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:35:56.984641 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 771/1533] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:35:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:36:00.796893 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108f02b-dd12-4f83-a359-866ac1f69455 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:00.797481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108f02b-dd12-4f83-a359-866ac1f69455 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:00.797481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108f02b-dd12-4f83-a359-866ac1f69455 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:00.798987 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:36:00.804832 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c17b7f-6aa0-43be-bf1b-416527148f4e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:00.805332 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c17b7f-6aa0-43be-bf1b-416527148f4e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:00.805490 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c17b7f-6aa0-43be-bf1b-416527148f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:00.824234 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-57c17b7f-6aa0-43be-bf1b-416527148f4e None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:00.825452 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-57c17b7f-6aa0-43be-bf1b-416527148f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:00.834195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:01.152196 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108f02b-dd12-4f83-a359-866ac1f69455 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:01.153869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4108f02b-dd12-4f83-a359-866ac1f69455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:01.231899 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108f02b-dd12-4f83-a359-866ac1f69455 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:01.235468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d3949-d971-49f5-8758-bc9a2d7561d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:01.236104 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d3949-d971-49f5-8758-bc9a2d7561d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:01.236388 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d3949-d971-49f5-8758-bc9a2d7561d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:01.236779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d3949-d971-49f5-8758-bc9a2d7561d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:01.246792 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d3949-d971-49f5-8758-bc9a2d7561d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:01.248247 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d3949-d971-49f5-8758-bc9a2d7561d2 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:01.258229 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 764/1536] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:36:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:36:03.345208 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75a56e-217b-483a-985c-7b4de6e2b8cc None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:03.345786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75a56e-217b-483a-985c-7b4de6e2b8cc None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:03.345786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75a56e-217b-483a-985c-7b4de6e2b8cc None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:03.347208 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 15:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:36:03.353020 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c1786-d55a-426b-bd22-d3fcb1530ff6 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:03.353446 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c1786-d55a-426b-bd22-d3fcb1530ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:03.353580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c1786-d55a-426b-bd22-d3fcb1530ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:03.372465 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-da4c1786-d55a-426b-bd22-d3fcb1530ff6 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:36:03.373691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-da4c1786-d55a-426b-bd22-d3fcb1530ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:03.381719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 15:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:36:03.689726 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75a56e-217b-483a-985c-7b4de6e2b8cc None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:36:03.691527 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4e75a56e-217b-483a-985c-7b4de6e2b8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:36:03.704480 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75a56e-217b-483a-985c-7b4de6e2b8cc None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:36:03.708826 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4aa76-14d0-457e-9f96-5e10471ff3c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:36:03.709536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4aa76-14d0-457e-9f96-5e10471ff3c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:36:03.709828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4aa76-14d0-457e-9f96-5e10471ff3c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:36:03.710139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4aa76-14d0-457e-9f96-5e10471ff3c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:36:03.719252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4aa76-14d0-457e-9f96-5e10471ff3c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:36:03.720688 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4aa76-14d0-457e-9f96-5e10471ff3c7 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:36:03.730674 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 774/1539] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:36:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:36:13.367686 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=66 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:13.726574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=34 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:35.893233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab88789-4548-48bb-ad75-d7d882c43115 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:35.893895 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab88789-4548-48bb-ad75-d7d882c43115 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:35.893895 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab88789-4548-48bb-ad75-d7d882c43115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:35.897884 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0bfe2-33df-4c3b-b1f3-559aebbc21c1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:35.898404 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0bfe2-33df-4c3b-b1f3-559aebbc21c1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:35.898499 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0bfe2-33df-4c3b-b1f3-559aebbc21c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:35.925629 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-0ea0bfe2-33df-4c3b-b1f3-559aebbc21c1 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:35.927174 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0ea0bfe2-33df-4c3b-b1f3-559aebbc21c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:35.929397 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3ab88789-4548-48bb-ad75-d7d882c43115 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:35.930643 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3ab88789-4548-48bb-ad75-d7d882c43115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:35.941936 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 775/1540] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:35.943667 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c846c24-62a1-405c-8776-17f9d889184d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:35.944322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c846c24-62a1-405c-8776-17f9d889184d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:35.944942 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c846c24-62a1-405c-8776-17f9d889184d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:35.952124 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 766/1541] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:37:35.953698 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3466c-98b9-46ba-9a58-399cdb6baf13 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:35.954196 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3466c-98b9-46ba-9a58-399cdb6baf13 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:35.954651 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3466c-98b9-46ba-9a58-399cdb6baf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:35.981586 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-1c846c24-62a1-405c-8776-17f9d889184d None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:35.981586 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1c846c24-62a1-405c-8776-17f9d889184d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:35.988399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c9e3466c-98b9-46ba-9a58-399cdb6baf13 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:35.989847 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c9e3466c-98b9-46ba-9a58-399cdb6baf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:35.994890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 776/1542] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:35.996881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4938b-b264-4f40-bd5c-d828b384a563 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:35.997425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4938b-b264-4f40-bd5c-d828b384a563 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:35.997883 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4938b-b264-4f40-bd5c-d828b384a563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.003561 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 767/1543] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:36.004939 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1285ebd-8b17-47e3-8313-e4650bfa7b59 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.005422 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1285ebd-8b17-47e3-8313-e4650bfa7b59 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.005861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1285ebd-8b17-47e3-8313-e4650bfa7b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.018517 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-22c4938b-b264-4f40-bd5c-d828b384a563 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:36.019744 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-22c4938b-b264-4f40-bd5c-d828b384a563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:36.026479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f1285ebd-8b17-47e3-8313-e4650bfa7b59 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:36.027922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 777/1544] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:36.028271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f1285ebd-8b17-47e3-8313-e4650bfa7b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:36.029176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53b175-509e-4983-8340-c41623dd4dd6 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.029469 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53b175-509e-4983-8340-c41623dd4dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.029753 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53b175-509e-4983-8340-c41623dd4dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.041228 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 768/1545] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:36.043367 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0761b15-2c34-4a28-b6ff-35554c3464a7 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.043825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0761b15-2c34-4a28-b6ff-35554c3464a7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.044279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0761b15-2c34-4a28-b6ff-35554c3464a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.048958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-9d53b175-509e-4983-8340-c41623dd4dd6 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:36.050971 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9d53b175-509e-4983-8340-c41623dd4dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:36.060008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 778/1546] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:36.061387 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daecd1b-06b2-41e7-b176-3a4ea9308fa7 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.061678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daecd1b-06b2-41e7-b176-3a4ea9308fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.061958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daecd1b-06b2-41e7-b176-3a4ea9308fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.082234 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7daecd1b-06b2-41e7-b176-3a4ea9308fa7 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:36.083480 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7daecd1b-06b2-41e7-b176-3a4ea9308fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:36.091899 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 779/1547] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:36.093236 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89266f1-87f6-40b4-977c-13e5f0d4a672 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.093528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89266f1-87f6-40b4-977c-13e5f0d4a672 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.093810 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89266f1-87f6-40b4-977c-13e5f0d4a672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.114630 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c89266f1-87f6-40b4-977c-13e5f0d4a672 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:36.115903 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c89266f1-87f6-40b4-977c-13e5f0d4a672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:36.124153 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 780/1548] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:36.125028 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89266f1-87f6-40b4-977c-13e5f0d4a672 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.139231 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89266f1-87f6-40b4-977c-13e5f0d4a672 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.144181 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99228b5f-dbbb-4990-bdd8-dc4a230e0785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.144786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99228b5f-dbbb-4990-bdd8-dc4a230e0785 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.145070 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99228b5f-dbbb-4990-bdd8-dc4a230e0785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.145346 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99228b5f-dbbb-4990-bdd8-dc4a230e0785 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.146103 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99228b5f-dbbb-4990-bdd8-dc4a230e0785 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:36.146426 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99228b5f-dbbb-4990-bdd8-dc4a230e0785 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.147468 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: WARNING py.warnings [None req-99228b5f-dbbb-4990-bdd8-dc4a230e0785 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:37:36.147468 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: warnings.warn(msg) Jul 14 15:37:36.147468 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: Jul 14 15:37:36.148372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99228b5f-dbbb-4990-bdd8-dc4a230e0785 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.162116 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 781/1549] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:36.163381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4c343-279f-48fe-9a76-96c0643f8032 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.163672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4c343-279f-48fe-9a76-96c0643f8032 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.163952 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d4c343-279f-48fe-9a76-96c0643f8032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.184851 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c4d4c343-279f-48fe-9a76-96c0643f8032 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:36.186120 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c4d4c343-279f-48fe-9a76-96c0643f8032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:36.194775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 782/1550] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:36.196296 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea4be5-6b79-4abd-8e03-571160c6055b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.196599 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea4be5-6b79-4abd-8e03-571160c6055b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.197449 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b0761b15-2c34-4a28-b6ff-35554c3464a7 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:36.198197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea4be5-6b79-4abd-8e03-571160c6055b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.198999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b0761b15-2c34-4a28-b6ff-35554c3464a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:36.208215 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 769/1551] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:36.209050 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0761b15-2c34-4a28-b6ff-35554c3464a7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.220120 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8eea4be5-6b79-4abd-8e03-571160c6055b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:36.220888 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8eea4be5-6b79-4abd-8e03-571160c6055b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:36.226340 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0761b15-2c34-4a28-b6ff-35554c3464a7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.230438 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 783/1552] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:36.231681 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e088558-4c79-441c-94e6-6fb3c8b4fbcc None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.231976 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e088558-4c79-441c-94e6-6fb3c8b4fbcc None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.232257 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e088558-4c79-441c-94e6-6fb3c8b4fbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.234846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f2557-382d-4295-9460-b048af520545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.235507 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f2557-382d-4295-9460-b048af520545 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.235793 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f2557-382d-4295-9460-b048af520545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.236068 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f2557-382d-4295-9460-b048af520545 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.237540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f2557-382d-4295-9460-b048af520545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:36.238147 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f2557-382d-4295-9460-b048af520545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.240194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f2557-382d-4295-9460-b048af520545 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.251814 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5e088558-4c79-441c-94e6-6fb3c8b4fbcc None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:36.252957 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 770/1553] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:36.253103 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5e088558-4c79-441c-94e6-6fb3c8b4fbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:36.254530 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da20c9-1ea6-43f7-a113-c096777e29bb None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.254824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da20c9-1ea6-43f7-a113-c096777e29bb None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.255155 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da20c9-1ea6-43f7-a113-c096777e29bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.261481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 784/1554] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:36.263161 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e088558-4c79-441c-94e6-6fb3c8b4fbcc None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.272797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e088558-4c79-441c-94e6-6fb3c8b4fbcc None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.276744 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-00da20c9-1ea6-43f7-a113-c096777e29bb None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:36.277600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be849c1-72c2-459e-b6c1-b177eae18d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.277964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-00da20c9-1ea6-43f7-a113-c096777e29bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:36.278295 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be849c1-72c2-459e-b6c1-b177eae18d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.278586 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be849c1-72c2-459e-b6c1-b177eae18d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.278886 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be849c1-72c2-459e-b6c1-b177eae18d5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.279629 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be849c1-72c2-459e-b6c1-b177eae18d5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:36.279946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be849c1-72c2-459e-b6c1-b177eae18d5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.281628 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be849c1-72c2-459e-b6c1-b177eae18d5f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.287176 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 771/1555] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:36.290995 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da20c9-1ea6-43f7-a113-c096777e29bb None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.296824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 785/1556] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:36.297796 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be849c1-72c2-459e-b6c1-b177eae18d5f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.308441 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be849c1-72c2-459e-b6c1-b177eae18d5f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.309466 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da20c9-1ea6-43f7-a113-c096777e29bb None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.313458 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e16d6b-d060-42a4-9698-da2bf89e9ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.313975 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e16d6b-d060-42a4-9698-da2bf89e9ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.314276 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1473d1-07d8-47ea-86d6-12754899edf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.314440 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e16d6b-d060-42a4-9698-da2bf89e9ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.314547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e16d6b-d060-42a4-9698-da2bf89e9ae8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.315013 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1473d1-07d8-47ea-86d6-12754899edf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.315488 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e16d6b-d060-42a4-9698-da2bf89e9ae8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:36.315629 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1473d1-07d8-47ea-86d6-12754899edf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.315802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e16d6b-d060-42a4-9698-da2bf89e9ae8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.315913 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1473d1-07d8-47ea-86d6-12754899edf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.316546 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1473d1-07d8-47ea-86d6-12754899edf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.317395 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e16d6b-d060-42a4-9698-da2bf89e9ae8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.317558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-bc1473d1-07d8-47ea-86d6-12754899edf6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:37:36.317558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: warnings.warn(msg) Jul 14 15:37:36.317558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: Jul 14 15:37:36.318775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1473d1-07d8-47ea-86d6-12754899edf6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.330166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 786/1557] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:36.332409 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473b6dd-8def-4838-b55a-790d0ef4373b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.332890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473b6dd-8def-4838-b55a-790d0ef4373b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.333183 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473b6dd-8def-4838-b55a-790d0ef4373b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.353677 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-0473b6dd-8def-4838-b55a-790d0ef4373b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:36.355104 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0473b6dd-8def-4838-b55a-790d0ef4373b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:36.363025 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 772/1558] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/projects => generated 367 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:36.363025 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1473d1-07d8-47ea-86d6-12754899edf6 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.366777 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 787/1559] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:36.366777 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473b6dd-8def-4838-b55a-790d0ef4373b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.376681 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473b6dd-8def-4838-b55a-790d0ef4373b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.436019 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1473d1-07d8-47ea-86d6-12754899edf6 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.439233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948aed7a-d859-4722-8a04-9462b8e8845a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.439998 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948aed7a-d859-4722-8a04-9462b8e8845a admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.440272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948aed7a-d859-4722-8a04-9462b8e8845a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.440824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948aed7a-d859-4722-8a04-9462b8e8845a admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.441251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948aed7a-d859-4722-8a04-9462b8e8845a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.441425 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4af347-707a-4950-997b-10a4fa3b0455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.442127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4af347-707a-4950-997b-10a4fa3b0455 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.442419 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4af347-707a-4950-997b-10a4fa3b0455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.442695 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4af347-707a-4950-997b-10a4fa3b0455 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.443346 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948aed7a-d859-4722-8a04-9462b8e8845a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.443474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4af347-707a-4950-997b-10a4fa3b0455 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:36.443722 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4af347-707a-4950-997b-10a4fa3b0455 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.445387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4af347-707a-4950-997b-10a4fa3b0455 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.457187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 773/1560] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:36.458583 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c523e6-3c64-4a9f-9a6c-9ce10ebf0dd6 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.458847 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c523e6-3c64-4a9f-9a6c-9ce10ebf0dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.459190 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c523e6-3c64-4a9f-9a6c-9ce10ebf0dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.471628 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 788/1561] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/projects => generated 393 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:36.472651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948aed7a-d859-4722-8a04-9462b8e8845a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.479582 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-30c523e6-3c64-4a9f-9a6c-9ce10ebf0dd6 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:36.480791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-30c523e6-3c64-4a9f-9a6c-9ce10ebf0dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:36.515764 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:36.537011 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948aed7a-d859-4722-8a04-9462b8e8845a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.541866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed062acf-6541-44a3-86c6-feded5ed78e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.542574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed062acf-6541-44a3-86c6-feded5ed78e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.542861 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed062acf-6541-44a3-86c6-feded5ed78e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.543142 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed062acf-6541-44a3-86c6-feded5ed78e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.543582 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 774/1562] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:36.543867 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed062acf-6541-44a3-86c6-feded5ed78e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:36.544176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed062acf-6541-44a3-86c6-feded5ed78e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.544621 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c523e6-3c64-4a9f-9a6c-9ce10ebf0dd6 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.545791 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed062acf-6541-44a3-86c6-feded5ed78e8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.557317 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c523e6-3c64-4a9f-9a6c-9ce10ebf0dd6 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.558930 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 789/1563] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:36.559450 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed062acf-6541-44a3-86c6-feded5ed78e8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.562649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53f398-7f4d-459b-9d69-bf0e3c5cef20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.563310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53f398-7f4d-459b-9d69-bf0e3c5cef20 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.563596 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53f398-7f4d-459b-9d69-bf0e3c5cef20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.563879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53f398-7f4d-459b-9d69-bf0e3c5cef20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.564592 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53f398-7f4d-459b-9d69-bf0e3c5cef20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.566995 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53f398-7f4d-459b-9d69-bf0e3c5cef20 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.569605 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed062acf-6541-44a3-86c6-feded5ed78e8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.574424 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255941c-cc7a-4a38-bafc-879a1b0844aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.575073 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255941c-cc7a-4a38-bafc-879a1b0844aa admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.575356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255941c-cc7a-4a38-bafc-879a1b0844aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.575639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255941c-cc7a-4a38-bafc-879a1b0844aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.576319 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e255941c-cc7a-4a38-bafc-879a1b0844aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.578248 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e255941c-cc7a-4a38-bafc-879a1b0844aa admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.582621 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:36.599047 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 775/1564] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:36.600744 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53f398-7f4d-459b-9d69-bf0e3c5cef20 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.612717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 790/1565] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:36.616192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255941c-cc7a-4a38-bafc-879a1b0844aa admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.676977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53f398-7f4d-459b-9d69-bf0e3c5cef20 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.681709 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a268bf1-fbf0-498b-a40f-b9114fcd0d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.682348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a268bf1-fbf0-498b-a40f-b9114fcd0d7d admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.682723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a268bf1-fbf0-498b-a40f-b9114fcd0d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.683000 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a268bf1-fbf0-498b-a40f-b9114fcd0d7d admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.683688 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a268bf1-fbf0-498b-a40f-b9114fcd0d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.685574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255941c-cc7a-4a38-bafc-879a1b0844aa admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.685712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a268bf1-fbf0-498b-a40f-b9114fcd0d7d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.690239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27102e-9824-4f5b-a268-6fc31c332907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.690900 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27102e-9824-4f5b-a268-6fc31c332907 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.691184 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27102e-9824-4f5b-a268-6fc31c332907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.691469 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27102e-9824-4f5b-a268-6fc31c332907 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.692364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27102e-9824-4f5b-a268-6fc31c332907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:36.692489 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27102e-9824-4f5b-a268-6fc31c332907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.694096 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27102e-9824-4f5b-a268-6fc31c332907 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.709758 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 776/1566] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:36.709996 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 791/1567] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:36.710153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a268bf1-fbf0-498b-a40f-b9114fcd0d7d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.710258 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27102e-9824-4f5b-a268-6fc31c332907 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.718941 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a268bf1-fbf0-498b-a40f-b9114fcd0d7d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.719377 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27102e-9824-4f5b-a268-6fc31c332907 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.724837 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df56fac-6f16-486e-95ed-c693d387cc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.725026 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d86ea9-fab8-462c-a039-ca8db8287370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.725556 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df56fac-6f16-486e-95ed-c693d387cc79 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.725669 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d86ea9-fab8-462c-a039-ca8db8287370 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.725871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d86ea9-fab8-462c-a039-ca8db8287370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.726192 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d86ea9-fab8-462c-a039-ca8db8287370 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.726312 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df56fac-6f16-486e-95ed-c693d387cc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.726594 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df56fac-6f16-486e-95ed-c693d387cc79 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.726890 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d86ea9-fab8-462c-a039-ca8db8287370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.727293 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df56fac-6f16-486e-95ed-c693d387cc79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.728294 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: WARNING py.warnings [None req-2df56fac-6f16-486e-95ed-c693d387cc79 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:37:36.728294 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: warnings.warn(msg) Jul 14 15:37:36.728294 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: Jul 14 15:37:36.728789 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d86ea9-fab8-462c-a039-ca8db8287370 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.729663 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df56fac-6f16-486e-95ed-c693d387cc79 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.752382 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 792/1568] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/users => generated 297 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:36.754890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df56fac-6f16-486e-95ed-c693d387cc79 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.755952 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 777/1569] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:36.756932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d86ea9-fab8-462c-a039-ca8db8287370 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.765105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df56fac-6f16-486e-95ed-c693d387cc79 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.821654 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d86ea9-fab8-462c-a039-ca8db8287370 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.823434 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b267ba7-0f27-4a85-acc2-3171708e4fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.824159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b267ba7-0f27-4a85-acc2-3171708e4fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.824448 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b267ba7-0f27-4a85-acc2-3171708e4fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.824727 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b267ba7-0f27-4a85-acc2-3171708e4fe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.825492 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b267ba7-0f27-4a85-acc2-3171708e4fe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:36.825802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b267ba7-0f27-4a85-acc2-3171708e4fe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.826446 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80674c7-9fd8-4015-bfb4-7a38ab089e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.827108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80674c7-9fd8-4015-bfb4-7a38ab089e01 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.827387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80674c7-9fd8-4015-bfb4-7a38ab089e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.827503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b267ba7-0f27-4a85-acc2-3171708e4fe7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.827658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80674c7-9fd8-4015-bfb4-7a38ab089e01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.828348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80674c7-9fd8-4015-bfb4-7a38ab089e01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.830349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80674c7-9fd8-4015-bfb4-7a38ab089e01 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.840562 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 793/1570] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:36.841396 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b267ba7-0f27-4a85-acc2-3171708e4fe7 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.853519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b267ba7-0f27-4a85-acc2-3171708e4fe7 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.858553 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10755447-23dd-441e-becf-aa1f87b4af0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.859218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10755447-23dd-441e-becf-aa1f87b4af0a admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.859506 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10755447-23dd-441e-becf-aa1f87b4af0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.859784 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10755447-23dd-441e-becf-aa1f87b4af0a admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.860469 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10755447-23dd-441e-becf-aa1f87b4af0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.862718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10755447-23dd-441e-becf-aa1f87b4af0a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.864490 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 778/1571] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:36.865614 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80674c7-9fd8-4015-bfb4-7a38ab089e01 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.883342 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 794/1572] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:36.884159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10755447-23dd-441e-becf-aa1f87b4af0a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.890890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:36.895741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10755447-23dd-441e-becf-aa1f87b4af0a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.925673 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:36.940352 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80674c7-9fd8-4015-bfb4-7a38ab089e01 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.945147 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbff5c7-fde3-4fb9-84a3-444fca42e7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.945818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbff5c7-fde3-4fb9-84a3-444fca42e7f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.946145 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbff5c7-fde3-4fb9-84a3-444fca42e7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.946425 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbff5c7-fde3-4fb9-84a3-444fca42e7f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.947106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbff5c7-fde3-4fb9-84a3-444fca42e7f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.949036 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbff5c7-fde3-4fb9-84a3-444fca42e7f6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.959496 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86542dd9-13b7-43c6-b16d-188cf0c11e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.960108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86542dd9-13b7-43c6-b16d-188cf0c11e27 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.960397 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86542dd9-13b7-43c6-b16d-188cf0c11e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.960682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86542dd9-13b7-43c6-b16d-188cf0c11e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.961414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86542dd9-13b7-43c6-b16d-188cf0c11e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.963371 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86542dd9-13b7-43c6-b16d-188cf0c11e27 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.972342 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 779/1573] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:36.976677 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbff5c7-fde3-4fb9-84a3-444fca42e7f6 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.976891 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 795/1574] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:36.977151 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86542dd9-13b7-43c6-b16d-188cf0c11e27 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:36.987547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86542dd9-13b7-43c6-b16d-188cf0c11e27 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.990339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbff5c7-fde3-4fb9-84a3-444fca42e7f6 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:36.992912 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a7b3e-809a-44d9-a9db-5d914abd650a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.993575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a7b3e-809a-44d9-a9db-5d914abd650a admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.993862 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a7b3e-809a-44d9-a9db-5d914abd650a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.994181 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a7b3e-809a-44d9-a9db-5d914abd650a admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.994909 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a7b3e-809a-44d9-a9db-5d914abd650a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.995046 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5893e-e7a7-4d5f-bc47-ac5045a2988d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:36.995722 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5893e-e7a7-4d5f-bc47-ac5045a2988d admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:36.996004 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5893e-e7a7-4d5f-bc47-ac5045a2988d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:36.996275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5893e-e7a7-4d5f-bc47-ac5045a2988d admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:36.996522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a7b3e-809a-44d9-a9db-5d914abd650a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:36.996954 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5893e-e7a7-4d5f-bc47-ac5045a2988d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:36.998882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5893e-e7a7-4d5f-bc47-ac5045a2988d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.007562 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 796/1575] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:37.008346 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a7b3e-809a-44d9-a9db-5d914abd650a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.019611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a7b3e-809a-44d9-a9db-5d914abd650a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.024781 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0c719-d51a-4feb-8c5c-8ebec1570a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.025480 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0c719-d51a-4feb-8c5c-8ebec1570a01 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.025889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0c719-d51a-4feb-8c5c-8ebec1570a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.026210 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0c719-d51a-4feb-8c5c-8ebec1570a01 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.026903 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0c719-d51a-4feb-8c5c-8ebec1570a01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.029026 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0c719-d51a-4feb-8c5c-8ebec1570a01 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.030435 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 780/1576] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:37:36 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:37.031247 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5893e-e7a7-4d5f-bc47-ac5045a2988d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.052747 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 797/1577] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:37:37 2022] POST /identity/v3/users => generated 283 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:37.055085 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0c719-d51a-4feb-8c5c-8ebec1570a01 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.065450 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0c719-d51a-4feb-8c5c-8ebec1570a01 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.099325 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5893e-e7a7-4d5f-bc47-ac5045a2988d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.104705 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffdd0e-5452-4516-82fe-b692261a0263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.105598 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffdd0e-5452-4516-82fe-b692261a0263 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.105884 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffdd0e-5452-4516-82fe-b692261a0263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.106266 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffdd0e-5452-4516-82fe-b692261a0263 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.107018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffdd0e-5452-4516-82fe-b692261a0263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.109063 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffdd0e-5452-4516-82fe-b692261a0263 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.134648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308683a7-1127-46c4-af5e-34dd8ea04145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.135345 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308683a7-1127-46c4-af5e-34dd8ea04145 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.135627 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308683a7-1127-46c4-af5e-34dd8ea04145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.135904 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308683a7-1127-46c4-af5e-34dd8ea04145 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.136591 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308683a7-1127-46c4-af5e-34dd8ea04145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.140837 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 781/1578] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:37:37 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:37.140837 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffdd0e-5452-4516-82fe-b692261a0263 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.141091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308683a7-1127-46c4-af5e-34dd8ea04145 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.160925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 798/1579] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:37:37 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:37.163016 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308683a7-1127-46c4-af5e-34dd8ea04145 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.173501 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308683a7-1127-46c4-af5e-34dd8ea04145 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.203362 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffdd0e-5452-4516-82fe-b692261a0263 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.208152 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434cebbc-bc21-4e88-9d82-4c2c251c2e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.208814 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cebbc-bc21-4e88-9d82-4c2c251c2e9a admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.209094 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cebbc-bc21-4e88-9d82-4c2c251c2e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.209377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cebbc-bc21-4e88-9d82-4c2c251c2e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.210100 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434cebbc-bc21-4e88-9d82-4c2c251c2e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.211734 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434cebbc-bc21-4e88-9d82-4c2c251c2e9a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.223096 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 782/1580] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:37.224290 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434cebbc-bc21-4e88-9d82-4c2c251c2e9a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.234198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434cebbc-bc21-4e88-9d82-4c2c251c2e9a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.236035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97928e66-e45d-4a1f-8441-14468b9c6d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.236705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97928e66-e45d-4a1f-8441-14468b9c6d46 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.237047 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97928e66-e45d-4a1f-8441-14468b9c6d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.237312 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97928e66-e45d-4a1f-8441-14468b9c6d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.238209 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97928e66-e45d-4a1f-8441-14468b9c6d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.239434 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb4c36-8f2b-4e01-81fb-dad09c768aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.239827 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97928e66-e45d-4a1f-8441-14468b9c6d46 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.240089 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb4c36-8f2b-4e01-81fb-dad09c768aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.241554 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb4c36-8f2b-4e01-81fb-dad09c768aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.241868 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb4c36-8f2b-4e01-81fb-dad09c768aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.242846 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:37.243220 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb4c36-8f2b-4e01-81fb-dad09c768aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.244817 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb4c36-8f2b-4e01-81fb-dad09c768aa2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.255490 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 799/1581] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:37.255490 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97928e66-e45d-4a1f-8441-14468b9c6d46 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.256053 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 783/1582] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:37.256827 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb4c36-8f2b-4e01-81fb-dad09c768aa2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.263909 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97928e66-e45d-4a1f-8441-14468b9c6d46 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.266664 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb4c36-8f2b-4e01-81fb-dad09c768aa2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.268506 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0af51e-531a-4f79-94df-046107279604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.269181 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0af51e-531a-4f79-94df-046107279604 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.269467 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0af51e-531a-4f79-94df-046107279604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.269768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0af51e-531a-4f79-94df-046107279604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.270498 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0af51e-531a-4f79-94df-046107279604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.271934 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bdf3b-1e87-4e39-b3c8-f60ea2a8dee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.272093 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0af51e-531a-4f79-94df-046107279604 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.272586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bdf3b-1e87-4e39-b3c8-f60ea2a8dee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.272874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bdf3b-1e87-4e39-b3c8-f60ea2a8dee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.273152 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bdf3b-1e87-4e39-b3c8-f60ea2a8dee3 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.273835 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bdf3b-1e87-4e39-b3c8-f60ea2a8dee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.275772 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bdf3b-1e87-4e39-b3c8-f60ea2a8dee3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.282535 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 800/1583] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:37.283144 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0af51e-531a-4f79-94df-046107279604 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.294829 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0af51e-531a-4f79-94df-046107279604 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.300005 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd0099-1270-48d1-bc57-be5745708c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.300674 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd0099-1270-48d1-bc57-be5745708c08 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.301042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd0099-1270-48d1-bc57-be5745708c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.301328 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd0099-1270-48d1-bc57-be5745708c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.302091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd0099-1270-48d1-bc57-be5745708c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.302604 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 784/1584] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:37:37 2022] POST /identity/v3/users => generated 294 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:37.303526 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bdf3b-1e87-4e39-b3c8-f60ea2a8dee3 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.303787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd0099-1270-48d1-bc57-be5745708c08 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.313428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bdf3b-1e87-4e39-b3c8-f60ea2a8dee3 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.315137 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 801/1585] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:37.316386 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd0099-1270-48d1-bc57-be5745708c08 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.319669 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787b8e8-08ca-424c-9090-0abee5cb383a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.320479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787b8e8-08ca-424c-9090-0abee5cb383a admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.320903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787b8e8-08ca-424c-9090-0abee5cb383a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.321201 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787b8e8-08ca-424c-9090-0abee5cb383a admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.322006 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787b8e8-08ca-424c-9090-0abee5cb383a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.324164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787b8e8-08ca-424c-9090-0abee5cb383a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.328701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd0099-1270-48d1-bc57-be5745708c08 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.333239 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:37.334733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95317aa4-865a-4dab-ab04-bfc504cc0a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.335754 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95317aa4-865a-4dab-ab04-bfc504cc0a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.336087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95317aa4-865a-4dab-ab04-bfc504cc0a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.336429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95317aa4-865a-4dab-ab04-bfc504cc0a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.337639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95317aa4-865a-4dab-ab04-bfc504cc0a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.339163 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95317aa4-865a-4dab-ab04-bfc504cc0a13 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.348078 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 785/1586] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:37:37 2022] POST /identity/v3/users => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:37.349141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787b8e8-08ca-424c-9090-0abee5cb383a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.353911 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 802/1587] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:37.353911 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95317aa4-865a-4dab-ab04-bfc504cc0a13 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.359420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787b8e8-08ca-424c-9090-0abee5cb383a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.361633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95317aa4-865a-4dab-ab04-bfc504cc0a13 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.364093 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e11030-b6e6-4c2c-ba38-14b1028580c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.364744 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e11030-b6e6-4c2c-ba38-14b1028580c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.365025 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e11030-b6e6-4c2c-ba38-14b1028580c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.365299 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e11030-b6e6-4c2c-ba38-14b1028580c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.366018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e11030-b6e6-4c2c-ba38-14b1028580c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.366984 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ba389-7a36-4ec3-8707-f5577f177734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.367637 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ba389-7a36-4ec3-8707-f5577f177734 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.367762 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e11030-b6e6-4c2c-ba38-14b1028580c9 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.367933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ba389-7a36-4ec3-8707-f5577f177734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.368204 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ba389-7a36-4ec3-8707-f5577f177734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.368922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ba389-7a36-4ec3-8707-f5577f177734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.370582 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ba389-7a36-4ec3-8707-f5577f177734 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.378678 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 786/1588] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:37.379481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e11030-b6e6-4c2c-ba38-14b1028580c9 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.384047 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 803/1589] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:37.384047 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ba389-7a36-4ec3-8707-f5577f177734 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.389971 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e11030-b6e6-4c2c-ba38-14b1028580c9 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.393648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ba389-7a36-4ec3-8707-f5577f177734 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.395685 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d666b4d-569b-4a4a-b27b-f47c177aeb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.396599 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d666b4d-569b-4a4a-b27b-f47c177aeb5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.396886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d666b4d-569b-4a4a-b27b-f47c177aeb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.397163 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d666b4d-569b-4a4a-b27b-f47c177aeb5f admin admin] PATH_INFO: `/v3/projects/1c444fe6a3e04cd1aa2c1795d8ee1235/users/80206583b4b44187a17e58a7eedbba96/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.398846 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5372bc4-82c1-4a22-a3be-f502d1ab7e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.399514 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5372bc4-82c1-4a22-a3be-f502d1ab7e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.399806 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5372bc4-82c1-4a22-a3be-f502d1ab7e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.400089 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5372bc4-82c1-4a22-a3be-f502d1ab7e00 admin admin] PATH_INFO: `/v3/projects/a12415e38f6140a182f5d0c90da5f02d/users/c7527df3bd954e939aa9dc63d7664e30/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.412593 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d666b4d-569b-4a4a-b27b-f47c177aeb5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c444fe6a3e04cd1aa2c1795d8ee1235, user_id=80206583b4b44187a17e58a7eedbba96, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.413680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-7d666b4d-569b-4a4a-b27b-f47c177aeb5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:37:37.413680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: warnings.warn(msg) Jul 14 15:37:37.413680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: Jul 14 15:37:37.415741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d666b4d-569b-4a4a-b27b-f47c177aeb5f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.422441 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5372bc4-82c1-4a22-a3be-f502d1ab7e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a12415e38f6140a182f5d0c90da5f02d, user_id=c7527df3bd954e939aa9dc63d7664e30, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.426328 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5372bc4-82c1-4a22-a3be-f502d1ab7e00 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.430700 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 787/1590] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:37:37 2022] PUT /identity/v3/projects/1c444fe6a3e04cd1aa2c1795d8ee1235/users/80206583b4b44187a17e58a7eedbba96/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:37.431580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d666b4d-569b-4a4a-b27b-f47c177aeb5f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.447267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 804/1591] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:37:37 2022] PUT /identity/v3/projects/a12415e38f6140a182f5d0c90da5f02d/users/c7527df3bd954e939aa9dc63d7664e30/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:37.448168 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5372bc4-82c1-4a22-a3be-f502d1ab7e00 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.497362 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d666b4d-569b-4a4a-b27b-f47c177aeb5f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.514399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5372bc4-82c1-4a22-a3be-f502d1ab7e00 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.519736 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c85835-6799-4489-9ca1-e2f847a9603a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.520432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c85835-6799-4489-9ca1-e2f847a9603a admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.520719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c85835-6799-4489-9ca1-e2f847a9603a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.520994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c85835-6799-4489-9ca1-e2f847a9603a admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.521716 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c85835-6799-4489-9ca1-e2f847a9603a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.523806 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c85835-6799-4489-9ca1-e2f847a9603a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.534008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 805/1592] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:37.534954 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c85835-6799-4489-9ca1-e2f847a9603a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.544529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c85835-6799-4489-9ca1-e2f847a9603a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.550309 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d98e10-022c-4b33-97ab-d58cc544066c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.550958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d98e10-022c-4b33-97ab-d58cc544066c admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.551276 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d98e10-022c-4b33-97ab-d58cc544066c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.551560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d98e10-022c-4b33-97ab-d58cc544066c admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.552414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d98e10-022c-4b33-97ab-d58cc544066c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.554145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d98e10-022c-4b33-97ab-d58cc544066c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.556057 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d294bb4-f6bf-4dfe-b586-21929cc73672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.556727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d294bb4-f6bf-4dfe-b586-21929cc73672 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.557011 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d294bb4-f6bf-4dfe-b586-21929cc73672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.557288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d294bb4-f6bf-4dfe-b586-21929cc73672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.558476 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d294bb4-f6bf-4dfe-b586-21929cc73672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.560499 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d294bb4-f6bf-4dfe-b586-21929cc73672 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.564555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 806/1593] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:37.564555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d98e10-022c-4b33-97ab-d58cc544066c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.571534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 788/1594] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:37.572516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d294bb4-f6bf-4dfe-b586-21929cc73672 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.576063 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d98e10-022c-4b33-97ab-d58cc544066c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.581211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcda7c0-73b4-4d4b-b7f0-5b0fa3a8dd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.581918 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcda7c0-73b4-4d4b-b7f0-5b0fa3a8dd2b admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.582248 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcda7c0-73b4-4d4b-b7f0-5b0fa3a8dd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.582536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcda7c0-73b4-4d4b-b7f0-5b0fa3a8dd2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.583209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d294bb4-f6bf-4dfe-b586-21929cc73672 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.583330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcda7c0-73b4-4d4b-b7f0-5b0fa3a8dd2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.584916 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcda7c0-73b4-4d4b-b7f0-5b0fa3a8dd2b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.587910 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b92b7-1ff8-442e-879e-f6c5dbb2aa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.588782 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b92b7-1ff8-442e-879e-f6c5dbb2aa6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.589068 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b92b7-1ff8-442e-879e-f6c5dbb2aa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.589348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b92b7-1ff8-442e-879e-f6c5dbb2aa6f admin admin] PATH_INFO: `/v3/projects/61b987d3312b42abbe4f5512aee6a0a8/users/7791b825f4274af19051fd0fd884274f/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.595743 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 807/1595] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:37.596827 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcda7c0-73b4-4d4b-b7f0-5b0fa3a8dd2b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.604028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b92b7-1ff8-442e-879e-f6c5dbb2aa6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b987d3312b42abbe4f5512aee6a0a8, user_id=7791b825f4274af19051fd0fd884274f, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.606857 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b92b7-1ff8-442e-879e-f6c5dbb2aa6f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.608192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcda7c0-73b4-4d4b-b7f0-5b0fa3a8dd2b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.614789 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789159ae-52e2-4ef0-8afa-829dd40628b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.615830 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789159ae-52e2-4ef0-8afa-829dd40628b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.616132 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789159ae-52e2-4ef0-8afa-829dd40628b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.616417 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789159ae-52e2-4ef0-8afa-829dd40628b8 admin admin] PATH_INFO: `/v3/projects/7e714d3b079746cb93c43211fa32f4cf/users/a75c3db54eca4c809941efcfbf4751af/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.621440 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 789/1596] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:37:37 2022] PUT /identity/v3/projects/61b987d3312b42abbe4f5512aee6a0a8/users/7791b825f4274af19051fd0fd884274f/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:37.622745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdc3a5-4dc2-460e-b1f6-e02bb088bb0a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.623035 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdc3a5-4dc2-460e-b1f6-e02bb088bb0a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.623310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdc3a5-4dc2-460e-b1f6-e02bb088bb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.632592 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789159ae-52e2-4ef0-8afa-829dd40628b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e714d3b079746cb93c43211fa32f4cf, user_id=a75c3db54eca4c809941efcfbf4751af, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.635541 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789159ae-52e2-4ef0-8afa-829dd40628b8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.649319 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 808/1597] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:37:37 2022] PUT /identity/v3/projects/7e714d3b079746cb93c43211fa32f4cf/users/a75c3db54eca4c809941efcfbf4751af/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:37.650640 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ce910-bc9c-4813-92bd-7fcdbecb2535 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.650931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ce910-bc9c-4813-92bd-7fcdbecb2535 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.651210 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ce910-bc9c-4813-92bd-7fcdbecb2535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.659773 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-81bdc3a5-4dc2-460e-b1f6-e02bb088bb0a None None] MFA Rules not processed for user `80206583b4b44187a17e58a7eedbba96`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:37.661042 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-81bdc3a5-4dc2-460e-b1f6-e02bb088bb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:37.672896 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-738ce910-bc9c-4813-92bd-7fcdbecb2535 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:37.674340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-738ce910-bc9c-4813-92bd-7fcdbecb2535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:37.687084 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:37.709502 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:37.734543 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 790/1598] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:37.734543 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdc3a5-4dc2-460e-b1f6-e02bb088bb0a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.738392 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 809/1599] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:37.739409 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ce910-bc9c-4813-92bd-7fcdbecb2535 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.746770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdc3a5-4dc2-460e-b1f6-e02bb088bb0a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.749420 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ce910-bc9c-4813-92bd-7fcdbecb2535 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.752274 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61257120-0a20-4637-ad9e-411e570f725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.753327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61257120-0a20-4637-ad9e-411e570f725e admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.753614 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61257120-0a20-4637-ad9e-411e570f725e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.753896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61257120-0a20-4637-ad9e-411e570f725e admin admin] PATH_INFO: `/v3/projects/fd7dfc1ffcf143ae9dd22bd06d7643d2/users/6d08856f94db4b26b084a04c796983d9/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.754318 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e883c81-1f56-41ef-8dc6-9a0ef8fe4d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.754983 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e883c81-1f56-41ef-8dc6-9a0ef8fe4d26 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.755268 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e883c81-1f56-41ef-8dc6-9a0ef8fe4d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.755549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e883c81-1f56-41ef-8dc6-9a0ef8fe4d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.756280 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e883c81-1f56-41ef-8dc6-9a0ef8fe4d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.757895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e883c81-1f56-41ef-8dc6-9a0ef8fe4d26 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.767983 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 810/1600] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:37.768825 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e883c81-1f56-41ef-8dc6-9a0ef8fe4d26 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.769170 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61257120-0a20-4637-ad9e-411e570f725e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd7dfc1ffcf143ae9dd22bd06d7643d2, user_id=6d08856f94db4b26b084a04c796983d9, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.771889 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61257120-0a20-4637-ad9e-411e570f725e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.781262 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e883c81-1f56-41ef-8dc6-9a0ef8fe4d26 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.785940 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 791/1601] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:37:37 2022] PUT /identity/v3/projects/fd7dfc1ffcf143ae9dd22bd06d7643d2/users/6d08856f94db4b26b084a04c796983d9/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:37.787395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61257120-0a20-4637-ad9e-411e570f725e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.849074 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9d94a-418f-49fb-ab0a-934dbd1d8575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.849750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9d94a-418f-49fb-ab0a-934dbd1d8575 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.850036 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9d94a-418f-49fb-ab0a-934dbd1d8575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.850345 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9d94a-418f-49fb-ab0a-934dbd1d8575 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.851070 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9d94a-418f-49fb-ab0a-934dbd1d8575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.852680 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9d94a-418f-49fb-ab0a-934dbd1d8575 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.859788 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61257120-0a20-4637-ad9e-411e570f725e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.863137 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 811/1602] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:37.863137 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90a56d-1323-405b-b62f-f6fcfc47665d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.863137 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90a56d-1323-405b-b62f-f6fcfc47665d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.863137 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90a56d-1323-405b-b62f-f6fcfc47665d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.868564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c05815-cc4e-4e53-ab3b-e698adc65847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.869464 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c05815-cc4e-4e53-ab3b-e698adc65847 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.869754 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c05815-cc4e-4e53-ab3b-e698adc65847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.870034 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c05815-cc4e-4e53-ab3b-e698adc65847 admin admin] PATH_INFO: `/v3/projects/bf59c1987dee428bb706f058c9c93a09/users/abca8080d1754da9911faf411b3230fb/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.882442 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7c90a56d-1323-405b-b62f-f6fcfc47665d None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:37.883724 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7c90a56d-1323-405b-b62f-f6fcfc47665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:37.885271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c05815-cc4e-4e53-ab3b-e698adc65847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf59c1987dee428bb706f058c9c93a09, user_id=abca8080d1754da9911faf411b3230fb, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.888152 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c05815-cc4e-4e53-ab3b-e698adc65847 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:37.891923 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 812/1603] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:37.894050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb9d6d-dd90-4839-b56b-9911ddab0f46 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.894419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb9d6d-dd90-4839-b56b-9911ddab0f46 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.894778 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb9d6d-dd90-4839-b56b-9911ddab0f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.903431 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 792/1604] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:37:37 2022] PUT /identity/v3/projects/bf59c1987dee428bb706f058c9c93a09/users/abca8080d1754da9911faf411b3230fb/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:37.904519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c05815-cc4e-4e53-ab3b-e698adc65847 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:37.926423 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7ddb9d6d-dd90-4839-b56b-9911ddab0f46 None None] MFA Rules not processed for user `a75c3db54eca4c809941efcfbf4751af`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:37.927772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7ddb9d6d-dd90-4839-b56b-9911ddab0f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:37.973730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c05815-cc4e-4e53-ab3b-e698adc65847 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:37.979277 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1bf90-5492-4f22-a008-3e220969a851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:37.979965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1bf90-5492-4f22-a008-3e220969a851 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:37.980247 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1bf90-5492-4f22-a008-3e220969a851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:37.980511 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1bf90-5492-4f22-a008-3e220969a851 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:37.981195 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1bf90-5492-4f22-a008-3e220969a851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:37.983124 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1bf90-5492-4f22-a008-3e220969a851 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:38.001416 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 813/1605] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:38.001416 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb9d6d-dd90-4839-b56b-9911ddab0f46 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:38.013443 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 793/1606] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:37:37 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:38.014470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1bf90-5492-4f22-a008-3e220969a851 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:38.026794 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:38.057956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:38.061830 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb9d6d-dd90-4839-b56b-9911ddab0f46 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:38.087864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1bf90-5492-4f22-a008-3e220969a851 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:38.092718 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682c17f-27bb-4f4b-933a-32f2149e0882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:38.093723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682c17f-27bb-4f4b-933a-32f2149e0882 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:38.094014 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682c17f-27bb-4f4b-933a-32f2149e0882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:38.094362 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682c17f-27bb-4f4b-933a-32f2149e0882 admin admin] PATH_INFO: `/v3/projects/1dd117ba2f1f4695bc89e420278a487c/users/a63509391b174805b4ae58b53195a44c/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:38.110660 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682c17f-27bb-4f4b-933a-32f2149e0882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dd117ba2f1f4695bc89e420278a487c, user_id=a63509391b174805b4ae58b53195a44c, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:38.114225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682c17f-27bb-4f4b-933a-32f2149e0882 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:38.114784 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5139efd-470f-49b2-9db5-a0af1d703696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:38.115488 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5139efd-470f-49b2-9db5-a0af1d703696 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:38.115779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5139efd-470f-49b2-9db5-a0af1d703696 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:38.116166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5139efd-470f-49b2-9db5-a0af1d703696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:38.126547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5139efd-470f-49b2-9db5-a0af1d703696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:38.128053 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5139efd-470f-49b2-9db5-a0af1d703696 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:38.128427 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 794/1607] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:37:38 2022] PUT /identity/v3/projects/1dd117ba2f1f4695bc89e420278a487c/users/a63509391b174805b4ae58b53195a44c/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:38.129698 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660015f7-f670-40e0-a70d-6a15e12dc953 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:38.129983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660015f7-f670-40e0-a70d-6a15e12dc953 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:38.130278 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660015f7-f670-40e0-a70d-6a15e12dc953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:38.138426 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 814/1608] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:37:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:38.138680 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5139efd-470f-49b2-9db5-a0af1d703696 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:38.148301 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5139efd-470f-49b2-9db5-a0af1d703696 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:38.166260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-660015f7-f670-40e0-a70d-6a15e12dc953 None None] MFA Rules not processed for user `6d08856f94db4b26b084a04c796983d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:38.167976 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-660015f7-f670-40e0-a70d-6a15e12dc953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:38.219105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682378d-4fe3-4553-8001-bdbc0cc1c86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:38.220328 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682378d-4fe3-4553-8001-bdbc0cc1c86e admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:38.220687 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682378d-4fe3-4553-8001-bdbc0cc1c86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:38.221140 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682378d-4fe3-4553-8001-bdbc0cc1c86e admin admin] PATH_INFO: `/v3/projects/527ea619c82c44b88f135a6639191464/users/f63aac7e7e0a458b8469bf0fd251daab/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:38.239190 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682378d-4fe3-4553-8001-bdbc0cc1c86e admin admin] RBAC: Authorizing `identity:create_grant(project_id=527ea619c82c44b88f135a6639191464, user_id=f63aac7e7e0a458b8469bf0fd251daab, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:38.242163 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682378d-4fe3-4553-8001-bdbc0cc1c86e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:38.243740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 795/1609] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:38.244764 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660015f7-f670-40e0-a70d-6a15e12dc953 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:38.263047 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 815/1610] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:37:38 2022] PUT /identity/v3/projects/527ea619c82c44b88f135a6639191464/users/f63aac7e7e0a458b8469bf0fd251daab/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:38.265004 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60ad33-55cd-4c6b-baa2-b474c0b25522 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:38.265303 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60ad33-55cd-4c6b-baa2-b474c0b25522 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:38.265811 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60ad33-55cd-4c6b-baa2-b474c0b25522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:38.286745 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3c60ad33-55cd-4c6b-baa2-b474c0b25522 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:38.288003 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3c60ad33-55cd-4c6b-baa2-b474c0b25522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:38.317818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660015f7-f670-40e0-a70d-6a15e12dc953 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:38.364491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:38.376422 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 816/1611] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:38.377025 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60ad33-55cd-4c6b-baa2-b474c0b25522 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:38.388472 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60ad33-55cd-4c6b-baa2-b474c0b25522 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:38.392363 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932e2b4-8fb0-4563-8319-993599511f0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:38.393842 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932e2b4-8fb0-4563-8319-993599511f0b service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:38.394173 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932e2b4-8fb0-4563-8319-993599511f0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:38.394585 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932e2b4-8fb0-4563-8319-993599511f0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:38.395038 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98623611-f6f8-4f48-ad98-5190f14d0925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:38.396140 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98623611-f6f8-4f48-ad98-5190f14d0925 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:38.396623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98623611-f6f8-4f48-ad98-5190f14d0925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:38.396906 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98623611-f6f8-4f48-ad98-5190f14d0925 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:38.397673 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98623611-f6f8-4f48-ad98-5190f14d0925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:38.399721 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98623611-f6f8-4f48-ad98-5190f14d0925 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:38.405173 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932e2b4-8fb0-4563-8319-993599511f0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:38.406976 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932e2b4-8fb0-4563-8319-993599511f0b service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:38.431985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 796/1612] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:37:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:38.435834 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 817/1613] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:37:38 2022] POST /identity/v3/users => generated 291 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:38.435972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a92669-fa2c-4b23-8669-9d0e72ca0f20 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:38.435972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a92669-fa2c-4b23-8669-9d0e72ca0f20 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:38.436195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622e751-081f-4605-a44c-412424648799 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:38.436303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a92669-fa2c-4b23-8669-9d0e72ca0f20 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:38.436383 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622e751-081f-4605-a44c-412424648799 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:38.436383 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622e751-081f-4605-a44c-412424648799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:38.436526 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 797/1614] 10.222.0.39 () {54 vars in 961 bytes} [Thu Jul 14 15:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:37:38.436856 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a92669-fa2c-4b23-8669-9d0e72ca0f20 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:38.458643 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4622e751-081f-4605-a44c-412424648799 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:38.459883 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4622e751-081f-4605-a44c-412424648799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:38.462444 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a92669-fa2c-4b23-8669-9d0e72ca0f20 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:38.470632 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ee015-7a3c-4c0d-9225-c91358ba594a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:38.471351 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ee015-7a3c-4c0d-9225-c91358ba594a admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:38.471891 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ee015-7a3c-4c0d-9225-c91358ba594a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:38.472065 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ee015-7a3c-4c0d-9225-c91358ba594a admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:38.472775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ee015-7a3c-4c0d-9225-c91358ba594a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:38.474922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ee015-7a3c-4c0d-9225-c91358ba594a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:38.475210 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 818/1615] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:38.477111 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21e716-43f1-4bf6-9113-8d131f9dd3c6 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:38.477702 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21e716-43f1-4bf6-9113-8d131f9dd3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:38.478254 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21e716-43f1-4bf6-9113-8d131f9dd3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:38.501033 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:38.509152 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 798/1616] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:37:38 2022] POST /identity/v3/projects => generated 363 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:38.510126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ee015-7a3c-4c0d-9225-c91358ba594a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:38.512881 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-393ee015-7a3c-4c0d-9225-c91358ba594a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:38.529558 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-cf21e716-43f1-4bf6-9113-8d131f9dd3c6 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:38.531443 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cf21e716-43f1-4bf6-9113-8d131f9dd3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:38.639583 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ee015-7a3c-4c0d-9225-c91358ba594a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:38.644090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6514ebb-e582-4a3e-9ee8-077c2da221db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:38.645073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6514ebb-e582-4a3e-9ee8-077c2da221db service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:38.645937 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6514ebb-e582-4a3e-9ee8-077c2da221db service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:38.645937 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6514ebb-e582-4a3e-9ee8-077c2da221db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:38.647831 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 819/1617] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:38.648784 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21e716-43f1-4bf6-9113-8d131f9dd3c6 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:38.662754 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21e716-43f1-4bf6-9113-8d131f9dd3c6 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:38.667851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6514ebb-e582-4a3e-9ee8-077c2da221db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:38.670061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6514ebb-e582-4a3e-9ee8-077c2da221db service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:38.671999 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4553bb-724d-42d9-befe-006e870133cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:38.672987 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4553bb-724d-42d9-befe-006e870133cd admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:38.673277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4553bb-724d-42d9-befe-006e870133cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:38.673606 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4553bb-724d-42d9-befe-006e870133cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:38.675308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4553bb-724d-42d9-befe-006e870133cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:38.677370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4553bb-724d-42d9-befe-006e870133cd admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:38.685532 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 799/1618] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:37:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:38.688248 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9dc5f-f5bc-4394-b094-41984e31c467 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:38.688709 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9dc5f-f5bc-4394-b094-41984e31c467 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:38.689001 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9dc5f-f5bc-4394-b094-41984e31c467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:38.692332 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 820/1619] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:38.693482 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4553bb-724d-42d9-befe-006e870133cd admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:38.707285 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4553bb-724d-42d9-befe-006e870133cd admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:38.714179 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcd063-0eed-4314-a3d3-323744f952a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:38.715003 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcd063-0eed-4314-a3d3-323744f952a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:38.715133 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcd063-0eed-4314-a3d3-323744f952a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:38.715419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afcd063-0eed-4314-a3d3-323744f952a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:38.728163 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afcd063-0eed-4314-a3d3-323744f952a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:38.730311 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afcd063-0eed-4314-a3d3-323744f952a9 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:38.743723 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 821/1620] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:37:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:38.744876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcd063-0eed-4314-a3d3-323744f952a9 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:38.745153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-52c9dc5f-f5bc-4394-b094-41984e31c467 None None] MFA Rules not processed for user `64f6b597a47c4a0eb08d1eabc4c0305c`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:38.746883 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-52c9dc5f-f5bc-4394-b094-41984e31c467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:38.755159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afcd063-0eed-4314-a3d3-323744f952a9 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:38.762176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34861b55-7bea-4f19-bb23-05e72f19d713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:38.763094 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34861b55-7bea-4f19-bb23-05e72f19d713 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:38.763825 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34861b55-7bea-4f19-bb23-05e72f19d713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:38.764112 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34861b55-7bea-4f19-bb23-05e72f19d713 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:38.765074 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34861b55-7bea-4f19-bb23-05e72f19d713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:38.768127 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34861b55-7bea-4f19-bb23-05e72f19d713 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:38.798628 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 822/1621] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:37:38 2022] POST /identity/v3/users => generated 288 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:38.804599 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34861b55-7bea-4f19-bb23-05e72f19d713 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:38.817951 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34861b55-7bea-4f19-bb23-05e72f19d713 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:38.824760 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebae28-c36f-48b0-84d6-be4e470d6293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:38.825841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebae28-c36f-48b0-84d6-be4e470d6293 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:38.826365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebae28-c36f-48b0-84d6-be4e470d6293 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:38.826764 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebae28-c36f-48b0-84d6-be4e470d6293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:38.838492 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 800/1622] 10.222.0.39 () {58 vars in 1058 bytes} [Thu Jul 14 15:37:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:38.840656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebae28-c36f-48b0-84d6-be4e470d6293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:38.842353 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebae28-c36f-48b0-84d6-be4e470d6293 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:38.849100 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9dc5f-f5bc-4394-b094-41984e31c467 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:38.858545 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 823/1623] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:37:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:38.859585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebae28-c36f-48b0-84d6-be4e470d6293 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:38.861554 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9dc5f-f5bc-4394-b094-41984e31c467 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:38.870517 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a5ce9-e4ce-4f77-888c-4089d6979c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:38.871570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a5ce9-e4ce-4f77-888c-4089d6979c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:38.871963 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a5ce9-e4ce-4f77-888c-4089d6979c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:38.872854 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a5ce9-e4ce-4f77-888c-4089d6979c80 admin admin] PATH_INFO: `/v3/projects/d35f4f930db64b9f885e1a42d4605ae9/users/b71892eaf15449189a96444be92a0077/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:38.886787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebae28-c36f-48b0-84d6-be4e470d6293 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:38.894357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a5ce9-e4ce-4f77-888c-4089d6979c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35f4f930db64b9f885e1a42d4605ae9, user_id=b71892eaf15449189a96444be92a0077, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:38.894914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a77aa8-4097-49e1-8e51-fe93e83d7432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:38.895875 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a77aa8-4097-49e1-8e51-fe93e83d7432 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:38.896271 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a77aa8-4097-49e1-8e51-fe93e83d7432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:38.896622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a77aa8-4097-49e1-8e51-fe93e83d7432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:38.897361 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a5ce9-e4ce-4f77-888c-4089d6979c80 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:38.898299 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a77aa8-4097-49e1-8e51-fe93e83d7432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:38.900360 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a77aa8-4097-49e1-8e51-fe93e83d7432 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:38.914511 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 801/1624] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:37:38 2022] PUT /identity/v3/projects/d35f4f930db64b9f885e1a42d4605ae9/users/b71892eaf15449189a96444be92a0077/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:38.918577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a5ce9-e4ce-4f77-888c-4089d6979c80 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:38.921078 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 824/1625] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:38.922013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a77aa8-4097-49e1-8e51-fe93e83d7432 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:38.933857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a77aa8-4097-49e1-8e51-fe93e83d7432 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:38.944094 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:39.015758 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2230b-6c87-483d-b0fa-0f45b06ced57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:39.017275 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2230b-6c87-483d-b0fa-0f45b06ced57 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.017572 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2230b-6c87-483d-b0fa-0f45b06ced57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.018211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2230b-6c87-483d-b0fa-0f45b06ced57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.019647 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2230b-6c87-483d-b0fa-0f45b06ced57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:39.021888 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2230b-6c87-483d-b0fa-0f45b06ced57 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:39.030573 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a5ce9-e4ce-4f77-888c-4089d6979c80 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:39.037436 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 825/1626] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:39.038821 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2230b-6c87-483d-b0fa-0f45b06ced57 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:39.041198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434be4e-4329-4f7b-b30f-b24de4e5e5e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:39.042449 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434be4e-4329-4f7b-b30f-b24de4e5e5e1 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.042937 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434be4e-4329-4f7b-b30f-b24de4e5e5e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.043126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434be4e-4329-4f7b-b30f-b24de4e5e5e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.054478 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2230b-6c87-483d-b0fa-0f45b06ced57 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:39.060660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6702c43-0670-4003-8db7-0e38db8a28e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:39.061653 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6702c43-0670-4003-8db7-0e38db8a28e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.062201 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6702c43-0670-4003-8db7-0e38db8a28e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.062621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6702c43-0670-4003-8db7-0e38db8a28e0 admin admin] PATH_INFO: `/v3/projects/7b5d1aff55b845c896c82cbaf631a40e/users/589246e75ae64efcb366a61538704bcd/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.084595 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6702c43-0670-4003-8db7-0e38db8a28e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5d1aff55b845c896c82cbaf631a40e, user_id=589246e75ae64efcb366a61538704bcd, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:39.088384 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6702c43-0670-4003-8db7-0e38db8a28e0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:39.120924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 826/1627] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:37:39 2022] PUT /identity/v3/projects/7b5d1aff55b845c896c82cbaf631a40e/users/589246e75ae64efcb366a61538704bcd/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:39.122100 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6702c43-0670-4003-8db7-0e38db8a28e0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:39.131703 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434be4e-4329-4f7b-b30f-b24de4e5e5e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:39.135637 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434be4e-4329-4f7b-b30f-b24de4e5e5e1 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:39.147605 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:39.164339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 802/1628] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:37:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:39.170924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434be4e-4329-4f7b-b30f-b24de4e5e5e1 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:39.201326 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434be4e-4329-4f7b-b30f-b24de4e5e5e1 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:39.239825 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6702c43-0670-4003-8db7-0e38db8a28e0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:39.247706 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee653ef-4487-4f6d-a1d9-fbb0ccbcae2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:39.247706 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee653ef-4487-4f6d-a1d9-fbb0ccbcae2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.247706 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee653ef-4487-4f6d-a1d9-fbb0ccbcae2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.247706 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee653ef-4487-4f6d-a1d9-fbb0ccbcae2b admin admin] PATH_INFO: `/v3/projects/d35f4f930db64b9f885e1a42d4605ae9/users/b71892eaf15449189a96444be92a0077/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.250595 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee653ef-4487-4f6d-a1d9-fbb0ccbcae2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35f4f930db64b9f885e1a42d4605ae9, user_id=b71892eaf15449189a96444be92a0077, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:39.254317 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee653ef-4487-4f6d-a1d9-fbb0ccbcae2b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:39.281374 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 827/1629] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:37:39 2022] PUT /identity/v3/projects/d35f4f930db64b9f885e1a42d4605ae9/users/b71892eaf15449189a96444be92a0077/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:39.283195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ffe90-3b1b-4761-b30d-de1500506131 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.283489 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ffe90-3b1b-4761-b30d-de1500506131 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.284298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ffe90-3b1b-4761-b30d-de1500506131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.346982 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af92b1-7a56-499e-83b4-9001279eb9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:39.347837 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af92b1-7a56-499e-83b4-9001279eb9ae admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.348227 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af92b1-7a56-499e-83b4-9001279eb9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.348606 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af92b1-7a56-499e-83b4-9001279eb9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.349462 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af92b1-7a56-499e-83b4-9001279eb9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:39.351229 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af92b1-7a56-499e-83b4-9001279eb9ae admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:39.357629 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-763ffe90-3b1b-4761-b30d-de1500506131 None None] MFA Rules not processed for user `b71892eaf15449189a96444be92a0077`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:39.359245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-763ffe90-3b1b-4761-b30d-de1500506131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:39.379339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 803/1630] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:39.383626 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af92b1-7a56-499e-83b4-9001279eb9ae admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:39.399973 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af92b1-7a56-499e-83b4-9001279eb9ae admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:39.490923 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 828/1631] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:39 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:39.498036 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ffe90-3b1b-4761-b30d-de1500506131 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:39.508262 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:39.538789 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352873d-003c-4ae3-a88b-09cc172d3b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:39.539785 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352873d-003c-4ae3-a88b-09cc172d3b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.540152 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352873d-003c-4ae3-a88b-09cc172d3b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.540498 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352873d-003c-4ae3-a88b-09cc172d3b94 admin admin] PATH_INFO: `/v3/projects/7b5d1aff55b845c896c82cbaf631a40e/users/589246e75ae64efcb366a61538704bcd/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.547222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352873d-003c-4ae3-a88b-09cc172d3b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5d1aff55b845c896c82cbaf631a40e, user_id=589246e75ae64efcb366a61538704bcd, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:39.552415 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352873d-003c-4ae3-a88b-09cc172d3b94 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:39.579653 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 804/1632] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:37:39 2022] PUT /identity/v3/projects/7b5d1aff55b845c896c82cbaf631a40e/users/589246e75ae64efcb366a61538704bcd/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:37:39.582434 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2089c7-d6f5-45e8-b1b7-6016ef7782a0 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.582953 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2089c7-d6f5-45e8-b1b7-6016ef7782a0 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.583438 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2089c7-d6f5-45e8-b1b7-6016ef7782a0 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.585117 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 805/1633] 10.222.0.39 () {54 vars in 912 bytes} [Thu Jul 14 15:37:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:37:39.596805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303569f-8788-45c1-9626-8c95e06c9296 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.599690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303569f-8788-45c1-9626-8c95e06c9296 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.599981 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303569f-8788-45c1-9626-8c95e06c9296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.615592 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ffe90-3b1b-4761-b30d-de1500506131 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:39.701045 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-1303569f-8788-45c1-9626-8c95e06c9296 None None] MFA Rules not processed for user `589246e75ae64efcb366a61538704bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:39.702587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1303569f-8788-45c1-9626-8c95e06c9296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:39.758126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:39.770599 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed62cc-5efa-4711-b0ad-5a0b26601370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:39.771251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed62cc-5efa-4711-b0ad-5a0b26601370 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.771534 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed62cc-5efa-4711-b0ad-5a0b26601370 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.771812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed62cc-5efa-4711-b0ad-5a0b26601370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.866485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 806/1634] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:39 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:39.869404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fb78e-c261-4997-8b95-4fab33907ae0 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.869881 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fb78e-c261-4997-8b95-4fab33907ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.870417 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fb78e-c261-4997-8b95-4fab33907ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.893921 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ad8fb78e-c261-4997-8b95-4fab33907ae0 None None] MFA Rules not processed for user `64f6b597a47c4a0eb08d1eabc4c0305c`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:39.895328 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ad8fb78e-c261-4997-8b95-4fab33907ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:39.915872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed62cc-5efa-4711-b0ad-5a0b26601370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:39.918948 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed62cc-5efa-4711-b0ad-5a0b26601370 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:39.938630 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 829/1635] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:37:39 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:39.939633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed62cc-5efa-4711-b0ad-5a0b26601370 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:39.951200 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed62cc-5efa-4711-b0ad-5a0b26601370 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:39.961112 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee1f9f-cb76-4e16-ab40-8c05a70a05b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:39.961910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee1f9f-cb76-4e16-ab40-8c05a70a05b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:39.963717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee1f9f-cb76-4e16-ab40-8c05a70a05b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:39.964014 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee1f9f-cb76-4e16-ab40-8c05a70a05b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:39.992294 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee1f9f-cb76-4e16-ab40-8c05a70a05b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:39.998170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee1f9f-cb76-4e16-ab40-8c05a70a05b7 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:40.031085 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 830/1636] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:37:39 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:40.034557 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 807/1637] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jul 14 15:37:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:40.072849 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee1f9f-cb76-4e16-ab40-8c05a70a05b7 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:40.088439 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee1f9f-cb76-4e16-ab40-8c05a70a05b7 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:40.093860 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d6a65-b23a-4a0b-bbbb-b1d5dbf6ba83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:40.094786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d6a65-b23a-4a0b-bbbb-b1d5dbf6ba83 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:40.095323 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d6a65-b23a-4a0b-bbbb-b1d5dbf6ba83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:40.095757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d6a65-b23a-4a0b-bbbb-b1d5dbf6ba83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:40.112075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d6a65-b23a-4a0b-bbbb-b1d5dbf6ba83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:40.114815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d6a65-b23a-4a0b-bbbb-b1d5dbf6ba83 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:40.144853 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 831/1638] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:37:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:41.541172 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fb78e-c261-4997-8b95-4fab33907ae0 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:41.675773 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fb78e-c261-4997-8b95-4fab33907ae0 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:41.688834 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f9480-f71d-42b6-bf06-50c2025c5ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:41.689966 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f9480-f71d-42b6-bf06-50c2025c5ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:41.690324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f9480-f71d-42b6-bf06-50c2025c5ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:41.690433 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f9480-f71d-42b6-bf06-50c2025c5ba4 admin admin] PATH_INFO: `/v3/users/6d08856f94db4b26b084a04c796983d9` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:41.694753 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f9480-f71d-42b6-bf06-50c2025c5ba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d08856f94db4b26b084a04c796983d9)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:41.696038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: WARNING py.warnings [None req-3c8f9480-f71d-42b6-bf06-50c2025c5ba4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:37:41.696038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: warnings.warn(msg) Jul 14 15:37:41.696038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: Jul 14 15:37:41.697482 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f9480-f71d-42b6-bf06-50c2025c5ba4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:41.709747 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:41.728855 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f07a5f-5852-4992-acce-6e29bae82a0f None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:41.729721 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f07a5f-5852-4992-acce-6e29bae82a0f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:41.729721 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f07a5f-5852-4992-acce-6e29bae82a0f None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:41.731051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 832/1639] 10.222.0.39 () {54 vars in 961 bytes} [Thu Jul 14 15:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:37:41.752879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b28af1-f202-4632-842b-1d5b1a56b10c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:41.753216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b28af1-f202-4632-842b-1d5b1a56b10c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:41.753513 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b28af1-f202-4632-842b-1d5b1a56b10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:41.797774 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d4b28af1-f202-4632-842b-1d5b1a56b10c None None] MFA Rules not processed for user `64f6b597a47c4a0eb08d1eabc4c0305c`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:41.806861 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d4b28af1-f202-4632-842b-1d5b1a56b10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:41.833987 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 833/1640] 10.222.0.39 () {58 vars in 1058 bytes} [Thu Jul 14 15:37:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:41.841315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d4dff-ae82-443f-bedb-6ae16840b371 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:41.841868 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d4dff-ae82-443f-bedb-6ae16840b371 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:41.842353 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d4dff-ae82-443f-bedb-6ae16840b371 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:41.844193 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 834/1641] 10.222.0.39 () {54 vars in 912 bytes} [Thu Jul 14 15:37:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:37:41.850896 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580fdd9-e5a7-4e13-885c-eba10c419d30 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:41.851184 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580fdd9-e5a7-4e13-885c-eba10c419d30 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:41.851464 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580fdd9-e5a7-4e13-885c-eba10c419d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:41.863788 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3c8f9480-f71d-42b6-bf06-50c2025c5ba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d08856f94db4b26b084a04c796983d9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:41.879978 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3c8f9480-f71d-42b6-bf06-50c2025c5ba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d08856f94db4b26b084a04c796983d9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:41.904095 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7580fdd9-e5a7-4e13-885c-eba10c419d30 None None] MFA Rules not processed for user `64f6b597a47c4a0eb08d1eabc4c0305c`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:41.905669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7580fdd9-e5a7-4e13-885c-eba10c419d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:41.907165 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3c8f9480-f71d-42b6-bf06-50c2025c5ba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d08856f94db4b26b084a04c796983d9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:41.918042 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3c8f9480-f71d-42b6-bf06-50c2025c5ba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d08856f94db4b26b084a04c796983d9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:41.919339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3c8f9480-f71d-42b6-bf06-50c2025c5ba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d08856f94db4b26b084a04c796983d9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:41.930186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 808/1642] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:37:41 2022] DELETE /identity/v3/users/6d08856f94db4b26b084a04c796983d9 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:41.934394 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ac4fa-5656-4be3-9bcf-aefc81ef6ffc None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:41.934855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ac4fa-5656-4be3-9bcf-aefc81ef6ffc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:41.935390 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ac4fa-5656-4be3-9bcf-aefc81ef6ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:41.941840 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 835/1643] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jul 14 15:37:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:37:41.966514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ca8ac4fa-5656-4be3-9bcf-aefc81ef6ffc None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:41.968347 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ca8ac4fa-5656-4be3-9bcf-aefc81ef6ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:41.969543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580fdd9-e5a7-4e13-885c-eba10c419d30 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:41.971887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7580fdd9-e5a7-4e13-885c-eba10c419d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:41.999293 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580fdd9-e5a7-4e13-885c-eba10c419d30 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:42.074749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 809/1644] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:42.126519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7ed95-f0eb-4fe4-8219-1a927fed1111 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:42.127861 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7ed95-f0eb-4fe4-8219-1a927fed1111 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:42.128440 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7ed95-f0eb-4fe4-8219-1a927fed1111 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:42.128956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7ed95-f0eb-4fe4-8219-1a927fed1111 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:42.148896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ac4fa-5656-4be3-9bcf-aefc81ef6ffc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:42.152007 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ca8ac4fa-5656-4be3-9bcf-aefc81ef6ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:42.289837 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7ed95-f0eb-4fe4-8219-1a927fed1111 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:42.292083 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7ed95-f0eb-4fe4-8219-1a927fed1111 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:42.298856 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ac4fa-5656-4be3-9bcf-aefc81ef6ffc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:42.304583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:42.304751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92177df9-ffc2-4a65-9f11-a942887b1a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:42.305432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92177df9-ffc2-4a65-9f11-a942887b1a21 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:42.305740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92177df9-ffc2-4a65-9f11-a942887b1a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:42.305964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92177df9-ffc2-4a65-9f11-a942887b1a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:42.324704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 836/1645] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:37:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:37:42.344852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92177df9-ffc2-4a65-9f11-a942887b1a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:42.349523 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92177df9-ffc2-4a65-9f11-a942887b1a21 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:42.379780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 810/1646] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:37:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:37:43.119015 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7ed95-f0eb-4fe4-8219-1a927fed1111 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:43.120822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-80f7ed95-f0eb-4fe4-8219-1a927fed1111 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:43.204046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7ed95-f0eb-4fe4-8219-1a927fed1111 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:43.224633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77b2bf-ebb4-41f2-9728-49df924ea092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:43.226266 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77b2bf-ebb4-41f2-9728-49df924ea092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:43.228768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77b2bf-ebb4-41f2-9728-49df924ea092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:43.229272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77b2bf-ebb4-41f2-9728-49df924ea092 admin admin] PATH_INFO: `/v3/users/80206583b4b44187a17e58a7eedbba96` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:43.231277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77b2bf-ebb4-41f2-9728-49df924ea092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80206583b4b44187a17e58a7eedbba96)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:43.234852 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77b2bf-ebb4-41f2-9728-49df924ea092 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:43.366978 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ea77b2bf-ebb4-41f2-9728-49df924ea092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80206583b4b44187a17e58a7eedbba96'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:43.372697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ea77b2bf-ebb4-41f2-9728-49df924ea092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80206583b4b44187a17e58a7eedbba96'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:43.385790 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ea77b2bf-ebb4-41f2-9728-49df924ea092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80206583b4b44187a17e58a7eedbba96'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:43.399074 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ea77b2bf-ebb4-41f2-9728-49df924ea092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80206583b4b44187a17e58a7eedbba96'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:43.458821 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ea77b2bf-ebb4-41f2-9728-49df924ea092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80206583b4b44187a17e58a7eedbba96'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:43.472394 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 837/1647] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:37:43 2022] DELETE /identity/v3/users/80206583b4b44187a17e58a7eedbba96 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:43.476602 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e39f20-fa1c-44fc-a03b-84115be0f9a5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:43.477115 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e39f20-fa1c-44fc-a03b-84115be0f9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:43.477200 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e39f20-fa1c-44fc-a03b-84115be0f9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:43.581472 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-74e39f20-fa1c-44fc-a03b-84115be0f9a5 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:43.585831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-74e39f20-fa1c-44fc-a03b-84115be0f9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:43.644976 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:43.716440 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 811/1648] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:43.762849 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77b2bf-ebb4-41f2-9728-49df924ea092 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:43.764516 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ea77b2bf-ebb4-41f2-9728-49df924ea092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:43.767515 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e39f20-fa1c-44fc-a03b-84115be0f9a5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:43.772150 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-74e39f20-fa1c-44fc-a03b-84115be0f9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:43.793221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77b2bf-ebb4-41f2-9728-49df924ea092 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:43.808564 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb0819-8781-4924-95b2-117c63173319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:43.810810 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb0819-8781-4924-95b2-117c63173319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:43.811096 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb0819-8781-4924-95b2-117c63173319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:43.811373 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb0819-8781-4924-95b2-117c63173319 admin admin] PATH_INFO: `/v3/projects/fd7dfc1ffcf143ae9dd22bd06d7643d2` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:43.815355 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb0819-8781-4924-95b2-117c63173319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd7dfc1ffcf143ae9dd22bd06d7643d2)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:43.817611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: WARNING py.warnings [None req-badb0819-8781-4924-95b2-117c63173319 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:37:43.817611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: warnings.warn(msg) Jul 14 15:37:43.817611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: Jul 14 15:37:43.821179 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb0819-8781-4924-95b2-117c63173319 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:43.925200 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e39f20-fa1c-44fc-a03b-84115be0f9a5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:43.975221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-badb0819-8781-4924-95b2-117c63173319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd7dfc1ffcf143ae9dd22bd06d7643d2', 'request_id': 'req-badb0819-8781-4924-95b2-117c63173319'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:43.999477 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-badb0819-8781-4924-95b2-117c63173319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd7dfc1ffcf143ae9dd22bd06d7643d2', 'request_id': 'req-badb0819-8781-4924-95b2-117c63173319'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:44.001331 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df9af7-1fef-4fa9-b718-a1734bac2056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:44.002020 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df9af7-1fef-4fa9-b718-a1734bac2056 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:44.003355 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df9af7-1fef-4fa9-b718-a1734bac2056 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:44.003652 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df9af7-1fef-4fa9-b718-a1734bac2056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:44.017059 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-badb0819-8781-4924-95b2-117c63173319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd7dfc1ffcf143ae9dd22bd06d7643d2', 'request_id': 'req-badb0819-8781-4924-95b2-117c63173319'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:44.047316 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-badb0819-8781-4924-95b2-117c63173319 admin admin] The token cache is being invalidate because project fd7dfc1ffcf143ae9dd22bd06d7643d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:44.047653 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-badb0819-8781-4924-95b2-117c63173319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:44.048450 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-badb0819-8781-4924-95b2-117c63173319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:44.054051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 838/1649] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:37:43 2022] DELETE /identity/v3/projects/fd7dfc1ffcf143ae9dd22bd06d7643d2 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:44.055905 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb0819-8781-4924-95b2-117c63173319 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:44.058338 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-badb0819-8781-4924-95b2-117c63173319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:44.102561 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df9af7-1fef-4fa9-b718-a1734bac2056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:44.104236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df9af7-1fef-4fa9-b718-a1734bac2056 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:44.124194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 812/1650] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:37:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:37:44.166412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:44.179346 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb0819-8781-4924-95b2-117c63173319 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:44.187076 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18d4cf-66c0-4e3c-a270-526b340dfe8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:44.188258 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18d4cf-66c0-4e3c-a270-526b340dfe8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:44.188550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18d4cf-66c0-4e3c-a270-526b340dfe8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:44.188832 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18d4cf-66c0-4e3c-a270-526b340dfe8b admin admin] PATH_INFO: `/v3/users/589246e75ae64efcb366a61538704bcd` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:44.191319 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18d4cf-66c0-4e3c-a270-526b340dfe8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=589246e75ae64efcb366a61538704bcd)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:44.193610 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18d4cf-66c0-4e3c-a270-526b340dfe8b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:44.271709 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9d18d4cf-66c0-4e3c-a270-526b340dfe8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '589246e75ae64efcb366a61538704bcd'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:44.272599 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9d18d4cf-66c0-4e3c-a270-526b340dfe8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '589246e75ae64efcb366a61538704bcd'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:44.282707 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9d18d4cf-66c0-4e3c-a270-526b340dfe8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '589246e75ae64efcb366a61538704bcd'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:44.296131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9d18d4cf-66c0-4e3c-a270-526b340dfe8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '589246e75ae64efcb366a61538704bcd'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:44.329261 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9d18d4cf-66c0-4e3c-a270-526b340dfe8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '589246e75ae64efcb366a61538704bcd'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:44.355627 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 839/1651] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:37:44 2022] DELETE /identity/v3/users/589246e75ae64efcb366a61538704bcd => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:37:45.204393 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df9af7-1fef-4fa9-b718-a1734bac2056 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:45.206764 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-79df9af7-1fef-4fa9-b718-a1734bac2056 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:45.242192 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df9af7-1fef-4fa9-b718-a1734bac2056 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:45.292449 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:45.367074 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974232e-3d40-4d30-84f3-ce18eacd5cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:45.367971 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974232e-3d40-4d30-84f3-ce18eacd5cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:45.368258 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974232e-3d40-4d30-84f3-ce18eacd5cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:45.368540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974232e-3d40-4d30-84f3-ce18eacd5cf7 admin admin] PATH_INFO: `/v3/projects/1c444fe6a3e04cd1aa2c1795d8ee1235` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:45.369766 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974232e-3d40-4d30-84f3-ce18eacd5cf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c444fe6a3e04cd1aa2c1795d8ee1235)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:45.372005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974232e-3d40-4d30-84f3-ce18eacd5cf7 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:45.510692 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7974232e-3d40-4d30-84f3-ce18eacd5cf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c444fe6a3e04cd1aa2c1795d8ee1235', 'request_id': 'req-7974232e-3d40-4d30-84f3-ce18eacd5cf7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:45.524837 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7974232e-3d40-4d30-84f3-ce18eacd5cf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c444fe6a3e04cd1aa2c1795d8ee1235', 'request_id': 'req-7974232e-3d40-4d30-84f3-ce18eacd5cf7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:45.543069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7974232e-3d40-4d30-84f3-ce18eacd5cf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c444fe6a3e04cd1aa2c1795d8ee1235', 'request_id': 'req-7974232e-3d40-4d30-84f3-ce18eacd5cf7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:45.569815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7974232e-3d40-4d30-84f3-ce18eacd5cf7 admin admin] The token cache is being invalidate because project 1c444fe6a3e04cd1aa2c1795d8ee1235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:45.570147 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7974232e-3d40-4d30-84f3-ce18eacd5cf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:45.571476 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7974232e-3d40-4d30-84f3-ce18eacd5cf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:45.574314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 813/1652] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:37:45 2022] DELETE /identity/v3/projects/1c444fe6a3e04cd1aa2c1795d8ee1235 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:45.578614 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18d4cf-66c0-4e3c-a270-526b340dfe8b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:45.582617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9d18d4cf-66c0-4e3c-a270-526b340dfe8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:45.610050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18d4cf-66c0-4e3c-a270-526b340dfe8b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:45.808626 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215bbc20-c27e-4fb7-aaae-819a9485702f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:45.809920 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bbc20-c27e-4fb7-aaae-819a9485702f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:45.810436 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bbc20-c27e-4fb7-aaae-819a9485702f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:45.815655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bbc20-c27e-4fb7-aaae-819a9485702f admin admin] PATH_INFO: `/v3/users/b71892eaf15449189a96444be92a0077` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:45.820934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215bbc20-c27e-4fb7-aaae-819a9485702f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b71892eaf15449189a96444be92a0077)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:45.824204 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215bbc20-c27e-4fb7-aaae-819a9485702f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:45.953515 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-215bbc20-c27e-4fb7-aaae-819a9485702f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b71892eaf15449189a96444be92a0077'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:45.954279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-215bbc20-c27e-4fb7-aaae-819a9485702f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b71892eaf15449189a96444be92a0077'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:45.969587 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-215bbc20-c27e-4fb7-aaae-819a9485702f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b71892eaf15449189a96444be92a0077'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:45.988064 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-215bbc20-c27e-4fb7-aaae-819a9485702f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b71892eaf15449189a96444be92a0077'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:46.019527 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:46.025166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-215bbc20-c27e-4fb7-aaae-819a9485702f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b71892eaf15449189a96444be92a0077'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:46.047163 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 840/1653] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:37:45 2022] DELETE /identity/v3/users/b71892eaf15449189a96444be92a0077 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:46.714986 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974232e-3d40-4d30-84f3-ce18eacd5cf7 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:46.716609 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7974232e-3d40-4d30-84f3-ce18eacd5cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:46.747134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974232e-3d40-4d30-84f3-ce18eacd5cf7 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:46.969362 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34714f70-d01f-413d-935f-d8da59665626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:46.971539 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34714f70-d01f-413d-935f-d8da59665626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:46.971820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34714f70-d01f-413d-935f-d8da59665626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:46.972095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34714f70-d01f-413d-935f-d8da59665626 admin admin] PATH_INFO: `/v3/projects/7b5d1aff55b845c896c82cbaf631a40e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:46.975078 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34714f70-d01f-413d-935f-d8da59665626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b5d1aff55b845c896c82cbaf631a40e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:46.977520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34714f70-d01f-413d-935f-d8da59665626 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:47.187214 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-34714f70-d01f-413d-935f-d8da59665626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b5d1aff55b845c896c82cbaf631a40e', 'request_id': 'req-34714f70-d01f-413d-935f-d8da59665626'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:47.204272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-34714f70-d01f-413d-935f-d8da59665626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b5d1aff55b845c896c82cbaf631a40e', 'request_id': 'req-34714f70-d01f-413d-935f-d8da59665626'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:47.214591 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:47.216619 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-34714f70-d01f-413d-935f-d8da59665626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b5d1aff55b845c896c82cbaf631a40e', 'request_id': 'req-34714f70-d01f-413d-935f-d8da59665626'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:47.266342 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-34714f70-d01f-413d-935f-d8da59665626 admin admin] The token cache is being invalidate because project 7b5d1aff55b845c896c82cbaf631a40e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:47.266645 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-34714f70-d01f-413d-935f-d8da59665626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:47.275938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-34714f70-d01f-413d-935f-d8da59665626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:47.285840 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 814/1654] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:37:46 2022] DELETE /identity/v3/projects/7b5d1aff55b845c896c82cbaf631a40e => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:47.293671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89a554-b7e9-4753-89a2-ac9efd297210 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:47.294294 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89a554-b7e9-4753-89a2-ac9efd297210 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:47.294378 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89a554-b7e9-4753-89a2-ac9efd297210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:47.347708 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6b89a554-b7e9-4753-89a2-ac9efd297210 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:47.349811 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6b89a554-b7e9-4753-89a2-ac9efd297210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:47.502724 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 841/1655] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:47.511101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d8ada-775a-4810-8b99-e8479823833a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:47.511740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d8ada-775a-4810-8b99-e8479823833a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:47.512494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d8ada-775a-4810-8b99-e8479823833a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:47.554920 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-316d8ada-775a-4810-8b99-e8479823833a None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:47.556289 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-316d8ada-775a-4810-8b99-e8479823833a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:47.579307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 815/1656] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:47.586273 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89a554-b7e9-4753-89a2-ac9efd297210 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:47.607706 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89a554-b7e9-4753-89a2-ac9efd297210 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:47.637161 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5a618-24a7-4c50-a7cc-2219cabcfc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:47.637886 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5a618-24a7-4c50-a7cc-2219cabcfc8f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:47.640359 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5a618-24a7-4c50-a7cc-2219cabcfc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:47.640699 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5a618-24a7-4c50-a7cc-2219cabcfc8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:47.641497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5a618-24a7-4c50-a7cc-2219cabcfc8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:47.641820 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5a618-24a7-4c50-a7cc-2219cabcfc8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:47.652510 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5a618-24a7-4c50-a7cc-2219cabcfc8f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:47.683593 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 842/1657] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:47.687875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d8ada-775a-4810-8b99-e8479823833a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:47.708037 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d8ada-775a-4810-8b99-e8479823833a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:47.723019 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5fe7a-1481-442e-ae53-711b668ccd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:47.730872 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5fe7a-1481-442e-ae53-711b668ccd6e admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:47.731601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5fe7a-1481-442e-ae53-711b668ccd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:47.732135 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5fe7a-1481-442e-ae53-711b668ccd6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:47.733303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5fe7a-1481-442e-ae53-711b668ccd6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:47.738001 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5fe7a-1481-442e-ae53-711b668ccd6e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:47.837305 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 816/1658] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:37:47 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:47.839531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5a618-24a7-4c50-a7cc-2219cabcfc8f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:47.854538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5a618-24a7-4c50-a7cc-2219cabcfc8f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:48.022870 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e74be-88fe-49f0-acf2-d2e67bb41e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:48.023569 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e74be-88fe-49f0-acf2-d2e67bb41e52 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:48.023914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e74be-88fe-49f0-acf2-d2e67bb41e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:48.024122 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e74be-88fe-49f0-acf2-d2e67bb41e52 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:48.024849 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e74be-88fe-49f0-acf2-d2e67bb41e52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:48.027034 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e74be-88fe-49f0-acf2-d2e67bb41e52 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:48.077056 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 843/1659] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:37:47 2022] POST /identity/v3/users => generated 288 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:48.083196 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5fe7a-1481-442e-ae53-711b668ccd6e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:48.102130 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5fe7a-1481-442e-ae53-711b668ccd6e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:48.132185 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698e277-14e3-4c68-880a-dc391ba5a93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:48.133708 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698e277-14e3-4c68-880a-dc391ba5a93e admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:48.136574 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698e277-14e3-4c68-880a-dc391ba5a93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:48.137383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698e277-14e3-4c68-880a-dc391ba5a93e admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:48.138662 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698e277-14e3-4c68-880a-dc391ba5a93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:48.140977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698e277-14e3-4c68-880a-dc391ba5a93e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:48.180795 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 817/1660] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:37:48.184199 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e74be-88fe-49f0-acf2-d2e67bb41e52 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:48.203912 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e74be-88fe-49f0-acf2-d2e67bb41e52 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:48.219628 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116c22f-0bab-472a-862f-7c1d4397a527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:48.220390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116c22f-0bab-472a-862f-7c1d4397a527 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:48.221218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116c22f-0bab-472a-862f-7c1d4397a527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:48.221504 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116c22f-0bab-472a-862f-7c1d4397a527 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:48.222720 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116c22f-0bab-472a-862f-7c1d4397a527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:48.226025 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116c22f-0bab-472a-862f-7c1d4397a527 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:48.255310 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 844/1661] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:48.256550 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698e277-14e3-4c68-880a-dc391ba5a93e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:48.275830 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698e277-14e3-4c68-880a-dc391ba5a93e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:48.294531 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb466ac5-6619-49c0-b24d-7d534879f85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:48.295634 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb466ac5-6619-49c0-b24d-7d534879f85a admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:48.296093 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb466ac5-6619-49c0-b24d-7d534879f85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:48.296535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb466ac5-6619-49c0-b24d-7d534879f85a admin admin] PATH_INFO: `/v3/projects/13addd5926c045e7a9d4b7d1924bf908/users/f5578fb4c3ad4225a85bc271ea363993/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:48.349344 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb466ac5-6619-49c0-b24d-7d534879f85a admin admin] RBAC: Authorizing `identity:create_grant(project_id=13addd5926c045e7a9d4b7d1924bf908, user_id=f5578fb4c3ad4225a85bc271ea363993, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:48.357685 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb466ac5-6619-49c0-b24d-7d534879f85a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:48.407018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 818/1662] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:37:48 2022] PUT /identity/v3/projects/13addd5926c045e7a9d4b7d1924bf908/users/f5578fb4c3ad4225a85bc271ea363993/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:48.420401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c216b69-7f91-4831-8a7d-e7096cc19746 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:48.420967 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c216b69-7f91-4831-8a7d-e7096cc19746 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:48.435799 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c216b69-7f91-4831-8a7d-e7096cc19746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:48.498573 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7c216b69-7f91-4831-8a7d-e7096cc19746 None None] MFA Rules not processed for user `f5578fb4c3ad4225a85bc271ea363993`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:48.499843 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7c216b69-7f91-4831-8a7d-e7096cc19746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:48.600536 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c02696-06eb-4704-93a7-5c56c7c9cb8a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:48.600829 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c02696-06eb-4704-93a7-5c56c7c9cb8a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:48.601120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c02696-06eb-4704-93a7-5c56c7c9cb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:48.613509 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:48.662552 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 845/1663] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:48.666649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c216b69-7f91-4831-8a7d-e7096cc19746 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:48.673369 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7c216b69-7f91-4831-8a7d-e7096cc19746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:48.683580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f5c02696-06eb-4704-93a7-5c56c7c9cb8a None None] MFA Rules not processed for user `c7527df3bd954e939aa9dc63d7664e30`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:48.685398 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f5c02696-06eb-4704-93a7-5c56c7c9cb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:48.805187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 819/1664] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:48.805187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c02696-06eb-4704-93a7-5c56c7c9cb8a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:48.822891 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c216b69-7f91-4831-8a7d-e7096cc19746 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:48.831293 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757524e-87f4-425b-bca8-9104e750b08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:48.832371 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757524e-87f4-425b-bca8-9104e750b08f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:48.832802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757524e-87f4-425b-bca8-9104e750b08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:48.833762 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757524e-87f4-425b-bca8-9104e750b08f admin admin] PATH_INFO: `/v3/projects/d35f4f930db64b9f885e1a42d4605ae9` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:48.836186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757524e-87f4-425b-bca8-9104e750b08f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d35f4f930db64b9f885e1a42d4605ae9)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:48.840198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757524e-87f4-425b-bca8-9104e750b08f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:48.943090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c02696-06eb-4704-93a7-5c56c7c9cb8a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:48.971786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8757524e-87f4-425b-bca8-9104e750b08f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd35f4f930db64b9f885e1a42d4605ae9', 'request_id': 'req-8757524e-87f4-425b-bca8-9104e750b08f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:48.984029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:49.002979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8757524e-87f4-425b-bca8-9104e750b08f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd35f4f930db64b9f885e1a42d4605ae9', 'request_id': 'req-8757524e-87f4-425b-bca8-9104e750b08f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:49.015666 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8757524e-87f4-425b-bca8-9104e750b08f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd35f4f930db64b9f885e1a42d4605ae9', 'request_id': 'req-8757524e-87f4-425b-bca8-9104e750b08f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:49.040134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8757524e-87f4-425b-bca8-9104e750b08f admin admin] The token cache is being invalidate because project d35f4f930db64b9f885e1a42d4605ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:49.040443 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8757524e-87f4-425b-bca8-9104e750b08f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:49.041166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8757524e-87f4-425b-bca8-9104e750b08f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:49.043182 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 846/1665] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:37:48 2022] DELETE /identity/v3/projects/d35f4f930db64b9f885e1a42d4605ae9 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:49.044559 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0f90d-1a1c-48f9-b4b9-726c2cc531a4 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:49.044859 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0f90d-1a1c-48f9-b4b9-726c2cc531a4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:49.045142 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0f90d-1a1c-48f9-b4b9-726c2cc531a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:49.066873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40012559-9e1a-46ae-b318-e3b818196b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:49.067695 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40012559-9e1a-46ae-b318-e3b818196b58 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:49.068086 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40012559-9e1a-46ae-b318-e3b818196b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:49.068463 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40012559-9e1a-46ae-b318-e3b818196b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:49.069631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40012559-9e1a-46ae-b318-e3b818196b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:49.074215 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40012559-9e1a-46ae-b318-e3b818196b58 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:49.099267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-1ef0f90d-1a1c-48f9-b4b9-726c2cc531a4 None None] MFA Rules not processed for user `c7527df3bd954e939aa9dc63d7664e30`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:49.102802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1ef0f90d-1a1c-48f9-b4b9-726c2cc531a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:49.120725 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 820/1666] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:37:48 2022] POST /identity/v3/projects => generated 375 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:49.124455 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b363fb1-35ac-49c9-ada2-037dbbf50d56 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:49.125801 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b363fb1-35ac-49c9-ada2-037dbbf50d56 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:49.125801 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b363fb1-35ac-49c9-ada2-037dbbf50d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:49.188653 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8b363fb1-35ac-49c9-ada2-037dbbf50d56 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:49.190290 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8b363fb1-35ac-49c9-ada2-037dbbf50d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:49.274823 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 847/1667] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:49.275717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0f90d-1a1c-48f9-b4b9-726c2cc531a4 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:49.279071 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1ef0f90d-1a1c-48f9-b4b9-726c2cc531a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:49.312159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0f90d-1a1c-48f9-b4b9-726c2cc531a4 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:49.362060 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:49.366741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 821/1668] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:49.370460 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b363fb1-35ac-49c9-ada2-037dbbf50d56 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:49.384009 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8b363fb1-35ac-49c9-ada2-037dbbf50d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:49.466237 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0372ac2-47e5-46d6-86b3-31115b409940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:49.468437 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0372ac2-47e5-46d6-86b3-31115b409940 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:49.468739 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0372ac2-47e5-46d6-86b3-31115b409940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:49.469025 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0372ac2-47e5-46d6-86b3-31115b409940 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:49.472938 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0372ac2-47e5-46d6-86b3-31115b409940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:49.475166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0372ac2-47e5-46d6-86b3-31115b409940 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:49.522988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 848/1669] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:37:49 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:49.524819 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fade5-5446-4fd2-99bf-f06a0a19b301 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:49.525159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fade5-5446-4fd2-99bf-f06a0a19b301 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:49.525448 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fade5-5446-4fd2-99bf-f06a0a19b301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:49.570827 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f62fade5-5446-4fd2-99bf-f06a0a19b301 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:49.574986 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f62fade5-5446-4fd2-99bf-f06a0a19b301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:49.578202 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b363fb1-35ac-49c9-ada2-037dbbf50d56 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:49.591524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 849/1670] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:49.592294 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7ffb8-f724-42a3-9eb0-c7f62e5e7456 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:49.593146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7ffb8-f724-42a3-9eb0-c7f62e5e7456 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:49.593440 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7ffb8-f724-42a3-9eb0-c7f62e5e7456 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:49.594633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fade5-5446-4fd2-99bf-f06a0a19b301 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:49.595624 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7ffb8-f724-42a3-9eb0-c7f62e5e7456 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:49.602795 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f7b7ffb8-f724-42a3-9eb0-c7f62e5e7456 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:49.616456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fade5-5446-4fd2-99bf-f06a0a19b301 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:49.639417 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51a025-1618-4b56-bd54-5688e2e2b544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:49.643112 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51a025-1618-4b56-bd54-5688e2e2b544 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:49.643691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51a025-1618-4b56-bd54-5688e2e2b544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:49.643989 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51a025-1618-4b56-bd54-5688e2e2b544 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:49.644784 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51a025-1618-4b56-bd54-5688e2e2b544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:49.650742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51a025-1618-4b56-bd54-5688e2e2b544 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:49.670530 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 850/1671] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:49.670530 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51a025-1618-4b56-bd54-5688e2e2b544 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:49.693187 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51a025-1618-4b56-bd54-5688e2e2b544 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:49.712702 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:49.714609 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bf8dc-9264-433b-9361-009765532de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:49.716174 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bf8dc-9264-433b-9361-009765532de1 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:49.716726 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bf8dc-9264-433b-9361-009765532de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:49.718281 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bf8dc-9264-433b-9361-009765532de1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:49.719159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bf8dc-9264-433b-9361-009765532de1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:49.719620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bf8dc-9264-433b-9361-009765532de1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:49.723390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bf8dc-9264-433b-9361-009765532de1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:49.735214 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7ffb8-f724-42a3-9eb0-c7f62e5e7456 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:49.737412 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7ffb8-f724-42a3-9eb0-c7f62e5e7456 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:49.740479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 851/1672] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:49.740479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bf8dc-9264-433b-9361-009765532de1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:49.748480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 822/1673] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:37:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:49.749465 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7ffb8-f724-42a3-9eb0-c7f62e5e7456 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:49.755766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bf8dc-9264-433b-9361-009765532de1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:49.763254 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229040a-a570-40b2-bffa-7a8eecfb6f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:49.764157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229040a-a570-40b2-bffa-7a8eecfb6f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:49.764447 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229040a-a570-40b2-bffa-7a8eecfb6f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:49.764733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229040a-a570-40b2-bffa-7a8eecfb6f94 admin admin] PATH_INFO: `/v3/projects/6d567aece73342f2bb0f76cca72459f6/users/48208c350bec41ea832e2425c06d3cd3/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:49.765109 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7ffb8-f724-42a3-9eb0-c7f62e5e7456 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:49.770989 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f7b45-85aa-4d30-ac27-cdc2d567811d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:49.771925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f7b45-85aa-4d30-ac27-cdc2d567811d admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:49.772319 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f7b45-85aa-4d30-ac27-cdc2d567811d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:49.772729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f7b45-85aa-4d30-ac27-cdc2d567811d admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:49.773670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f7b45-85aa-4d30-ac27-cdc2d567811d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:49.775740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f7b45-85aa-4d30-ac27-cdc2d567811d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:49.783520 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229040a-a570-40b2-bffa-7a8eecfb6f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d567aece73342f2bb0f76cca72459f6, user_id=48208c350bec41ea832e2425c06d3cd3, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:49.786774 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229040a-a570-40b2-bffa-7a8eecfb6f94 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:49.804576 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 852/1674] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:37:49 2022] PUT /identity/v3/projects/6d567aece73342f2bb0f76cca72459f6/users/48208c350bec41ea832e2425c06d3cd3/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:49.808334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229040a-a570-40b2-bffa-7a8eecfb6f94 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:49.815016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 823/1675] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:37:49 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:49.817481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f7b45-85aa-4d30-ac27-cdc2d567811d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:49.968907 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229040a-a570-40b2-bffa-7a8eecfb6f94 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:49.985023 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76c2f7-bf92-435c-9496-518635642e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:49.985851 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76c2f7-bf92-435c-9496-518635642e31 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:49.986216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76c2f7-bf92-435c-9496-518635642e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:49.986685 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76c2f7-bf92-435c-9496-518635642e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:49.989310 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76c2f7-bf92-435c-9496-518635642e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:49.991001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76c2f7-bf92-435c-9496-518635642e31 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:50.000593 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f7b45-85aa-4d30-ac27-cdc2d567811d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:50.013672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f713611-6fb7-4dbe-83a6-f9a32e20647d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:50.014628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f713611-6fb7-4dbe-83a6-f9a32e20647d admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:50.022028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f713611-6fb7-4dbe-83a6-f9a32e20647d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:50.022474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f713611-6fb7-4dbe-83a6-f9a32e20647d admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:50.023220 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f713611-6fb7-4dbe-83a6-f9a32e20647d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:50.028724 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f713611-6fb7-4dbe-83a6-f9a32e20647d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:50.032630 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 853/1676] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:37:50.038031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76c2f7-bf92-435c-9496-518635642e31 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:50.063438 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76c2f7-bf92-435c-9496-518635642e31 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:50.077591 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 824/1677] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:37:49 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:50.082200 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3e4ed-514f-40e4-a6bc-fc2d1451f965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:50.082624 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f713611-6fb7-4dbe-83a6-f9a32e20647d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:50.083318 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3e4ed-514f-40e4-a6bc-fc2d1451f965 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:50.083590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3e4ed-514f-40e4-a6bc-fc2d1451f965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:50.083880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3e4ed-514f-40e4-a6bc-fc2d1451f965 admin admin] PATH_INFO: `/v3/projects/6d567aece73342f2bb0f76cca72459f6/users/48208c350bec41ea832e2425c06d3cd3/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:50.092802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3e4ed-514f-40e4-a6bc-fc2d1451f965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d567aece73342f2bb0f76cca72459f6, user_id=48208c350bec41ea832e2425c06d3cd3, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:50.095828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3e4ed-514f-40e4-a6bc-fc2d1451f965 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:50.116995 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f713611-6fb7-4dbe-83a6-f9a32e20647d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:50.130768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 854/1678] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:37:50 2022] PUT /identity/v3/projects/6d567aece73342f2bb0f76cca72459f6/users/48208c350bec41ea832e2425c06d3cd3/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:50.143475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c136c89-16bd-4b96-87a7-13c1c49a7750 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:50.144245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c136c89-16bd-4b96-87a7-13c1c49a7750 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:50.144552 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c136c89-16bd-4b96-87a7-13c1c49a7750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:50.237265 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4c136c89-16bd-4b96-87a7-13c1c49a7750 None None] MFA Rules not processed for user `48208c350bec41ea832e2425c06d3cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:50.243559 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4c136c89-16bd-4b96-87a7-13c1c49a7750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:50.264249 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118a8e3-09e6-476b-8b8a-0c7a74e92af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:50.264931 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118a8e3-09e6-476b-8b8a-0c7a74e92af0 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:50.265221 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118a8e3-09e6-476b-8b8a-0c7a74e92af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:50.265506 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118a8e3-09e6-476b-8b8a-0c7a74e92af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:50.266287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118a8e3-09e6-476b-8b8a-0c7a74e92af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:50.268103 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118a8e3-09e6-476b-8b8a-0c7a74e92af0 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:50.296730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 825/1679] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:37:50.306464 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118a8e3-09e6-476b-8b8a-0c7a74e92af0 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:50.325879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118a8e3-09e6-476b-8b8a-0c7a74e92af0 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:50.335041 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:50.342159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e936e-7011-40f6-a14e-79aaa3c55222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:50.342900 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e936e-7011-40f6-a14e-79aaa3c55222 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:50.343189 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e936e-7011-40f6-a14e-79aaa3c55222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:50.343471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e936e-7011-40f6-a14e-79aaa3c55222 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:50.344219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e936e-7011-40f6-a14e-79aaa3c55222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:50.347856 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e936e-7011-40f6-a14e-79aaa3c55222 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:50.381638 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 826/1680] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:50.384169 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e936e-7011-40f6-a14e-79aaa3c55222 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:50.409480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e936e-7011-40f6-a14e-79aaa3c55222 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:50.425523 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a79a8-7129-4bb9-b1ca-dda3d4216401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:50.430357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a79a8-7129-4bb9-b1ca-dda3d4216401 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:50.430357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a79a8-7129-4bb9-b1ca-dda3d4216401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:50.430357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a79a8-7129-4bb9-b1ca-dda3d4216401 admin admin] PATH_INFO: `/v3/projects/527ad628791a46d19471f6ac740fd70b/users/fbeedf5fab024147967ed25a20483baa/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:50.434943 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 855/1681] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:37:50.450666 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c136c89-16bd-4b96-87a7-13c1c49a7750 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:50.455771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4c136c89-16bd-4b96-87a7-13c1c49a7750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:50.483292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a79a8-7129-4bb9-b1ca-dda3d4216401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=527ad628791a46d19471f6ac740fd70b, user_id=fbeedf5fab024147967ed25a20483baa, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:50.489245 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a79a8-7129-4bb9-b1ca-dda3d4216401 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:50.530426 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 827/1682] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:37:50 2022] PUT /identity/v3/projects/527ad628791a46d19471f6ac740fd70b/users/fbeedf5fab024147967ed25a20483baa/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:50.531839 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b5dc9-65c5-42e3-8f74-de0e7f3cbd00 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:50.532138 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b5dc9-65c5-42e3-8f74-de0e7f3cbd00 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:50.532420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b5dc9-65c5-42e3-8f74-de0e7f3cbd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:50.582406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:50.590408 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c136c89-16bd-4b96-87a7-13c1c49a7750 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:50.591907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-048b5dc9-65c5-42e3-8f74-de0e7f3cbd00 None None] MFA Rules not processed for user `fbeedf5fab024147967ed25a20483baa`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:50.596201 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-048b5dc9-65c5-42e3-8f74-de0e7f3cbd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:50.669297 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d130fb0-a506-4848-81e3-1b3f3ebf4550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:50.672633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d130fb0-a506-4848-81e3-1b3f3ebf4550 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:50.673274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d130fb0-a506-4848-81e3-1b3f3ebf4550 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:50.675878 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d130fb0-a506-4848-81e3-1b3f3ebf4550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:50.679332 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1d130fb0-a506-4848-81e3-1b3f3ebf4550 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:50.757866 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 828/1683] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:37:50.763627 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b5dc9-65c5-42e3-8f74-de0e7f3cbd00 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:50.813303 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d130fb0-a506-4848-81e3-1b3f3ebf4550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:50.814875 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d130fb0-a506-4848-81e3-1b3f3ebf4550 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:50.836271 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 856/1684] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:37:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:50.923297 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b5dc9-65c5-42e3-8f74-de0e7f3cbd00 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:50.944445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a893f-1e85-4aa6-967b-bd38bfe20fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:50.945139 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a893f-1e85-4aa6-967b-bd38bfe20fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:50.945422 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a893f-1e85-4aa6-967b-bd38bfe20fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:50.945697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a893f-1e85-4aa6-967b-bd38bfe20fb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:50.946434 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a893f-1e85-4aa6-967b-bd38bfe20fb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:50.948404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a893f-1e85-4aa6-967b-bd38bfe20fb4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:51.020839 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 829/1685] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:37:50 2022] POST /identity/v3/projects => generated 385 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:51.024796 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d130fb0-a506-4848-81e3-1b3f3ebf4550 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:51.042880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d130fb0-a506-4848-81e3-1b3f3ebf4550 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:51.138100 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:51.200221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a54e63-9f48-4204-ade3-aa23653a5f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:51.202267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a54e63-9f48-4204-ade3-aa23653a5f4d admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:51.202555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a54e63-9f48-4204-ade3-aa23653a5f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:51.203186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a54e63-9f48-4204-ade3-aa23653a5f4d admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:51.205892 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a54e63-9f48-4204-ade3-aa23653a5f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:51.208535 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a54e63-9f48-4204-ade3-aa23653a5f4d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:51.251239 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde5534-68c1-45f5-b7b4-add0349e4b12 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:51.251239 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde5534-68c1-45f5-b7b4-add0349e4b12 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:51.251416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde5534-68c1-45f5-b7b4-add0349e4b12 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:51.253427 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 830/1686] 10.222.0.39 () {54 vars in 912 bytes} [Thu Jul 14 15:37:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:37:51.281705 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533278f-af42-4acf-904f-0962b86173d7 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:51.282129 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533278f-af42-4acf-904f-0962b86173d7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:51.282327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533278f-af42-4acf-904f-0962b86173d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:51.319639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 857/1687] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:37:51 2022] POST /identity/v3/users => generated 299 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:51.329826 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a54e63-9f48-4204-ade3-aa23653a5f4d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:51.364661 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a54e63-9f48-4204-ade3-aa23653a5f4d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:51.381172 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe627a-19a1-4122-8145-744bfc0899ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:51.381919 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe627a-19a1-4122-8145-744bfc0899ea admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:51.382378 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe627a-19a1-4122-8145-744bfc0899ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:51.382640 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe627a-19a1-4122-8145-744bfc0899ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:51.383623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe627a-19a1-4122-8145-744bfc0899ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:51.386143 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fe627a-19a1-4122-8145-744bfc0899ea admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:51.399143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c533278f-af42-4acf-904f-0962b86173d7 None None] MFA Rules not processed for user `7b82de4816a244c0b62b5f9f894ccaf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:51.400430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c533278f-af42-4acf-904f-0962b86173d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:51.410188 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 858/1688] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:51.414171 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe627a-19a1-4122-8145-744bfc0899ea admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:51.425189 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe627a-19a1-4122-8145-744bfc0899ea admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:51.431439 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55384ab3-36d7-4ec1-ae89-424cacfdde8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:51.432604 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55384ab3-36d7-4ec1-ae89-424cacfdde8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:51.433012 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55384ab3-36d7-4ec1-ae89-424cacfdde8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:51.433391 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55384ab3-36d7-4ec1-ae89-424cacfdde8c admin admin] PATH_INFO: `/v3/projects/2d8e102aa22b449e80e2f9a561f6e537/users/49bbe975424e43db9d6564702496ccac/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:51.467851 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55384ab3-36d7-4ec1-ae89-424cacfdde8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8e102aa22b449e80e2f9a561f6e537, user_id=49bbe975424e43db9d6564702496ccac, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:51.475066 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55384ab3-36d7-4ec1-ae89-424cacfdde8c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:51.514925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 859/1689] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:37:51 2022] PUT /identity/v3/projects/2d8e102aa22b449e80e2f9a561f6e537/users/49bbe975424e43db9d6564702496ccac/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:51.519509 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55384ab3-36d7-4ec1-ae89-424cacfdde8c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:51.616518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 831/1690] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jul 14 15:37:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:37:51.679011 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55384ab3-36d7-4ec1-ae89-424cacfdde8c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:51.699384 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a98130-5303-4f1b-82ef-97a8800507e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:51.699384 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a98130-5303-4f1b-82ef-97a8800507e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:51.699384 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a98130-5303-4f1b-82ef-97a8800507e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:51.699730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a98130-5303-4f1b-82ef-97a8800507e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:51.701541 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a98130-5303-4f1b-82ef-97a8800507e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:51.707455 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a98130-5303-4f1b-82ef-97a8800507e1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:51.764347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 860/1691] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:51.769109 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533278f-af42-4acf-904f-0962b86173d7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:51.787254 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533278f-af42-4acf-904f-0962b86173d7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:51.801712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b788cc-8e9c-4585-912d-d9c10eab878c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:51.802751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b788cc-8e9c-4585-912d-d9c10eab878c admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:51.802994 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b788cc-8e9c-4585-912d-d9c10eab878c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:51.803438 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b788cc-8e9c-4585-912d-d9c10eab878c admin admin] PATH_INFO: `/v3/projects/2d8e102aa22b449e80e2f9a561f6e537/users/49bbe975424e43db9d6564702496ccac/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:51.811643 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b788cc-8e9c-4585-912d-d9c10eab878c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8e102aa22b449e80e2f9a561f6e537, user_id=49bbe975424e43db9d6564702496ccac, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:51.814941 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b788cc-8e9c-4585-912d-d9c10eab878c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:51.850989 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 832/1692] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:37:51 2022] PUT /identity/v3/projects/2d8e102aa22b449e80e2f9a561f6e537/users/49bbe975424e43db9d6564702496ccac/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:51.863603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8f2b4-1d71-4cb4-af03-a8f0f4183c6b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:51.864898 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8f2b4-1d71-4cb4-af03-a8f0f4183c6b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:51.865568 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8f2b4-1d71-4cb4-af03-a8f0f4183c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:51.914746 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f3a8f2b4-1d71-4cb4-af03-a8f0f4183c6b None None] MFA Rules not processed for user `49bbe975424e43db9d6564702496ccac`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:51.917185 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f3a8f2b4-1d71-4cb4-af03-a8f0f4183c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:52.110639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 861/1693] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:52.119730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b788cc-8e9c-4585-912d-d9c10eab878c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:52.151620 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:52.271278 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b788cc-8e9c-4585-912d-d9c10eab878c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:52.278533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cdaa5-d0ac-4df9-a57b-63593a9fb10f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:52.279795 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cdaa5-d0ac-4df9-a57b-63593a9fb10f service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:52.280130 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cdaa5-d0ac-4df9-a57b-63593a9fb10f service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:52.280416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cdaa5-d0ac-4df9-a57b-63593a9fb10f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:52.295929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8f2b4-1d71-4cb4-af03-a8f0f4183c6b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:52.297378 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f3a8f2b4-1d71-4cb4-af03-a8f0f4183c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:52.303233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cdaa5-d0ac-4df9-a57b-63593a9fb10f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:52.305184 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cdaa5-d0ac-4df9-a57b-63593a9fb10f service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:52.327065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:52.331676 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 833/1694] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:37:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:52.446692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8f2b4-1d71-4cb4-af03-a8f0f4183c6b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:52.457571 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027bc11d-636c-4ed4-b194-9c94aa01fdb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:52.458294 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bc11d-636c-4ed4-b194-9c94aa01fdb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:52.458583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bc11d-636c-4ed4-b194-9c94aa01fdb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:52.458871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bc11d-636c-4ed4-b194-9c94aa01fdb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:52.484777 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027bc11d-636c-4ed4-b194-9c94aa01fdb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:52.487341 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027bc11d-636c-4ed4-b194-9c94aa01fdb1 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:52.511616 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 862/1695] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:37:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:52.518710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cdaa5-d0ac-4df9-a57b-63593a9fb10f service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:52.655211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cdaa5-d0ac-4df9-a57b-63593a9fb10f service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:52.669540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5be373-a363-4e04-8f96-f8ec8e081382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:52.670470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5be373-a363-4e04-8f96-f8ec8e081382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:52.670754 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5be373-a363-4e04-8f96-f8ec8e081382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:52.673258 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5be373-a363-4e04-8f96-f8ec8e081382 admin admin] PATH_INFO: `/v3/users/fbeedf5fab024147967ed25a20483baa` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:52.676002 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5be373-a363-4e04-8f96-f8ec8e081382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbeedf5fab024147967ed25a20483baa)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:52.678167 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5be373-a363-4e04-8f96-f8ec8e081382 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:52.775611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cf5be373-a363-4e04-8f96-f8ec8e081382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbeedf5fab024147967ed25a20483baa'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:52.801309 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cf5be373-a363-4e04-8f96-f8ec8e081382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbeedf5fab024147967ed25a20483baa'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:52.821836 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cf5be373-a363-4e04-8f96-f8ec8e081382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbeedf5fab024147967ed25a20483baa'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:52.858495 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cf5be373-a363-4e04-8f96-f8ec8e081382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbeedf5fab024147967ed25a20483baa'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:52.859652 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-cf5be373-a363-4e04-8f96-f8ec8e081382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbeedf5fab024147967ed25a20483baa'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:52.872087 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 834/1696] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:37:52 2022] DELETE /identity/v3/users/fbeedf5fab024147967ed25a20483baa => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:52.876274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a12408-bf15-4a47-96b2-ac80681bef5a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:52.878202 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a12408-bf15-4a47-96b2-ac80681bef5a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:52.878712 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a12408-bf15-4a47-96b2-ac80681bef5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:52.929828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-92a12408-bf15-4a47-96b2-ac80681bef5a None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:52.931133 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-92a12408-bf15-4a47-96b2-ac80681bef5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:53.108005 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 863/1697] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:53.166677 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5be373-a363-4e04-8f96-f8ec8e081382 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:53.168293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cf5be373-a363-4e04-8f96-f8ec8e081382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:53.261799 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:53.345181 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5be373-a363-4e04-8f96-f8ec8e081382 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:53.353553 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83dddd-c412-4627-bcbf-f41009374ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:53.354533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83dddd-c412-4627-bcbf-f41009374ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:53.354533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83dddd-c412-4627-bcbf-f41009374ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:53.354858 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83dddd-c412-4627-bcbf-f41009374ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:53.377992 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83dddd-c412-4627-bcbf-f41009374ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:53.379526 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83dddd-c412-4627-bcbf-f41009374ad6 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:53.402612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 835/1698] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:37:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:53.736115 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142db2d-fa6a-488b-9848-9d50b0b20d21 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:53.738063 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142db2d-fa6a-488b-9848-9d50b0b20d21 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:53.739052 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142db2d-fa6a-488b-9848-9d50b0b20d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:53.801414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4142db2d-fa6a-488b-9848-9d50b0b20d21 None None] MFA Rules not processed for user `7791b825f4274af19051fd0fd884274f`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:53.805972 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4142db2d-fa6a-488b-9848-9d50b0b20d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:53.985943 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 864/1699] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:54.000138 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83dddd-c412-4627-bcbf-f41009374ad6 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:54.001610 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4f83dddd-c412-4627-bcbf-f41009374ad6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:54.159789 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83dddd-c412-4627-bcbf-f41009374ad6 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:54.171018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d7f1a-fe87-4f01-99a3-49e919816c07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:54.171702 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d7f1a-fe87-4f01-99a3-49e919816c07 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:54.172050 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d7f1a-fe87-4f01-99a3-49e919816c07 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:54.172595 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d7f1a-fe87-4f01-99a3-49e919816c07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:54.212606 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d7f1a-fe87-4f01-99a3-49e919816c07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:54.216571 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d7f1a-fe87-4f01-99a3-49e919816c07 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:54.261720 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 836/1700] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:37:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:54.838177 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc09b4c-fdb5-49b6-9c2c-4ac5a9d4cbee None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:54.839159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc09b4c-fdb5-49b6-9c2c-4ac5a9d4cbee None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:54.839582 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc09b4c-fdb5-49b6-9c2c-4ac5a9d4cbee None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:54.841165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 865/1701] 10.222.0.39 () {54 vars in 960 bytes} [Thu Jul 14 15:37:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:37:54.847652 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a0f78-3558-4ad8-8d27-54fd8d59d667 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:54.848220 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a0f78-3558-4ad8-8d27-54fd8d59d667 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:54.848719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a0f78-3558-4ad8-8d27-54fd8d59d667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:54.878201 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc09b4c-fdb5-49b6-9c2c-4ac5a9d4cbee None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:54.881213 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8fc09b4c-fdb5-49b6-9c2c-4ac5a9d4cbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:54.900259 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-778a0f78-3558-4ad8-8d27-54fd8d59d667 None None] MFA Rules not processed for user `1d1dbca57a4c43ce9bc37c2303417d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:54.904127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-778a0f78-3558-4ad8-8d27-54fd8d59d667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:54.920453 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc09b4c-fdb5-49b6-9c2c-4ac5a9d4cbee None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:54.932218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb2dc8-7a7c-469b-a7ea-9ba77e251492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:54.933473 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb2dc8-7a7c-469b-a7ea-9ba77e251492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:54.938864 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb2dc8-7a7c-469b-a7ea-9ba77e251492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:54.941567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb2dc8-7a7c-469b-a7ea-9ba77e251492 admin admin] PATH_INFO: `/v3/users/a75c3db54eca4c809941efcfbf4751af` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:54.943409 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb2dc8-7a7c-469b-a7ea-9ba77e251492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a75c3db54eca4c809941efcfbf4751af)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:54.956422 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb2dc8-7a7c-469b-a7ea-9ba77e251492 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:55.045191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:55.058394 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5dcb2dc8-7a7c-469b-a7ea-9ba77e251492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a75c3db54eca4c809941efcfbf4751af'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:55.060183 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5dcb2dc8-7a7c-469b-a7ea-9ba77e251492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a75c3db54eca4c809941efcfbf4751af'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:55.095254 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5dcb2dc8-7a7c-469b-a7ea-9ba77e251492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a75c3db54eca4c809941efcfbf4751af'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:55.098182 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 837/1702] 10.222.0.39 () {58 vars in 1057 bytes} [Thu Jul 14 15:37:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:55.099910 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5ed87-d29f-4944-81b8-9fc341a65919 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:55.100382 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5ed87-d29f-4944-81b8-9fc341a65919 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:55.100849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5ed87-d29f-4944-81b8-9fc341a65919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:55.117165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5dcb2dc8-7a7c-469b-a7ea-9ba77e251492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a75c3db54eca4c809941efcfbf4751af'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:55.130755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-4ba5ed87-d29f-4944-81b8-9fc341a65919 None None] MFA Rules not processed for user `c7527df3bd954e939aa9dc63d7664e30`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:55.132285 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4ba5ed87-d29f-4944-81b8-9fc341a65919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:55.156196 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5dcb2dc8-7a7c-469b-a7ea-9ba77e251492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a75c3db54eca4c809941efcfbf4751af'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:55.176108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 866/1703] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:37:54 2022] DELETE /identity/v3/users/a75c3db54eca4c809941efcfbf4751af => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:55.177206 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb2dc8-7a7c-469b-a7ea-9ba77e251492 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:55.262937 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 838/1704] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:55.270145 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baa815-00e6-4c0d-a7f1-d8302e9edd36 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:55.270447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baa815-00e6-4c0d-a7f1-d8302e9edd36 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:55.270726 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17baa815-00e6-4c0d-a7f1-d8302e9edd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:55.286783 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:55.315483 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-17baa815-00e6-4c0d-a7f1-d8302e9edd36 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:55.316811 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-17baa815-00e6-4c0d-a7f1-d8302e9edd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:55.337796 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb2dc8-7a7c-469b-a7ea-9ba77e251492 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:55.352460 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292dc16f-733e-4ad2-88c2-98ecde3957dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:55.353627 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292dc16f-733e-4ad2-88c2-98ecde3957dc service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:55.354338 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292dc16f-733e-4ad2-88c2-98ecde3957dc service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:55.354701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292dc16f-733e-4ad2-88c2-98ecde3957dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:55.356809 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-292dc16f-733e-4ad2-88c2-98ecde3957dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:55.373206 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292dc16f-733e-4ad2-88c2-98ecde3957dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:55.377109 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292dc16f-733e-4ad2-88c2-98ecde3957dc service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:55.396722 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 867/1705] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:37:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:55.563526 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 839/1706] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:55.671345 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292dc16f-733e-4ad2-88c2-98ecde3957dc service placement] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:55.673959 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-292dc16f-733e-4ad2-88c2-98ecde3957dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:55.826844 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292dc16f-733e-4ad2-88c2-98ecde3957dc service placement] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:55.834976 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c4afb-6a8a-4b7e-9ff6-93d4859ad67e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:55.835653 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c4afb-6a8a-4b7e-9ff6-93d4859ad67e service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:55.835943 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c4afb-6a8a-4b7e-9ff6-93d4859ad67e service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:55.836223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c4afb-6a8a-4b7e-9ff6-93d4859ad67e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:55.863318 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c4afb-6a8a-4b7e-9ff6-93d4859ad67e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:55.864801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430c4afb-6a8a-4b7e-9ff6-93d4859ad67e service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:55.901162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 868/1707] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:37:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:56.059430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d3dd9-a055-4d5e-929c-8893f6f9fd4c None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:56.059744 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d3dd9-a055-4d5e-929c-8893f6f9fd4c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:56.060101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d3dd9-a055-4d5e-929c-8893f6f9fd4c None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:56.061846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 840/1708] 10.222.0.39 () {54 vars in 912 bytes} [Thu Jul 14 15:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:37:56.069921 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6516301-4ed0-422c-bd4d-8a8729493386 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:56.070509 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6516301-4ed0-422c-bd4d-8a8729493386 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:56.070509 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6516301-4ed0-422c-bd4d-8a8729493386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:56.100225 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b6516301-4ed0-422c-bd4d-8a8729493386 None None] MFA Rules not processed for user `7b82de4816a244c0b62b5f9f894ccaf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:56.101351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b6516301-4ed0-422c-bd4d-8a8729493386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:56.121240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 869/1709] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jul 14 15:37:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:56.148802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d3dd9-a055-4d5e-929c-8893f6f9fd4c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:56.170816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d3dd9-a055-4d5e-929c-8893f6f9fd4c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:56.179591 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc9b9b-dfe0-44db-bc6f-9df044569bf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:56.180268 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc9b9b-dfe0-44db-bc6f-9df044569bf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:56.180553 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc9b9b-dfe0-44db-bc6f-9df044569bf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:56.180829 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc9b9b-dfe0-44db-bc6f-9df044569bf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:56.211541 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc9b9b-dfe0-44db-bc6f-9df044569bf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:56.213597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc9b9b-dfe0-44db-bc6f-9df044569bf8 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:56.237328 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 841/1710] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:37:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:56.935867 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6516301-4ed0-422c-bd4d-8a8729493386 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:56.937582 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b6516301-4ed0-422c-bd4d-8a8729493386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:56.963432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6516301-4ed0-422c-bd4d-8a8729493386 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:56.982522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5425847-93d8-4f78-b87e-a0aef513feee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:56.983690 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5425847-93d8-4f78-b87e-a0aef513feee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:56.984039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5425847-93d8-4f78-b87e-a0aef513feee admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:56.984386 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5425847-93d8-4f78-b87e-a0aef513feee admin admin] PATH_INFO: `/v3/projects/527ad628791a46d19471f6ac740fd70b` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:56.991028 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5425847-93d8-4f78-b87e-a0aef513feee admin admin] RBAC: Authorizing `identity:delete_project(project_id=527ad628791a46d19471f6ac740fd70b)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:56.993099 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5425847-93d8-4f78-b87e-a0aef513feee admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:57.090260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:57.111657 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d5425847-93d8-4f78-b87e-a0aef513feee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '527ad628791a46d19471f6ac740fd70b', 'request_id': 'req-d5425847-93d8-4f78-b87e-a0aef513feee'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:57.119004 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d5425847-93d8-4f78-b87e-a0aef513feee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '527ad628791a46d19471f6ac740fd70b', 'request_id': 'req-d5425847-93d8-4f78-b87e-a0aef513feee'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:57.137751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d5425847-93d8-4f78-b87e-a0aef513feee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '527ad628791a46d19471f6ac740fd70b', 'request_id': 'req-d5425847-93d8-4f78-b87e-a0aef513feee'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:57.162337 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d5425847-93d8-4f78-b87e-a0aef513feee admin admin] The token cache is being invalidate because project 527ad628791a46d19471f6ac740fd70b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:57.165224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d5425847-93d8-4f78-b87e-a0aef513feee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:57.169590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d5425847-93d8-4f78-b87e-a0aef513feee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:57.174898 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 870/1711] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:37:56 2022] DELETE /identity/v3/projects/527ad628791a46d19471f6ac740fd70b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:57.176561 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc9b9b-dfe0-44db-bc6f-9df044569bf8 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:57.190203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc9b9b-dfe0-44db-bc6f-9df044569bf8 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:57.371760 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59273cfd-6643-4aef-881d-0fcec2291acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:57.373535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59273cfd-6643-4aef-881d-0fcec2291acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:57.374504 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59273cfd-6643-4aef-881d-0fcec2291acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:57.374791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59273cfd-6643-4aef-881d-0fcec2291acf admin admin] PATH_INFO: `/v3/users/49bbe975424e43db9d6564702496ccac` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:57.378863 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59273cfd-6643-4aef-881d-0fcec2291acf admin admin] RBAC: Authorizing `identity:delete_user(user_id=49bbe975424e43db9d6564702496ccac)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:57.380919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59273cfd-6643-4aef-881d-0fcec2291acf admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:57.519969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-59273cfd-6643-4aef-881d-0fcec2291acf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49bbe975424e43db9d6564702496ccac'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:57.543430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-59273cfd-6643-4aef-881d-0fcec2291acf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49bbe975424e43db9d6564702496ccac'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:57.581217 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-59273cfd-6643-4aef-881d-0fcec2291acf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49bbe975424e43db9d6564702496ccac'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:57.599545 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-59273cfd-6643-4aef-881d-0fcec2291acf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49bbe975424e43db9d6564702496ccac'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:57.600784 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-59273cfd-6643-4aef-881d-0fcec2291acf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49bbe975424e43db9d6564702496ccac'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:57.625257 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 842/1712] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:37:57 2022] DELETE /identity/v3/users/49bbe975424e43db9d6564702496ccac => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:57.923840 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5425847-93d8-4f78-b87e-a0aef513feee admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:57.925695 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d5425847-93d8-4f78-b87e-a0aef513feee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:58.053930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59273cfd-6643-4aef-881d-0fcec2291acf admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:58.055481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-59273cfd-6643-4aef-881d-0fcec2291acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:58.081058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:58.106882 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5425847-93d8-4f78-b87e-a0aef513feee admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:58.230970 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59273cfd-6643-4aef-881d-0fcec2291acf admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:58.263939 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a24588-9701-4b04-92b9-1429b078c211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:58.268792 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a24588-9701-4b04-92b9-1429b078c211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:58.269087 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a24588-9701-4b04-92b9-1429b078c211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:58.269364 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a24588-9701-4b04-92b9-1429b078c211 admin admin] PATH_INFO: `/v3/projects/7e714d3b079746cb93c43211fa32f4cf` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:58.271601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a24588-9701-4b04-92b9-1429b078c211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e714d3b079746cb93c43211fa32f4cf)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:58.280847 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a24588-9701-4b04-92b9-1429b078c211 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:58.290291 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6ace4-52a2-4997-a108-c7a0a19d6c3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:58.291230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6ace4-52a2-4997-a108-c7a0a19d6c3d service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:58.291981 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6ace4-52a2-4997-a108-c7a0a19d6c3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:58.292394 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6ace4-52a2-4997-a108-c7a0a19d6c3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:58.302021 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3ec6ace4-52a2-4997-a108-c7a0a19d6c3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:58.419146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73a24588-9701-4b04-92b9-1429b078c211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e714d3b079746cb93c43211fa32f4cf', 'request_id': 'req-73a24588-9701-4b04-92b9-1429b078c211'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:58.439160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73a24588-9701-4b04-92b9-1429b078c211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e714d3b079746cb93c43211fa32f4cf', 'request_id': 'req-73a24588-9701-4b04-92b9-1429b078c211'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:58.457696 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73a24588-9701-4b04-92b9-1429b078c211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e714d3b079746cb93c43211fa32f4cf', 'request_id': 'req-73a24588-9701-4b04-92b9-1429b078c211'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:58.491049 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73a24588-9701-4b04-92b9-1429b078c211 admin admin] The token cache is being invalidate because project 7e714d3b079746cb93c43211fa32f4cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:37:58.491449 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73a24588-9701-4b04-92b9-1429b078c211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:58.492522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-73a24588-9701-4b04-92b9-1429b078c211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:37:58.496635 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 843/1713] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:37:58 2022] DELETE /identity/v3/projects/7e714d3b079746cb93c43211fa32f4cf => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:37:58.508982 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6060a-9510-4c1c-b8a8-3336a8d47ce7 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:58.511730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6060a-9510-4c1c-b8a8-3336a8d47ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:58.512395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6060a-9510-4c1c-b8a8-3336a8d47ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:58.551584 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6ace4-52a2-4997-a108-c7a0a19d6c3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:58.558927 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6ace4-52a2-4997-a108-c7a0a19d6c3d service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:58.561684 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-cdf6060a-9510-4c1c-b8a8-3336a8d47ce7 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:58.563108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cdf6060a-9510-4c1c-b8a8-3336a8d47ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:58.588531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 871/1714] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:37:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:37:58.751466 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 844/1715] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:58.760538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9b57c-cc20-4d2c-91da-a1d5389419f7 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:58.760985 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9b57c-cc20-4d2c-91da-a1d5389419f7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:58.761278 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9b57c-cc20-4d2c-91da-a1d5389419f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:58.859598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7bf9b57c-cc20-4d2c-91da-a1d5389419f7 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:58.868369 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7bf9b57c-cc20-4d2c-91da-a1d5389419f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:58.900756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 872/1716] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:58.905491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6060a-9510-4c1c-b8a8-3336a8d47ce7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:58.920052 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579030a7-3cfb-4e00-9a93-5c79e4114ce0 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:58.920361 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579030a7-3cfb-4e00-9a93-5c79e4114ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:58.923875 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579030a7-3cfb-4e00-9a93-5c79e4114ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:58.930064 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6060a-9510-4c1c-b8a8-3336a8d47ce7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:58.967769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78af61-754a-4aa2-94cf-3ac0c67ab117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:58.970443 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78af61-754a-4aa2-94cf-3ac0c67ab117 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:58.973048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78af61-754a-4aa2-94cf-3ac0c67ab117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:58.975240 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78af61-754a-4aa2-94cf-3ac0c67ab117 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:58.976071 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78af61-754a-4aa2-94cf-3ac0c67ab117 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:37:58.976393 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78af61-754a-4aa2-94cf-3ac0c67ab117 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:58.984001 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78af61-754a-4aa2-94cf-3ac0c67ab117 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:59.042109 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 845/1717] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:37:59.060415 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78af61-754a-4aa2-94cf-3ac0c67ab117 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:59.090743 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78af61-754a-4aa2-94cf-3ac0c67ab117 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:59.099931 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d5e20-9ae9-4656-94f8-bcdf0e3f38c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:59.100414 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d5e20-9ae9-4656-94f8-bcdf0e3f38c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:59.100688 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:59.100790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d5e20-9ae9-4656-94f8-bcdf0e3f38c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:59.100973 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d5e20-9ae9-4656-94f8-bcdf0e3f38c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:59.101716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d5e20-9ae9-4656-94f8-bcdf0e3f38c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:59.103900 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d5e20-9ae9-4656-94f8-bcdf0e3f38c3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:59.121786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-579030a7-3cfb-4e00-9a93-5c79e4114ce0 None None] MFA Rules not processed for user `8103402ac83c4b4191a3ec4d55038e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:37:59.128476 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-579030a7-3cfb-4e00-9a93-5c79e4114ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:59.187412 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 846/1718] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:37:59 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:59.200679 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d5e20-9ae9-4656-94f8-bcdf0e3f38c3 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:59.218573 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:59.537360 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 873/1719] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jul 14 15:37:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 622 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:37:59.543150 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d5e20-9ae9-4656-94f8-bcdf0e3f38c3 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:59.580181 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247ef23-1c06-4d42-b8f5-ddac73789bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:59.581240 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247ef23-1c06-4d42-b8f5-ddac73789bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:59.581526 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247ef23-1c06-4d42-b8f5-ddac73789bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:59.581894 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247ef23-1c06-4d42-b8f5-ddac73789bc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:59.582546 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247ef23-1c06-4d42-b8f5-ddac73789bc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:59.584514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247ef23-1c06-4d42-b8f5-ddac73789bc0 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:59.640561 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 847/1720] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:37:59 2022] POST /identity/v3/users => generated 287 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:37:59.644560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579030a7-3cfb-4e00-9a93-5c79e4114ce0 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:59.661179 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579030a7-3cfb-4e00-9a93-5c79e4114ce0 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:59.686523 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e080cc-1631-46b8-a04f-4759796b4ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:59.687288 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e080cc-1631-46b8-a04f-4759796b4ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:59.687580 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e080cc-1631-46b8-a04f-4759796b4ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:59.687860 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e080cc-1631-46b8-a04f-4759796b4ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:59.702053 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e080cc-1631-46b8-a04f-4759796b4ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:59.703771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e080cc-1631-46b8-a04f-4759796b4ea9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:59.759962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 874/1721] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:59.761276 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247ef23-1c06-4d42-b8f5-ddac73789bc0 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:59.780698 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247ef23-1c06-4d42-b8f5-ddac73789bc0 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:59.802117 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d2c33-6b25-409c-9111-06a18906a8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:59.802962 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d2c33-6b25-409c-9111-06a18906a8ce admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:59.803356 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d2c33-6b25-409c-9111-06a18906a8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:59.803734 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d2c33-6b25-409c-9111-06a18906a8ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:59.807089 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d2c33-6b25-409c-9111-06a18906a8ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:59.808885 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d2c33-6b25-409c-9111-06a18906a8ce admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:37:59.850977 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e080cc-1631-46b8-a04f-4759796b4ea9 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:59.854682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-17e080cc-1631-46b8-a04f-4759796b4ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:37:59.868741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 848/1722] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:37:59.871840 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d2c33-6b25-409c-9111-06a18906a8ce admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:37:59.902696 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d2c33-6b25-409c-9111-06a18906a8ce admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:37:59.915188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d00fd-65e4-4624-9bfc-d8db6710a4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:37:59.916584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d00fd-65e4-4624-9bfc-d8db6710a4d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:37:59.917394 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d00fd-65e4-4624-9bfc-d8db6710a4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:37:59.917394 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d00fd-65e4-4624-9bfc-d8db6710a4d8 admin admin] PATH_INFO: `/v3/projects/ed30c37a188e47b9bd2edb1721fb4450/users/d4aff069d9e24bbc962abd8065867fb4/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:37:59.972938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d00fd-65e4-4624-9bfc-d8db6710a4d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed30c37a188e47b9bd2edb1721fb4450, user_id=d4aff069d9e24bbc962abd8065867fb4, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:37:59.975839 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d00fd-65e4-4624-9bfc-d8db6710a4d8 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:00.014024 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 849/1723] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:37:59 2022] PUT /identity/v3/projects/ed30c37a188e47b9bd2edb1721fb4450/users/d4aff069d9e24bbc962abd8065867fb4/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:00.025018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8d692-97ed-4188-9e0b-0229da947418 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:00.025320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8d692-97ed-4188-9e0b-0229da947418 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:00.025617 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8d692-97ed-4188-9e0b-0229da947418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:00.088887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e080cc-1631-46b8-a04f-4759796b4ea9 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:00.099114 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-53c8d692-97ed-4188-9e0b-0229da947418 None None] MFA Rules not processed for user `d4aff069d9e24bbc962abd8065867fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:00.102469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-53c8d692-97ed-4188-9e0b-0229da947418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:00.233953 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d51e6a-24c2-4328-90cb-af8f831edb01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edbbc94ca71c42c0aac562c8c2ec83db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:00.234931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d51e6a-24c2-4328-90cb-af8f831edb01 service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:00.235733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d51e6a-24c2-4328-90cb-af8f831edb01 service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:00.235733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d51e6a-24c2-4328-90cb-af8f831edb01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:00.264689 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:00.287365 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 850/1724] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:00.288006 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8d692-97ed-4188-9e0b-0229da947418 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:00.295190 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-53c8d692-97ed-4188-9e0b-0229da947418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:00.328559 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d51e6a-24c2-4328-90cb-af8f831edb01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:00.331343 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d51e6a-24c2-4328-90cb-af8f831edb01 service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:00.341361 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 875/1725] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jul 14 15:37:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:38:00.343128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d51e6a-24c2-4328-90cb-af8f831edb01 service swift] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:00.436989 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:00.492661 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8d692-97ed-4188-9e0b-0229da947418 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:00.507264 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3371422-6896-4a3e-8998-b5243a4ac668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:00.509153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3371422-6896-4a3e-8998-b5243a4ac668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:00.509458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3371422-6896-4a3e-8998-b5243a4ac668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:00.509744 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3371422-6896-4a3e-8998-b5243a4ac668 admin admin] PATH_INFO: `/v3/projects/2d8e102aa22b449e80e2f9a561f6e537` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:00.512322 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3371422-6896-4a3e-8998-b5243a4ac668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d8e102aa22b449e80e2f9a561f6e537)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:00.515889 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3371422-6896-4a3e-8998-b5243a4ac668 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:00.526441 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d51e6a-24c2-4328-90cb-af8f831edb01 service swift] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:00.558111 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9518c3-a5ce-4c4f-b854-b30fc28ec57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:00.561342 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9518c3-a5ce-4c4f-b854-b30fc28ec57b admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:00.561633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9518c3-a5ce-4c4f-b854-b30fc28ec57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:00.561949 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9518c3-a5ce-4c4f-b854-b30fc28ec57b admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:00.565456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9518c3-a5ce-4c4f-b854-b30fc28ec57b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:00.571742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9518c3-a5ce-4c4f-b854-b30fc28ec57b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:00.651870 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 876/1726] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:38:00 2022] POST /identity/v3/projects => generated 371 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:00.656906 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9518c3-a5ce-4c4f-b854-b30fc28ec57b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:00.675013 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d3371422-6896-4a3e-8998-b5243a4ac668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d8e102aa22b449e80e2f9a561f6e537', 'request_id': 'req-d3371422-6896-4a3e-8998-b5243a4ac668'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:00.699134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d3371422-6896-4a3e-8998-b5243a4ac668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d8e102aa22b449e80e2f9a561f6e537', 'request_id': 'req-d3371422-6896-4a3e-8998-b5243a4ac668'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:00.717651 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d3371422-6896-4a3e-8998-b5243a4ac668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d8e102aa22b449e80e2f9a561f6e537', 'request_id': 'req-d3371422-6896-4a3e-8998-b5243a4ac668'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:00.752522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d3371422-6896-4a3e-8998-b5243a4ac668 admin admin] The token cache is being invalidate because project 2d8e102aa22b449e80e2f9a561f6e537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:00.752522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d3371422-6896-4a3e-8998-b5243a4ac668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:00.753498 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d3371422-6896-4a3e-8998-b5243a4ac668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:00.755779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 851/1727] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:38:00 2022] DELETE /identity/v3/projects/2d8e102aa22b449e80e2f9a561f6e537 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:00.760653 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f7420-6db6-4438-a228-6f8c4c94a426 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:00.760951 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f7420-6db6-4438-a228-6f8c4c94a426 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:00.761231 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f7420-6db6-4438-a228-6f8c4c94a426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:00.819287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-023f7420-6db6-4438-a228-6f8c4c94a426 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:00.820800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-023f7420-6db6-4438-a228-6f8c4c94a426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:00.836303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 852/1728] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:00.839762 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9518c3-a5ce-4c4f-b854-b30fc28ec57b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:00.844792 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65cffe-5a6b-46a6-98b1-a0ce939557f4 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:00.845275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65cffe-5a6b-46a6-98b1-a0ce939557f4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:00.846298 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65cffe-5a6b-46a6-98b1-a0ce939557f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:00.859284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b820a7e-8653-4bfa-b5cb-ab2be3ef80b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:00.860044 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b820a7e-8653-4bfa-b5cb-ab2be3ef80b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:00.860337 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b820a7e-8653-4bfa-b5cb-ab2be3ef80b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:00.860620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b820a7e-8653-4bfa-b5cb-ab2be3ef80b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:00.861537 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b820a7e-8653-4bfa-b5cb-ab2be3ef80b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:00.866728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b820a7e-8653-4bfa-b5cb-ab2be3ef80b3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:00.891685 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9e65cffe-5a6b-46a6-98b1-a0ce939557f4 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:00.893963 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9e65cffe-5a6b-46a6-98b1-a0ce939557f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:00.931098 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 853/1729] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:00.932198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65cffe-5a6b-46a6-98b1-a0ce939557f4 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:00.954772 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65cffe-5a6b-46a6-98b1-a0ce939557f4 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:00.972821 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e924f8-f5dd-427c-8cd4-dd6489b24950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:00.973523 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e924f8-f5dd-427c-8cd4-dd6489b24950 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:00.973815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e924f8-f5dd-427c-8cd4-dd6489b24950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:00.974118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e924f8-f5dd-427c-8cd4-dd6489b24950 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:00.974881 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e924f8-f5dd-427c-8cd4-dd6489b24950 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:38:00.975197 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e924f8-f5dd-427c-8cd4-dd6489b24950 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:00.976889 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e924f8-f5dd-427c-8cd4-dd6489b24950 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:00.986778 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 877/1730] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:38:00 2022] POST /identity/v3/users => generated 292 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:00.994892 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b820a7e-8653-4bfa-b5cb-ab2be3ef80b3 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:00.996783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4b820a7e-8653-4bfa-b5cb-ab2be3ef80b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:01.037043 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 854/1731] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:01.037886 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b820a7e-8653-4bfa-b5cb-ab2be3ef80b3 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:01.041837 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e924f8-f5dd-427c-8cd4-dd6489b24950 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:01.059784 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda1a58-785d-493c-a795-55b8e1be5c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:01.060538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda1a58-785d-493c-a795-55b8e1be5c30 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:01.061540 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda1a58-785d-493c-a795-55b8e1be5c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:01.061540 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda1a58-785d-493c-a795-55b8e1be5c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:01.066012 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda1a58-785d-493c-a795-55b8e1be5c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:01.068946 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e924f8-f5dd-427c-8cd4-dd6489b24950 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:01.077589 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda1a58-785d-493c-a795-55b8e1be5c30 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:01.083617 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197920c-eebc-4e0e-9806-a9e303ef3e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:01.084320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197920c-eebc-4e0e-9806-a9e303ef3e94 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:01.084607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197920c-eebc-4e0e-9806-a9e303ef3e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:01.084889 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197920c-eebc-4e0e-9806-a9e303ef3e94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:01.098310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197920c-eebc-4e0e-9806-a9e303ef3e94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:01.100292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197920c-eebc-4e0e-9806-a9e303ef3e94 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:01.128455 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 878/1732] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:01.136226 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda1a58-785d-493c-a795-55b8e1be5c30 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:01.182972 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda1a58-785d-493c-a795-55b8e1be5c30 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:01.200606 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 855/1733] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:38:01 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:38:01.201596 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197920c-eebc-4e0e-9806-a9e303ef3e94 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:01.231787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:01.391854 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736f9b1-00a8-400e-b6e4-d33dee8a3f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:01.393727 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736f9b1-00a8-400e-b6e4-d33dee8a3f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:01.397837 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736f9b1-00a8-400e-b6e4-d33dee8a3f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:01.398381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736f9b1-00a8-400e-b6e4-d33dee8a3f08 admin admin] PATH_INFO: `/v3/projects/4197d55569f54781a9029285c46dac28/users/6bf24a2aef3f4feeaf3c61015d27132c/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:01.431488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197920c-eebc-4e0e-9806-a9e303ef3e94 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:01.443676 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff218ae6-cc67-429a-aeb7-eb699c548f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:01.444366 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff218ae6-cc67-429a-aeb7-eb699c548f62 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:01.444664 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff218ae6-cc67-429a-aeb7-eb699c548f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:01.444923 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff218ae6-cc67-429a-aeb7-eb699c548f62 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:01.445683 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff218ae6-cc67-429a-aeb7-eb699c548f62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:01.447646 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff218ae6-cc67-429a-aeb7-eb699c548f62 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:01.458852 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736f9b1-00a8-400e-b6e4-d33dee8a3f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4197d55569f54781a9029285c46dac28, user_id=6bf24a2aef3f4feeaf3c61015d27132c, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:01.462854 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736f9b1-00a8-400e-b6e4-d33dee8a3f08 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:01.481579 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 856/1734] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:38:01 2022] POST /identity/v3/users => generated 291 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:01.485377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff218ae6-cc67-429a-aeb7-eb699c548f62 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:01.498193 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 879/1735] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:38:01 2022] PUT /identity/v3/projects/4197d55569f54781a9029285c46dac28/users/6bf24a2aef3f4feeaf3c61015d27132c/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:01.503733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736f9b1-00a8-400e-b6e4-d33dee8a3f08 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:01.508698 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff218ae6-cc67-429a-aeb7-eb699c548f62 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:01.562686 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:01.625035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736f9b1-00a8-400e-b6e4-d33dee8a3f08 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:01.643595 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200987da-ea56-4985-a45c-6ef893578cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:01.644281 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200987da-ea56-4985-a45c-6ef893578cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:01.644579 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200987da-ea56-4985-a45c-6ef893578cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:01.644857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200987da-ea56-4985-a45c-6ef893578cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:01.645597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200987da-ea56-4985-a45c-6ef893578cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:01.651009 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200987da-ea56-4985-a45c-6ef893578cf8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:01.681342 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 880/1736] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:01.687955 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200987da-ea56-4985-a45c-6ef893578cf8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:01.689585 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e330cc-57f7-4bdc-bfcf-a24b9728babe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:01.693807 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e330cc-57f7-4bdc-bfcf-a24b9728babe admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:01.694127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e330cc-57f7-4bdc-bfcf-a24b9728babe admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:01.694414 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e330cc-57f7-4bdc-bfcf-a24b9728babe admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:01.700946 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e330cc-57f7-4bdc-bfcf-a24b9728babe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:01.703250 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e330cc-57f7-4bdc-bfcf-a24b9728babe admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:01.716925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200987da-ea56-4985-a45c-6ef893578cf8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:01.724587 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c542c1-f58e-490c-bbe3-a09e597423ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:01.729671 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 857/1737] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:01.732486 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c542c1-f58e-490c-bbe3-a09e597423ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:01.732974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c542c1-f58e-490c-bbe3-a09e597423ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:01.733564 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c542c1-f58e-490c-bbe3-a09e597423ce admin admin] PATH_INFO: `/v3/projects/4197d55569f54781a9029285c46dac28/users/6bf24a2aef3f4feeaf3c61015d27132c/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:01.733678 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e330cc-57f7-4bdc-bfcf-a24b9728babe admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:01.736337 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c542c1-f58e-490c-bbe3-a09e597423ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4197d55569f54781a9029285c46dac28, user_id=6bf24a2aef3f4feeaf3c61015d27132c, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:01.740451 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c542c1-f58e-490c-bbe3-a09e597423ce admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:01.753721 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e330cc-57f7-4bdc-bfcf-a24b9728babe admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:01.784800 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 881/1738] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:38:01 2022] PUT /identity/v3/projects/4197d55569f54781a9029285c46dac28/users/6bf24a2aef3f4feeaf3c61015d27132c/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:01.786516 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d1f7b-8174-4776-b903-b76f2c2b61ee None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:01.798756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d1f7b-8174-4776-b903-b76f2c2b61ee None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:01.799184 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d1f7b-8174-4776-b903-b76f2c2b61ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:01.863021 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-906d1f7b-8174-4776-b903-b76f2c2b61ee None None] MFA Rules not processed for user `6bf24a2aef3f4feeaf3c61015d27132c`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:01.867567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-906d1f7b-8174-4776-b903-b76f2c2b61ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:01.883077 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cea1cf-3fde-4328-bf2c-0946b28f0ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:01.888521 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cea1cf-3fde-4328-bf2c-0946b28f0ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:01.888950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cea1cf-3fde-4328-bf2c-0946b28f0ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:01.889330 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cea1cf-3fde-4328-bf2c-0946b28f0ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:01.890221 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cea1cf-3fde-4328-bf2c-0946b28f0ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:01.891971 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cea1cf-3fde-4328-bf2c-0946b28f0ee8 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:01.929177 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 858/1739] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:01.930427 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cea1cf-3fde-4328-bf2c-0946b28f0ee8 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:01.944293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cea1cf-3fde-4328-bf2c-0946b28f0ee8 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:01.952964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc8d2e-2730-47bb-a7e1-50ba9defc25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:01.954509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc8d2e-2730-47bb-a7e1-50ba9defc25a admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:01.955737 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc8d2e-2730-47bb-a7e1-50ba9defc25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:01.956270 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc8d2e-2730-47bb-a7e1-50ba9defc25a admin admin] PATH_INFO: `/v3/projects/5035c31b3c504a99a1aacb99acd47bc0/users/548d6e9dc44841ec91473d9212868213/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:01.991159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc8d2e-2730-47bb-a7e1-50ba9defc25a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5035c31b3c504a99a1aacb99acd47bc0, user_id=548d6e9dc44841ec91473d9212868213, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:01.995438 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc8d2e-2730-47bb-a7e1-50ba9defc25a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:02.008435 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 882/1740] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:01 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:02.026524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d1f7b-8174-4776-b903-b76f2c2b61ee None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:02.029745 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-906d1f7b-8174-4776-b903-b76f2c2b61ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:02.046876 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 859/1741] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:38:01 2022] PUT /identity/v3/projects/5035c31b3c504a99a1aacb99acd47bc0/users/548d6e9dc44841ec91473d9212868213/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:02.057857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:02.061174 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f0bfa-042b-483c-828d-57fd2c3ea8c6 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:02.063268 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f0bfa-042b-483c-828d-57fd2c3ea8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:02.063632 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f0bfa-042b-483c-828d-57fd2c3ea8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:02.106929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ed3f0bfa-042b-483c-828d-57fd2c3ea8c6 None None] MFA Rules not processed for user `f63aac7e7e0a458b8469bf0fd251daab`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:02.108540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ed3f0bfa-042b-483c-828d-57fd2c3ea8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:02.140063 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d1f7b-8174-4776-b903-b76f2c2b61ee None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:02.228963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0676f61-bd3f-4bea-aecd-c373cf1ca4ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:02.229949 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 860/1742] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:02.230219 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0676f61-bd3f-4bea-aecd-c373cf1ca4ec service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:02.230786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0676f61-bd3f-4bea-aecd-c373cf1ca4ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:02.231265 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0676f61-bd3f-4bea-aecd-c373cf1ca4ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:02.233125 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875bda9-c6e2-437c-bff4-36991f3f9520 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:02.233826 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875bda9-c6e2-437c-bff4-36991f3f9520 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:02.233826 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875bda9-c6e2-437c-bff4-36991f3f9520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:02.280724 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-1875bda9-c6e2-437c-bff4-36991f3f9520 None None] MFA Rules not processed for user `548d6e9dc44841ec91473d9212868213`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:02.282529 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1875bda9-c6e2-437c-bff4-36991f3f9520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:02.296992 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:02.401498 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0676f61-bd3f-4bea-aecd-c373cf1ca4ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:02.405351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0676f61-bd3f-4bea-aecd-c373cf1ca4ec service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:02.433880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 883/1743] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:02 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:02.444954 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0676f61-bd3f-4bea-aecd-c373cf1ca4ec service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:02.448250 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f0676f61-bd3f-4bea-aecd-c373cf1ca4ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:02.551643 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 861/1744] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:02.557017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5c6d8-bf30-45d4-8abc-f5c07e7d63b4 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:02.557778 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5c6d8-bf30-45d4-8abc-f5c07e7d63b4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:02.557778 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5c6d8-bf30-45d4-8abc-f5c07e7d63b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:02.636967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-dfa5c6d8-bf30-45d4-8abc-f5c07e7d63b4 None None] MFA Rules not processed for user `a63509391b174805b4ae58b53195a44c`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:02.644023 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-dfa5c6d8-bf30-45d4-8abc-f5c07e7d63b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:02.776866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0676f61-bd3f-4bea-aecd-c373cf1ca4ec service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:02.790703 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8dd44-99fc-40ef-9601-59fb8dffe32f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:02.791643 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8dd44-99fc-40ef-9601-59fb8dffe32f service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:02.791930 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8dd44-99fc-40ef-9601-59fb8dffe32f service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:02.792207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8dd44-99fc-40ef-9601-59fb8dffe32f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:02.828599 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8dd44-99fc-40ef-9601-59fb8dffe32f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:02.831165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8dd44-99fc-40ef-9601-59fb8dffe32f service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:02.837715 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:02.850778 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 884/1745] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:02.879289 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8dd44-99fc-40ef-9601-59fb8dffe32f service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:02.979069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 862/1746] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:02.980374 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5c6d8-bf30-45d4-8abc-f5c07e7d63b4 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:02.986145 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-dfa5c6d8-bf30-45d4-8abc-f5c07e7d63b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:03.026202 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5c6d8-bf30-45d4-8abc-f5c07e7d63b4 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:03.091226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe623a-87c4-4614-be91-763cb06fc6d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:03.097271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe623a-87c4-4614-be91-763cb06fc6d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:03.097634 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe623a-87c4-4614-be91-763cb06fc6d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:03.098101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe623a-87c4-4614-be91-763cb06fc6d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:03.103761 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cdbe623a-87c4-4614-be91-763cb06fc6d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:03.175132 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8dd44-99fc-40ef-9601-59fb8dffe32f service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:03.189524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcb8ab-f1eb-43ae-9557-59d24c79d820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:03.190456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcb8ab-f1eb-43ae-9557-59d24c79d820 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:03.190884 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcb8ab-f1eb-43ae-9557-59d24c79d820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:03.191188 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcb8ab-f1eb-43ae-9557-59d24c79d820 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:03.192179 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcb8ab-f1eb-43ae-9557-59d24c79d820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:03.195051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adcb8ab-f1eb-43ae-9557-59d24c79d820 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:03.272950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe623a-87c4-4614-be91-763cb06fc6d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:03.274666 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 885/1747] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:38:02 2022] POST /identity/v3/projects => generated 379 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:03.275769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcb8ab-f1eb-43ae-9557-59d24c79d820 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:03.278738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe623a-87c4-4614-be91-763cb06fc6d9 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:03.309611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 863/1748] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:03.311607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1a9e5-2d80-4b09-987c-4d4be77fb8c9 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:03.311607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1a9e5-2d80-4b09-987c-4d4be77fb8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:03.314385 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1a9e5-2d80-4b09-987c-4d4be77fb8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:03.357095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-74b1a9e5-2d80-4b09-987c-4d4be77fb8c9 None None] MFA Rules not processed for user `7791b825f4274af19051fd0fd884274f`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:03.359370 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-74b1a9e5-2d80-4b09-987c-4d4be77fb8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:03.467279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcb8ab-f1eb-43ae-9557-59d24c79d820 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:03.469253 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:03.490769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d165d-b72f-4ce4-8eb9-e7a519d2f26c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:03.492940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d165d-b72f-4ce4-8eb9-e7a519d2f26c service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:03.494684 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d165d-b72f-4ce4-8eb9-e7a519d2f26c service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:03.496720 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d165d-b72f-4ce4-8eb9-e7a519d2f26c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:03.557189 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 864/1749] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:03.558123 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1a9e5-2d80-4b09-987c-4d4be77fb8c9 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:03.804369 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d165d-b72f-4ce4-8eb9-e7a519d2f26c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:03.806004 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d165d-b72f-4ce4-8eb9-e7a519d2f26c service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:03.832553 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1a9e5-2d80-4b09-987c-4d4be77fb8c9 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:03.834180 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 886/1750] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:03.838326 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01c947-0b51-4bad-97bc-9a897e23add0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:03.839158 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01c947-0b51-4bad-97bc-9a897e23add0 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:03.839564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01c947-0b51-4bad-97bc-9a897e23add0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:03.839979 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01c947-0b51-4bad-97bc-9a897e23add0 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:03.841022 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01c947-0b51-4bad-97bc-9a897e23add0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:03.843436 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01c947-0b51-4bad-97bc-9a897e23add0 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:03.847718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1924d97-d0dc-4a62-93d9-e8c8bec02c69 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:03.850220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1924d97-d0dc-4a62-93d9-e8c8bec02c69 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:03.850517 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1924d97-d0dc-4a62-93d9-e8c8bec02c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:03.871212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 865/1751] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:38:03 2022] POST /identity/v3/users => generated 296 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:03.875803 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01c947-0b51-4bad-97bc-9a897e23add0 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:03.895023 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01c947-0b51-4bad-97bc-9a897e23add0 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:03.902031 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1739e69-2e46-45c3-ba54-8b3b82e7c1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:03.906297 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1739e69-2e46-45c3-ba54-8b3b82e7c1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:03.908758 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1739e69-2e46-45c3-ba54-8b3b82e7c1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:03.909551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1739e69-2e46-45c3-ba54-8b3b82e7c1f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:03.910546 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1739e69-2e46-45c3-ba54-8b3b82e7c1f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:03.913533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1739e69-2e46-45c3-ba54-8b3b82e7c1f2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:03.930858 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 866/1752] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:38:03.938277 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1739e69-2e46-45c3-ba54-8b3b82e7c1f2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:03.958276 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b1924d97-d0dc-4a62-93d9-e8c8bec02c69 None None] MFA Rules not processed for user `abca8080d1754da9911faf411b3230fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:03.960164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b1924d97-d0dc-4a62-93d9-e8c8bec02c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:03.973755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1739e69-2e46-45c3-ba54-8b3b82e7c1f2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:03.978846 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:03.989282 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7da39e-fc19-429e-9527-c4edf402e1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:03.992493 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7da39e-fc19-429e-9527-c4edf402e1af admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:03.994217 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7da39e-fc19-429e-9527-c4edf402e1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:03.995909 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7da39e-fc19-429e-9527-c4edf402e1af admin admin] PATH_INFO: `/v3/projects/24863e27954c4bfeb0675e81ff204e50/users/77cba46cc195452498fbf341dd3e7fc9/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:04.068015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7da39e-fc19-429e-9527-c4edf402e1af admin admin] RBAC: Authorizing `identity:create_grant(project_id=24863e27954c4bfeb0675e81ff204e50, user_id=77cba46cc195452498fbf341dd3e7fc9, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:04.073516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7da39e-fc19-429e-9527-c4edf402e1af admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:04.102737 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 867/1753] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:38:03 2022] PUT /identity/v3/projects/24863e27954c4bfeb0675e81ff204e50/users/77cba46cc195452498fbf341dd3e7fc9/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:04.110350 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7da39e-fc19-429e-9527-c4edf402e1af admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:04.171239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 887/1754] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:04.184064 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a18f0a-36ea-4377-a191-1b84e2a7a238 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:04.184447 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a18f0a-36ea-4377-a191-1b84e2a7a238 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:04.184733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a18f0a-36ea-4377-a191-1b84e2a7a238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:04.251011 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-22a18f0a-36ea-4377-a191-1b84e2a7a238 None None] MFA Rules not processed for user `abca8080d1754da9911faf411b3230fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:04.252314 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-22a18f0a-36ea-4377-a191-1b84e2a7a238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:04.458181 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 888/1755] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:04.477148 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7da39e-fc19-429e-9527-c4edf402e1af admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:04.507200 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1bf83-47df-47a2-b97d-4d038118a174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:04.535704 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1bf83-47df-47a2-b97d-4d038118a174 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:04.536032 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1bf83-47df-47a2-b97d-4d038118a174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:04.536329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1bf83-47df-47a2-b97d-4d038118a174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:04.537141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1bf83-47df-47a2-b97d-4d038118a174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:04.565457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1bf83-47df-47a2-b97d-4d038118a174 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:04.592081 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb595d42-5189-4061-8273-c4df136d6fa3 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:04.592553 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb595d42-5189-4061-8273-c4df136d6fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:04.592669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb595d42-5189-4061-8273-c4df136d6fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:04.647460 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 868/1756] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 541 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:04.653856 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1bf83-47df-47a2-b97d-4d038118a174 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:04.654981 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-cb595d42-5189-4061-8273-c4df136d6fa3 None None] MFA Rules not processed for user `7b82de4816a244c0b62b5f9f894ccaf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:04.667471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cb595d42-5189-4061-8273-c4df136d6fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:04.709794 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1bf83-47df-47a2-b97d-4d038118a174 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:04.743226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc7dc0-60e7-4fd7-abdf-2fc0629414d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:04.744241 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc7dc0-60e7-4fd7-abdf-2fc0629414d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:04.744602 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc7dc0-60e7-4fd7-abdf-2fc0629414d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:04.744889 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc7dc0-60e7-4fd7-abdf-2fc0629414d8 admin admin] PATH_INFO: `/v3/projects/24863e27954c4bfeb0675e81ff204e50/users/77cba46cc195452498fbf341dd3e7fc9/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:04.750453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc7dc0-60e7-4fd7-abdf-2fc0629414d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24863e27954c4bfeb0675e81ff204e50, user_id=77cba46cc195452498fbf341dd3e7fc9, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:04.759355 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc7dc0-60e7-4fd7-abdf-2fc0629414d8 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:04.887632 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 869/1757] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:38:04 2022] PUT /identity/v3/projects/24863e27954c4bfeb0675e81ff204e50/users/77cba46cc195452498fbf341dd3e7fc9/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:04.888706 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc7dc0-60e7-4fd7-abdf-2fc0629414d8 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:05.009098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 889/1758] 10.222.0.117 () {58 vars in 1016 bytes} [Thu Jul 14 15:38:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:05.010929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f3ab2-b471-4ab9-a321-ebc2db65f58c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:05.011455 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f3ab2-b471-4ab9-a321-ebc2db65f58c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:05.011959 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f3ab2-b471-4ab9-a321-ebc2db65f58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:05.033476 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:05.158240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-620f3ab2-b471-4ab9-a321-ebc2db65f58c None None] MFA Rules not processed for user `77cba46cc195452498fbf341dd3e7fc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:05.161679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-620f3ab2-b471-4ab9-a321-ebc2db65f58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:05.359363 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc7dc0-60e7-4fd7-abdf-2fc0629414d8 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:05.374810 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33f196-4c17-4135-8d8d-0e1c48d78627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:05.375498 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33f196-4c17-4135-8d8d-0e1c48d78627 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:05.378286 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33f196-4c17-4135-8d8d-0e1c48d78627 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:05.378770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da33f196-4c17-4135-8d8d-0e1c48d78627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:05.528213 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:05.626957 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 890/1759] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 616 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:05.630289 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f3ab2-b471-4ab9-a321-ebc2db65f58c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:05.632895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-620f3ab2-b471-4ab9-a321-ebc2db65f58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:05.708139 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33f196-4c17-4135-8d8d-0e1c48d78627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:05.711505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da33f196-4c17-4135-8d8d-0e1c48d78627 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:05.763579 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 870/1760] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 875 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:05.776476 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33f196-4c17-4135-8d8d-0e1c48d78627 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:06.034959 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f3ab2-b471-4ab9-a321-ebc2db65f58c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:06.063697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd704e-1dbc-4576-9180-70be09a7282a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:06.067334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd704e-1dbc-4576-9180-70be09a7282a service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:06.067745 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd704e-1dbc-4576-9180-70be09a7282a service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:06.070359 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd704e-1dbc-4576-9180-70be09a7282a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:06.090593 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da33f196-4c17-4135-8d8d-0e1c48d78627 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:06.106447 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd704e-1dbc-4576-9180-70be09a7282a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:06.108657 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd704e-1dbc-4576-9180-70be09a7282a service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:06.120006 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c3b19-549d-4015-8bcd-0557f56e88cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:06.120694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c3b19-549d-4015-8bcd-0557f56e88cf service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:06.120983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c3b19-549d-4015-8bcd-0557f56e88cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:06.121262 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c3b19-549d-4015-8bcd-0557f56e88cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:06.147900 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c3b19-549d-4015-8bcd-0557f56e88cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:06.148862 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 891/1761] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:06.149053 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c3b19-549d-4015-8bcd-0557f56e88cf service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:06.179039 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 871/1762] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:07.307730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd704e-1dbc-4576-9180-70be09a7282a service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:07.343462 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd704e-1dbc-4576-9180-70be09a7282a service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:07.364459 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c166f-4f7c-41be-82cd-4fdc755d40b6 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77cba46cc195452498fbf341dd3e7fc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24863e27954c4bfeb0675e81ff204e50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:07.365214 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c166f-4f7c-41be-82cd-4fdc755d40b6 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:07.365707 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c166f-4f7c-41be-82cd-4fdc755d40b6 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:07.366224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c166f-4f7c-41be-82cd-4fdc755d40b6 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:07.367143 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c166f-4f7c-41be-82cd-4fdc755d40b6 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:38:07.367995 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c166f-4f7c-41be-82cd-4fdc755d40b6 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:07.369878 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c166f-4f7c-41be-82cd-4fdc755d40b6 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:07.492307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c3b19-549d-4015-8bcd-0557f56e88cf service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:07.493122 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 892/1763] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:07.513102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c3b19-549d-4015-8bcd-0557f56e88cf service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:07.527129 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b24d8-d92f-4df3-a0c9-8d93a58e6428 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77cba46cc195452498fbf341dd3e7fc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24863e27954c4bfeb0675e81ff204e50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:07.529339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b24d8-d92f-4df3-a0c9-8d93a58e6428 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:07.529650 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b24d8-d92f-4df3-a0c9-8d93a58e6428 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:07.529949 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b24d8-d92f-4df3-a0c9-8d93a58e6428 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:07.534596 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b24d8-d92f-4df3-a0c9-8d93a58e6428 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:07.540469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b24d8-d92f-4df3-a0c9-8d93a58e6428 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:07.623545 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 872/1764] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:38:07 2022] POST /identity/v3/projects => generated 355 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:07.628212 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c166f-4f7c-41be-82cd-4fdc755d40b6 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:07.643635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c166f-4f7c-41be-82cd-4fdc755d40b6 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:07.809510 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1e8cb-ecdf-4f19-a0c9-6de5cadaf4e1 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77cba46cc195452498fbf341dd3e7fc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24863e27954c4bfeb0675e81ff204e50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:07.809650 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1e8cb-ecdf-4f19-a0c9-6de5cadaf4e1 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:07.809923 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1e8cb-ecdf-4f19-a0c9-6de5cadaf4e1 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:07.810420 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1e8cb-ecdf-4f19-a0c9-6de5cadaf4e1 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:07.811692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1e8cb-ecdf-4f19-a0c9-6de5cadaf4e1 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:38:07.812597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1e8cb-ecdf-4f19-a0c9-6de5cadaf4e1 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:07.816713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1e8cb-ecdf-4f19-a0c9-6de5cadaf4e1 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:07.913811 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 893/1765] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:08.051383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b24d8-d92f-4df3-a0c9-8d93a58e6428 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:08.075268 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b24d8-d92f-4df3-a0c9-8d93a58e6428 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:08.108481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851cb87-fada-472d-af3a-336b9885e217 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77cba46cc195452498fbf341dd3e7fc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24863e27954c4bfeb0675e81ff204e50', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:08.112423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851cb87-fada-472d-af3a-336b9885e217 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:08.112916 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851cb87-fada-472d-af3a-336b9885e217 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:08.116850 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851cb87-fada-472d-af3a-336b9885e217 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] PATH_INFO: `/v3/projects/031760c75fd8466480a5efd0b44d90c4` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:08.122416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851cb87-fada-472d-af3a-336b9885e217 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] RBAC: Authorizing `identity:delete_project(project_id=031760c75fd8466480a5efd0b44d90c4)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:08.124478 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851cb87-fada-472d-af3a-336b9885e217 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:08.267829 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:08.320836 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e851cb87-fada-472d-af3a-336b9885e217 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '031760c75fd8466480a5efd0b44d90c4', 'request_id': 'req-e851cb87-fada-472d-af3a-336b9885e217'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:08.362903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e851cb87-fada-472d-af3a-336b9885e217 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '031760c75fd8466480a5efd0b44d90c4', 'request_id': 'req-e851cb87-fada-472d-af3a-336b9885e217'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:08.413933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e851cb87-fada-472d-af3a-336b9885e217 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '031760c75fd8466480a5efd0b44d90c4', 'request_id': 'req-e851cb87-fada-472d-af3a-336b9885e217'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:08.468816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e851cb87-fada-472d-af3a-336b9885e217 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] The token cache is being invalidate because project 031760c75fd8466480a5efd0b44d90c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:08.469118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e851cb87-fada-472d-af3a-336b9885e217 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:08.475731 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e851cb87-fada-472d-af3a-336b9885e217 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:08.482474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 873/1766] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:38:08 2022] DELETE /identity/v3/projects/031760c75fd8466480a5efd0b44d90c4 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:09.437628 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1e8cb-ecdf-4f19-a0c9-6de5cadaf4e1 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:09.444170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-59a1e8cb-ecdf-4f19-a0c9-6de5cadaf4e1 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:09.645662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1e8cb-ecdf-4f19-a0c9-6de5cadaf4e1 tempest-VolumeQuotaClassesTest-465112784 tempest-VolumeQuotaClassesTest-465112784-project-admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:09.673007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:09.743573 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c4ce1-0d20-4593-b541-51be86579be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:09.746353 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c4ce1-0d20-4593-b541-51be86579be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:09.747011 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c4ce1-0d20-4593-b541-51be86579be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:09.747680 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c4ce1-0d20-4593-b541-51be86579be2 admin admin] PATH_INFO: `/v3/users/548d6e9dc44841ec91473d9212868213` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:09.749927 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c4ce1-0d20-4593-b541-51be86579be2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=548d6e9dc44841ec91473d9212868213)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:09.752772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c4ce1-0d20-4593-b541-51be86579be2 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:09.865246 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-384c4ce1-0d20-4593-b541-51be86579be2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '548d6e9dc44841ec91473d9212868213'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:09.866527 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-384c4ce1-0d20-4593-b541-51be86579be2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '548d6e9dc44841ec91473d9212868213'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:09.886116 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-384c4ce1-0d20-4593-b541-51be86579be2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '548d6e9dc44841ec91473d9212868213'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:09.905074 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-384c4ce1-0d20-4593-b541-51be86579be2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '548d6e9dc44841ec91473d9212868213'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:09.968326 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-384c4ce1-0d20-4593-b541-51be86579be2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '548d6e9dc44841ec91473d9212868213'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:09.979716 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 894/1767] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:38:09 2022] DELETE /identity/v3/users/548d6e9dc44841ec91473d9212868213 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:09.984010 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03cda4e-e94f-4a35-a293-fbc64b1298a2 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:09.984632 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03cda4e-e94f-4a35-a293-fbc64b1298a2 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:09.984730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03cda4e-e94f-4a35-a293-fbc64b1298a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:10.022397 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b03cda4e-e94f-4a35-a293-fbc64b1298a2 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:10.024226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b03cda4e-e94f-4a35-a293-fbc64b1298a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:10.155996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 874/1768] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:10.175240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c4ce1-0d20-4593-b541-51be86579be2 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:10.182311 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-384c4ce1-0d20-4593-b541-51be86579be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:10.387050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c4ce1-0d20-4593-b541-51be86579be2 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:10.398552 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb043e99-5a68-4e49-968e-12c6278729d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:10.400721 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb043e99-5a68-4e49-968e-12c6278729d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:10.401640 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb043e99-5a68-4e49-968e-12c6278729d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:10.403914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb043e99-5a68-4e49-968e-12c6278729d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:10.444609 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb043e99-5a68-4e49-968e-12c6278729d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:10.447291 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb043e99-5a68-4e49-968e-12c6278729d2 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:10.496615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 895/1769] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:10.977252 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5406159-80a4-4ae8-9500-744a66d68246 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:10.977513 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5406159-80a4-4ae8-9500-744a66d68246 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:10.977781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5406159-80a4-4ae8-9500-744a66d68246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:11.026953 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d5406159-80a4-4ae8-9500-744a66d68246 None None] MFA Rules not processed for user `f63aac7e7e0a458b8469bf0fd251daab`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:11.030774 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d5406159-80a4-4ae8-9500-744a66d68246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:11.101680 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6244e7-668f-47bc-8419-0ec4879ebab3 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:11.102178 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6244e7-668f-47bc-8419-0ec4879ebab3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:11.102575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6244e7-668f-47bc-8419-0ec4879ebab3 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:11.104136 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 896/1770] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jul 14 15:38:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:38:11.148607 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e31fb7-c14c-4d0e-9f0f-f22ce54de17a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:11.149211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e31fb7-c14c-4d0e-9f0f-f22ce54de17a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:11.153941 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e31fb7-c14c-4d0e-9f0f-f22ce54de17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:11.219010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c4e31fb7-c14c-4d0e-9f0f-f22ce54de17a None None] MFA Rules not processed for user `64f6b597a47c4a0eb08d1eabc4c0305c`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:11.233236 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c4e31fb7-c14c-4d0e-9f0f-f22ce54de17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:11.280970 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 875/1771] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:11.351578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:11.423575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 897/1772] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jul 14 15:38:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:11.593157 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d076f30-bc1a-4035-9c19-0583de943524 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:11.593454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d076f30-bc1a-4035-9c19-0583de943524 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:11.593740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d076f30-bc1a-4035-9c19-0583de943524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:11.628206 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-1d076f30-bc1a-4035-9c19-0583de943524 None None] MFA Rules not processed for user `a63509391b174805b4ae58b53195a44c`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:11.629439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1d076f30-bc1a-4035-9c19-0583de943524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:11.717700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e31fb7-c14c-4d0e-9f0f-f22ce54de17a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:11.721029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c4e31fb7-c14c-4d0e-9f0f-f22ce54de17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:11.748503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e31fb7-c14c-4d0e-9f0f-f22ce54de17a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:11.762271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 876/1773] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:11.763601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d076f30-bc1a-4035-9c19-0583de943524 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:11.764364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365584a-394e-43fc-a99c-3d8dc40c0701 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:11.765510 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365584a-394e-43fc-a99c-3d8dc40c0701 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:11.767077 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1d076f30-bc1a-4035-9c19-0583de943524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:11.767484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365584a-394e-43fc-a99c-3d8dc40c0701 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:11.769190 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365584a-394e-43fc-a99c-3d8dc40c0701 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:11.789715 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365584a-394e-43fc-a99c-3d8dc40c0701 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:11.791672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365584a-394e-43fc-a99c-3d8dc40c0701 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:11.803870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d076f30-bc1a-4035-9c19-0583de943524 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:11.814187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f9201-04a3-4b32-909f-643bcc776d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:11.815312 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f9201-04a3-4b32-909f-643bcc776d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:11.815719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f9201-04a3-4b32-909f-643bcc776d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:11.816005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f9201-04a3-4b32-909f-643bcc776d30 admin admin] PATH_INFO: `/v3/projects/5035c31b3c504a99a1aacb99acd47bc0` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:11.816588 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 898/1774] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:11.817417 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f9201-04a3-4b32-909f-643bcc776d30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5035c31b3c504a99a1aacb99acd47bc0)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:11.819392 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f9201-04a3-4b32-909f-643bcc776d30 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:11.822616 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:11.883570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7e7f9201-04a3-4b32-909f-643bcc776d30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5035c31b3c504a99a1aacb99acd47bc0', 'request_id': 'req-7e7f9201-04a3-4b32-909f-643bcc776d30'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:11.891334 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7e7f9201-04a3-4b32-909f-643bcc776d30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5035c31b3c504a99a1aacb99acd47bc0', 'request_id': 'req-7e7f9201-04a3-4b32-909f-643bcc776d30'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:11.899147 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7e7f9201-04a3-4b32-909f-643bcc776d30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5035c31b3c504a99a1aacb99acd47bc0', 'request_id': 'req-7e7f9201-04a3-4b32-909f-643bcc776d30'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:11.930035 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7e7f9201-04a3-4b32-909f-643bcc776d30 admin admin] The token cache is being invalidate because project 5035c31b3c504a99a1aacb99acd47bc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:11.930358 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7e7f9201-04a3-4b32-909f-643bcc776d30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:11.931595 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7e7f9201-04a3-4b32-909f-643bcc776d30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:11.937587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 877/1775] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:38:11 2022] DELETE /identity/v3/projects/5035c31b3c504a99a1aacb99acd47bc0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:11.939044 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365584a-394e-43fc-a99c-3d8dc40c0701 service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:11.961739 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365584a-394e-43fc-a99c-3d8dc40c0701 service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:12.139674 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288531c0-048d-4a84-ace1-bb23dd85690f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:12.140801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288531c0-048d-4a84-ace1-bb23dd85690f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:12.141485 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288531c0-048d-4a84-ace1-bb23dd85690f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:12.144309 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288531c0-048d-4a84-ace1-bb23dd85690f admin admin] PATH_INFO: `/v3/users/77cba46cc195452498fbf341dd3e7fc9` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:12.145872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288531c0-048d-4a84-ace1-bb23dd85690f admin admin] RBAC: Authorizing `identity:delete_user(user_id=77cba46cc195452498fbf341dd3e7fc9)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:12.150278 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288531c0-048d-4a84-ace1-bb23dd85690f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:12.244816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-288531c0-048d-4a84-ace1-bb23dd85690f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77cba46cc195452498fbf341dd3e7fc9'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:12.245517 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-288531c0-048d-4a84-ace1-bb23dd85690f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77cba46cc195452498fbf341dd3e7fc9'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:12.261615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-288531c0-048d-4a84-ace1-bb23dd85690f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77cba46cc195452498fbf341dd3e7fc9'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:12.273742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-288531c0-048d-4a84-ace1-bb23dd85690f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77cba46cc195452498fbf341dd3e7fc9'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:12.293279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-288531c0-048d-4a84-ace1-bb23dd85690f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77cba46cc195452498fbf341dd3e7fc9'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:12.304068 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 899/1776] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:38:11 2022] DELETE /identity/v3/users/77cba46cc195452498fbf341dd3e7fc9 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:38:13.109520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f9201-04a3-4b32-909f-643bcc776d30 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:13.111380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7e7f9201-04a3-4b32-909f-643bcc776d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:13.129924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f9201-04a3-4b32-909f-643bcc776d30 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:13.268623 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caebe15-0b15-43b4-b826-08c7667a4989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:13.269721 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caebe15-0b15-43b4-b826-08c7667a4989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:13.270014 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caebe15-0b15-43b4-b826-08c7667a4989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:13.270312 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caebe15-0b15-43b4-b826-08c7667a4989 admin admin] PATH_INFO: `/v3/projects/24863e27954c4bfeb0675e81ff204e50` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:13.272256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caebe15-0b15-43b4-b826-08c7667a4989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24863e27954c4bfeb0675e81ff204e50)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:13.278384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caebe15-0b15-43b4-b826-08c7667a4989 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:13.385293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2caebe15-0b15-43b4-b826-08c7667a4989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24863e27954c4bfeb0675e81ff204e50', 'request_id': 'req-2caebe15-0b15-43b4-b826-08c7667a4989'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:13.409805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2caebe15-0b15-43b4-b826-08c7667a4989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24863e27954c4bfeb0675e81ff204e50', 'request_id': 'req-2caebe15-0b15-43b4-b826-08c7667a4989'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:13.442733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2caebe15-0b15-43b4-b826-08c7667a4989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24863e27954c4bfeb0675e81ff204e50', 'request_id': 'req-2caebe15-0b15-43b4-b826-08c7667a4989'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:13.462756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2caebe15-0b15-43b4-b826-08c7667a4989 admin admin] The token cache is being invalidate because project 24863e27954c4bfeb0675e81ff204e50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:13.462955 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2caebe15-0b15-43b4-b826-08c7667a4989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:13.464464 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2caebe15-0b15-43b4-b826-08c7667a4989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:13.470869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 878/1777] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:38:13 2022] DELETE /identity/v3/projects/24863e27954c4bfeb0675e81ff204e50 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:13.472690 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78363c0-daa1-46be-bcce-dacd781dcde2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:13.473164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78363c0-daa1-46be-bcce-dacd781dcde2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:13.477379 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78363c0-daa1-46be-bcce-dacd781dcde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:13.508192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f78363c0-daa1-46be-bcce-dacd781dcde2 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:13.536573 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f78363c0-daa1-46be-bcce-dacd781dcde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:13.679233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:13.770650 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 900/1778] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:13.771962 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c6784-a5fa-4ec3-93ed-087bbd2c3594 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:13.772268 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c6784-a5fa-4ec3-93ed-087bbd2c3594 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:13.772890 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c6784-a5fa-4ec3-93ed-087bbd2c3594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:13.804717 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-283c6784-a5fa-4ec3-93ed-087bbd2c3594 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:13.806377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-283c6784-a5fa-4ec3-93ed-087bbd2c3594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:13.828439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 879/1779] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:13.833428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78363c0-daa1-46be-bcce-dacd781dcde2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:13.848879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78363c0-daa1-46be-bcce-dacd781dcde2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:13.856513 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8263fa1-0d13-49a4-a31c-a98de76a7a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:13.857777 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8263fa1-0d13-49a4-a31c-a98de76a7a7f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:13.861637 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8263fa1-0d13-49a4-a31c-a98de76a7a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:13.862786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8263fa1-0d13-49a4-a31c-a98de76a7a7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:13.863637 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8263fa1-0d13-49a4-a31c-a98de76a7a7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:38:13.864141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8263fa1-0d13-49a4-a31c-a98de76a7a7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:13.867023 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8263fa1-0d13-49a4-a31c-a98de76a7a7f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:13.888044 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 901/1780] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:38:13.893097 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c6784-a5fa-4ec3-93ed-087bbd2c3594 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:13.916956 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c6784-a5fa-4ec3-93ed-087bbd2c3594 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:13.927961 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464862fa-ab8c-4421-8c08-00092b0c04ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:13.928668 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464862fa-ab8c-4421-8c08-00092b0c04ed admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:13.929034 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464862fa-ab8c-4421-8c08-00092b0c04ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:13.929254 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464862fa-ab8c-4421-8c08-00092b0c04ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:13.929953 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464862fa-ab8c-4421-8c08-00092b0c04ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:13.939519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464862fa-ab8c-4421-8c08-00092b0c04ed admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:13.987824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:14.019059 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 880/1781] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:38:13 2022] POST /identity/v3/projects => generated 393 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:14.019246 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8263fa1-0d13-49a4-a31c-a98de76a7a7f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:14.033803 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8263fa1-0d13-49a4-a31c-a98de76a7a7f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:14.238275 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19344676-167b-4d35-b605-cbef3d17c3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:14.241212 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19344676-167b-4d35-b605-cbef3d17c3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:14.241593 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19344676-167b-4d35-b605-cbef3d17c3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:14.242021 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19344676-167b-4d35-b605-cbef3d17c3b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:14.244977 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19344676-167b-4d35-b605-cbef3d17c3b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:14.248235 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19344676-167b-4d35-b605-cbef3d17c3b1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:14.325372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 902/1782] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:38:14 2022] POST /identity/v3/users => generated 297 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:38:14.333606 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464862fa-ab8c-4421-8c08-00092b0c04ed admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:14.352855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464862fa-ab8c-4421-8c08-00092b0c04ed admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:14.367533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710bf6de-e0c8-481f-9378-9dd57a614b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:14.368319 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bf6de-e0c8-481f-9378-9dd57a614b55 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:14.369444 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bf6de-e0c8-481f-9378-9dd57a614b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:14.369790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bf6de-e0c8-481f-9378-9dd57a614b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:14.370543 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710bf6de-e0c8-481f-9378-9dd57a614b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:14.372209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710bf6de-e0c8-481f-9378-9dd57a614b55 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:14.400001 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 881/1783] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:14.402783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19344676-167b-4d35-b605-cbef3d17c3b1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:14.445004 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19344676-167b-4d35-b605-cbef3d17c3b1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:14.457234 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1f4cc-9684-42d1-8874-d98618b600e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:14.463821 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1f4cc-9684-42d1-8874-d98618b600e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:14.464180 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1f4cc-9684-42d1-8874-d98618b600e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:14.464534 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1f4cc-9684-42d1-8874-d98618b600e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:14.472269 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1f4cc-9684-42d1-8874-d98618b600e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:14.477951 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1f4cc-9684-42d1-8874-d98618b600e2 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:14.553029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 903/1784] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:14.554125 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710bf6de-e0c8-481f-9378-9dd57a614b55 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:14.571541 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710bf6de-e0c8-481f-9378-9dd57a614b55 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:14.582731 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49e339-9b88-493c-b94a-a56daec17d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:14.583929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49e339-9b88-493c-b94a-a56daec17d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:14.584399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49e339-9b88-493c-b94a-a56daec17d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:14.584834 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49e339-9b88-493c-b94a-a56daec17d37 admin admin] PATH_INFO: `/v3/projects/abd03883d7974b4d85bdc1976b2553f1/users/f5ca65dd66c74c74b2b402f1b617bc77/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:14.607921 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49e339-9b88-493c-b94a-a56daec17d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd03883d7974b4d85bdc1976b2553f1, user_id=f5ca65dd66c74c74b2b402f1b617bc77, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:14.630707 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49e339-9b88-493c-b94a-a56daec17d37 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:14.700411 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 882/1785] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:38:14 2022] PUT /identity/v3/projects/abd03883d7974b4d85bdc1976b2553f1/users/f5ca65dd66c74c74b2b402f1b617bc77/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:14.705534 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cf5a0-2b6d-4fe1-9ded-7ac2007ef07f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:14.706028 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cf5a0-2b6d-4fe1-9ded-7ac2007ef07f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:14.706568 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cf5a0-2b6d-4fe1-9ded-7ac2007ef07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:14.822360 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e80cf5a0-2b6d-4fe1-9ded-7ac2007ef07f None None] MFA Rules not processed for user `f5ca65dd66c74c74b2b402f1b617bc77`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:14.825412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e80cf5a0-2b6d-4fe1-9ded-7ac2007ef07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:15.070506 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 904/1786] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:15.075299 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49e339-9b88-493c-b94a-a56daec17d37 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:15.274774 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49e339-9b88-493c-b94a-a56daec17d37 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:15.294722 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ee306-faf8-438b-b89c-d43553a6f251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:15.295660 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ee306-faf8-438b-b89c-d43553a6f251 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:15.295660 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ee306-faf8-438b-b89c-d43553a6f251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:15.295879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ee306-faf8-438b-b89c-d43553a6f251 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:15.296592 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ee306-faf8-438b-b89c-d43553a6f251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:15.326955 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ee306-faf8-438b-b89c-d43553a6f251 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:15.405080 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80cf5a0-2b6d-4fe1-9ded-7ac2007ef07f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:15.406204 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 883/1787] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:38:15 2022] POST /identity/v3/projects => generated 393 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:15.425782 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80cf5a0-2b6d-4fe1-9ded-7ac2007ef07f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:15.496831 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:15.547485 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7c4ef-ed4b-4d16-9ec3-40750f08a500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:15.549463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7c4ef-ed4b-4d16-9ec3-40750f08a500 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:15.552345 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7c4ef-ed4b-4d16-9ec3-40750f08a500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:15.558127 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7c4ef-ed4b-4d16-9ec3-40750f08a500 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:15.558127 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7c4ef-ed4b-4d16-9ec3-40750f08a500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:15.558127 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7c4ef-ed4b-4d16-9ec3-40750f08a500 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:15.602023 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 905/1788] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:38:15 2022] POST /identity/v3/users => generated 303 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:38:15.606041 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ee306-faf8-438b-b89c-d43553a6f251 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:15.621657 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ee306-faf8-438b-b89c-d43553a6f251 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:15.643397 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c27c6-a241-4d1f-b135-6884fcc51c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:15.644316 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c27c6-a241-4d1f-b135-6884fcc51c11 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:15.646098 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c27c6-a241-4d1f-b135-6884fcc51c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:15.647616 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c27c6-a241-4d1f-b135-6884fcc51c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:15.649303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c27c6-a241-4d1f-b135-6884fcc51c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:15.652413 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c27c6-a241-4d1f-b135-6884fcc51c11 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:15.684248 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 884/1789] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:15.685325 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7c4ef-ed4b-4d16-9ec3-40750f08a500 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:15.699267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7c4ef-ed4b-4d16-9ec3-40750f08a500 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:15.713811 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfd433-23d6-451a-abbb-2de6af8a6852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:15.717265 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfd433-23d6-451a-abbb-2de6af8a6852 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:15.717755 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfd433-23d6-451a-abbb-2de6af8a6852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:15.718245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cfd433-23d6-451a-abbb-2de6af8a6852 admin admin] PATH_INFO: `/v3/projects/93c5786c201a4ba094b53769565cbe3a/users/6789793d029d4c06b0e8dfee9731ba8f/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:15.761736 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cfd433-23d6-451a-abbb-2de6af8a6852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c5786c201a4ba094b53769565cbe3a, user_id=6789793d029d4c06b0e8dfee9731ba8f, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:15.765583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cfd433-23d6-451a-abbb-2de6af8a6852 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:15.810026 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 906/1790] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:38:15 2022] PUT /identity/v3/projects/93c5786c201a4ba094b53769565cbe3a/users/6789793d029d4c06b0e8dfee9731ba8f/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:15.821931 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c27c6-a241-4d1f-b135-6884fcc51c11 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:15.841766 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c27c6-a241-4d1f-b135-6884fcc51c11 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:15.934882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c831315-7dac-4044-8da7-e144ff47c5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:15.936112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c831315-7dac-4044-8da7-e144ff47c5aa admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:15.936519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c831315-7dac-4044-8da7-e144ff47c5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:15.937073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c831315-7dac-4044-8da7-e144ff47c5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:15.939094 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c831315-7dac-4044-8da7-e144ff47c5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:15.941920 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c831315-7dac-4044-8da7-e144ff47c5aa admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:15.956709 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 885/1791] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:15.961283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfd433-23d6-451a-abbb-2de6af8a6852 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:15.984825 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cfd433-23d6-451a-abbb-2de6af8a6852 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:15.995333 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2900f8b-af59-408a-85fa-d80a5f04a216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:15.996792 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2900f8b-af59-408a-85fa-d80a5f04a216 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:15.997299 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2900f8b-af59-408a-85fa-d80a5f04a216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:15.997813 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2900f8b-af59-408a-85fa-d80a5f04a216 admin admin] PATH_INFO: `/v3/projects/93c5786c201a4ba094b53769565cbe3a/users/6789793d029d4c06b0e8dfee9731ba8f/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:16.004746 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2900f8b-af59-408a-85fa-d80a5f04a216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c5786c201a4ba094b53769565cbe3a, user_id=6789793d029d4c06b0e8dfee9731ba8f, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:16.010103 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2900f8b-af59-408a-85fa-d80a5f04a216 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:16.029756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 907/1792] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:38:15 2022] PUT /identity/v3/projects/93c5786c201a4ba094b53769565cbe3a/users/6789793d029d4c06b0e8dfee9731ba8f/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:16.041969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53589a5-7542-4ecc-9a6e-7bbac1e0b4da None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:16.046973 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53589a5-7542-4ecc-9a6e-7bbac1e0b4da None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:16.046973 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53589a5-7542-4ecc-9a6e-7bbac1e0b4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:16.122109 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c53589a5-7542-4ecc-9a6e-7bbac1e0b4da None None] MFA Rules not processed for user `6789793d029d4c06b0e8dfee9731ba8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:16.124109 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c53589a5-7542-4ecc-9a6e-7bbac1e0b4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:16.185635 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:16.347413 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 886/1793] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:16.361409 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2900f8b-af59-408a-85fa-d80a5f04a216 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:16.363794 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b2900f8b-af59-408a-85fa-d80a5f04a216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:16.475834 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2900f8b-af59-408a-85fa-d80a5f04a216 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:16.484952 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532e1f6-43f0-49f9-8c8b-21e7d0115dca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:16.487239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532e1f6-43f0-49f9-8c8b-21e7d0115dca service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:16.487700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532e1f6-43f0-49f9-8c8b-21e7d0115dca service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:16.488123 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532e1f6-43f0-49f9-8c8b-21e7d0115dca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:16.509222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532e1f6-43f0-49f9-8c8b-21e7d0115dca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:16.512284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532e1f6-43f0-49f9-8c8b-21e7d0115dca service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:16.525781 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 908/1794] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:16.618695 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53589a5-7542-4ecc-9a6e-7bbac1e0b4da None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:16.620745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c53589a5-7542-4ecc-9a6e-7bbac1e0b4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:16.643259 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53589a5-7542-4ecc-9a6e-7bbac1e0b4da None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:16.652308 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70398143-7481-4b87-adf8-47710d92e2b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:16.653254 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70398143-7481-4b87-adf8-47710d92e2b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:16.653687 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70398143-7481-4b87-adf8-47710d92e2b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:16.654149 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70398143-7481-4b87-adf8-47710d92e2b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:16.779911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70398143-7481-4b87-adf8-47710d92e2b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:16.784834 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70398143-7481-4b87-adf8-47710d92e2b3 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:16.802044 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 887/1795] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:26.520252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=54,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:26.794455 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=49 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:30.613726 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532e1f6-43f0-49f9-8c8b-21e7d0115dca service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:30.714451 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532e1f6-43f0-49f9-8c8b-21e7d0115dca service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:30.722291 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b9509-72fb-4f38-be57-d26d6c2c1cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:30.723262 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b9509-72fb-4f38-be57-d26d6c2c1cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:30.723588 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b9509-72fb-4f38-be57-d26d6c2c1cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:30.723877 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b9509-72fb-4f38-be57-d26d6c2c1cc9 admin admin] PATH_INFO: `/v3/users/f5ca65dd66c74c74b2b402f1b617bc77` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:30.725207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b9509-72fb-4f38-be57-d26d6c2c1cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5ca65dd66c74c74b2b402f1b617bc77)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:30.727370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b9509-72fb-4f38-be57-d26d6c2c1cc9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:30.804881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c28b9509-72fb-4f38-be57-d26d6c2c1cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5ca65dd66c74c74b2b402f1b617bc77'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:30.805596 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c28b9509-72fb-4f38-be57-d26d6c2c1cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5ca65dd66c74c74b2b402f1b617bc77'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:30.814442 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c28b9509-72fb-4f38-be57-d26d6c2c1cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5ca65dd66c74c74b2b402f1b617bc77'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:30.823842 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c28b9509-72fb-4f38-be57-d26d6c2c1cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5ca65dd66c74c74b2b402f1b617bc77'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:30.840458 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c28b9509-72fb-4f38-be57-d26d6c2c1cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5ca65dd66c74c74b2b402f1b617bc77'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:30.849132 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 909/1796] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:38:30 2022] DELETE /identity/v3/users/f5ca65dd66c74c74b2b402f1b617bc77 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:30.853691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfbf64-2af8-4d9b-bd15-cba8ddabe0c8 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:30.854223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfbf64-2af8-4d9b-bd15-cba8ddabe0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:30.854326 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfbf64-2af8-4d9b-bd15-cba8ddabe0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:30.890392 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-5bbfbf64-2af8-4d9b-bd15-cba8ddabe0c8 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:30.893191 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5bbfbf64-2af8-4d9b-bd15-cba8ddabe0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:30.969350 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 888/1797] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:30.976012 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b9509-72fb-4f38-be57-d26d6c2c1cc9 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:30.977473 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c28b9509-72fb-4f38-be57-d26d6c2c1cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:31.039035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b9509-72fb-4f38-be57-d26d6c2c1cc9 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:31.043100 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f526a-1766-4c01-b6e4-1a39673d0f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:31.043758 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f526a-1766-4c01-b6e4-1a39673d0f3a service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:31.044179 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f526a-1766-4c01-b6e4-1a39673d0f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:31.044464 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f526a-1766-4c01-b6e4-1a39673d0f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:31.054641 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f526a-1766-4c01-b6e4-1a39673d0f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:31.056117 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f526a-1766-4c01-b6e4-1a39673d0f3a service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:31.068075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 910/1798] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:32.305119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfbf64-2af8-4d9b-bd15-cba8ddabe0c8 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:32.308688 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5bbfbf64-2af8-4d9b-bd15-cba8ddabe0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:32.333405 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfbf64-2af8-4d9b-bd15-cba8ddabe0c8 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:32.339141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a09b7-4b9a-42e5-8ea8-34bf5439495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:32.343176 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a09b7-4b9a-42e5-8ea8-34bf5439495b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:32.343846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a09b7-4b9a-42e5-8ea8-34bf5439495b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:32.345146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a09b7-4b9a-42e5-8ea8-34bf5439495b admin admin] PATH_INFO: `/v3/projects/abd03883d7974b4d85bdc1976b2553f1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:32.347186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a09b7-4b9a-42e5-8ea8-34bf5439495b admin admin] RBAC: Authorizing `identity:delete_project(project_id=abd03883d7974b4d85bdc1976b2553f1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:32.351301 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a09b7-4b9a-42e5-8ea8-34bf5439495b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:32.447878 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e17a09b7-4b9a-42e5-8ea8-34bf5439495b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd03883d7974b4d85bdc1976b2553f1', 'request_id': 'req-e17a09b7-4b9a-42e5-8ea8-34bf5439495b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:32.456424 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e17a09b7-4b9a-42e5-8ea8-34bf5439495b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd03883d7974b4d85bdc1976b2553f1', 'request_id': 'req-e17a09b7-4b9a-42e5-8ea8-34bf5439495b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:32.467681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e17a09b7-4b9a-42e5-8ea8-34bf5439495b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd03883d7974b4d85bdc1976b2553f1', 'request_id': 'req-e17a09b7-4b9a-42e5-8ea8-34bf5439495b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:32.483079 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e17a09b7-4b9a-42e5-8ea8-34bf5439495b admin admin] The token cache is being invalidate because project abd03883d7974b4d85bdc1976b2553f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:32.483634 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e17a09b7-4b9a-42e5-8ea8-34bf5439495b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:32.484477 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e17a09b7-4b9a-42e5-8ea8-34bf5439495b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:32.491221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f526a-1766-4c01-b6e4-1a39673d0f3a service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:32.491760 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 889/1799] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:38:32 2022] DELETE /identity/v3/projects/abd03883d7974b4d85bdc1976b2553f1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:32.503067 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f526a-1766-4c01-b6e4-1a39673d0f3a service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:32.523090 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:32.580152 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b1b4d-b6dd-444e-b430-829fcb4b789b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:32.581830 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b1b4d-b6dd-444e-b430-829fcb4b789b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:32.582145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b1b4d-b6dd-444e-b430-829fcb4b789b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:32.582432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b1b4d-b6dd-444e-b430-829fcb4b789b admin admin] PATH_INFO: `/v3/users/6789793d029d4c06b0e8dfee9731ba8f` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:32.584283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b1b4d-b6dd-444e-b430-829fcb4b789b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6789793d029d4c06b0e8dfee9731ba8f)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:32.586761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b1b4d-b6dd-444e-b430-829fcb4b789b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:32.695600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ff6b1b4d-b6dd-444e-b430-829fcb4b789b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6789793d029d4c06b0e8dfee9731ba8f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:32.697006 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ff6b1b4d-b6dd-444e-b430-829fcb4b789b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6789793d029d4c06b0e8dfee9731ba8f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:32.709786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ff6b1b4d-b6dd-444e-b430-829fcb4b789b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6789793d029d4c06b0e8dfee9731ba8f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:32.721263 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ff6b1b4d-b6dd-444e-b430-829fcb4b789b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6789793d029d4c06b0e8dfee9731ba8f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:32.745099 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ff6b1b4d-b6dd-444e-b430-829fcb4b789b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6789793d029d4c06b0e8dfee9731ba8f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:32.759851 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 911/1800] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:38:32 2022] DELETE /identity/v3/users/6789793d029d4c06b0e8dfee9731ba8f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:33.781674 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a09b7-4b9a-42e5-8ea8-34bf5439495b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:33.784621 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e17a09b7-4b9a-42e5-8ea8-34bf5439495b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:33.827378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a09b7-4b9a-42e5-8ea8-34bf5439495b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:33.902467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212a849-5968-4837-9951-d014fb8c9d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:33.902951 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212a849-5968-4837-9951-d014fb8c9d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:33.903289 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212a849-5968-4837-9951-d014fb8c9d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:33.903572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212a849-5968-4837-9951-d014fb8c9d89 admin admin] PATH_INFO: `/v3/projects/93c5786c201a4ba094b53769565cbe3a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:33.904766 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212a849-5968-4837-9951-d014fb8c9d89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93c5786c201a4ba094b53769565cbe3a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:33.906728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212a849-5968-4837-9951-d014fb8c9d89 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:33.960834 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:33.983691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0212a849-5968-4837-9951-d014fb8c9d89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93c5786c201a4ba094b53769565cbe3a', 'request_id': 'req-0212a849-5968-4837-9951-d014fb8c9d89'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:33.991757 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0212a849-5968-4837-9951-d014fb8c9d89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93c5786c201a4ba094b53769565cbe3a', 'request_id': 'req-0212a849-5968-4837-9951-d014fb8c9d89'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:33.999722 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0212a849-5968-4837-9951-d014fb8c9d89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93c5786c201a4ba094b53769565cbe3a', 'request_id': 'req-0212a849-5968-4837-9951-d014fb8c9d89'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:34.015346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0212a849-5968-4837-9951-d014fb8c9d89 admin admin] The token cache is being invalidate because project 93c5786c201a4ba094b53769565cbe3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:34.015713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0212a849-5968-4837-9951-d014fb8c9d89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:34.016420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0212a849-5968-4837-9951-d014fb8c9d89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:34.019174 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 890/1801] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:38:33 2022] DELETE /identity/v3/projects/93c5786c201a4ba094b53769565cbe3a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:38:34.023845 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c56f8-4a37-4eb5-a378-e61d213c1c3e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:34.024363 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c56f8-4a37-4eb5-a378-e61d213c1c3e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:34.024628 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c56f8-4a37-4eb5-a378-e61d213c1c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:34.046432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7a5c56f8-4a37-4eb5-a378-e61d213c1c3e None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:34.047590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7a5c56f8-4a37-4eb5-a378-e61d213c1c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:34.108163 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 912/1802] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:34.120306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cc460-77f7-458c-a76a-c0ccb2f985ab None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:34.120851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cc460-77f7-458c-a76a-c0ccb2f985ab None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:34.121178 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cc460-77f7-458c-a76a-c0ccb2f985ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:34.143260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-694cc460-77f7-458c-a76a-c0ccb2f985ab None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:34.144504 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-694cc460-77f7-458c-a76a-c0ccb2f985ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:34.154312 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 891/1803] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:34.159225 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c56f8-4a37-4eb5-a378-e61d213c1c3e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:34.169933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c56f8-4a37-4eb5-a378-e61d213c1c3e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:34.175494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084c267-fb58-4b09-bcf3-9f8e2c435824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:34.176155 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084c267-fb58-4b09-bcf3-9f8e2c435824 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:34.176460 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084c267-fb58-4b09-bcf3-9f8e2c435824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:34.176728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084c267-fb58-4b09-bcf3-9f8e2c435824 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:34.177458 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084c267-fb58-4b09-bcf3-9f8e2c435824 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:38:34.177773 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084c267-fb58-4b09-bcf3-9f8e2c435824 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:34.179435 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084c267-fb58-4b09-bcf3-9f8e2c435824 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:34.191741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 913/1804] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:34.196111 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cc460-77f7-458c-a76a-c0ccb2f985ab None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:34.205549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cc460-77f7-458c-a76a-c0ccb2f985ab None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:34.211415 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd7927-cd0d-4d21-8c7b-dfc47f1b890f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:34.212077 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd7927-cd0d-4d21-8c7b-dfc47f1b890f admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:34.212360 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd7927-cd0d-4d21-8c7b-dfc47f1b890f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:34.212637 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd7927-cd0d-4d21-8c7b-dfc47f1b890f admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:34.213345 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd7927-cd0d-4d21-8c7b-dfc47f1b890f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:34.215301 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd7927-cd0d-4d21-8c7b-dfc47f1b890f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:34.242526 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 892/1805] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:38:34 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:34.246816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084c267-fb58-4b09-bcf3-9f8e2c435824 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:34.256789 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084c267-fb58-4b09-bcf3-9f8e2c435824 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:34.285030 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:34.318762 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd54c9e-9723-4e9f-9e53-a1b0fc657e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:34.319363 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd54c9e-9723-4e9f-9e53-a1b0fc657e24 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:34.319652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd54c9e-9723-4e9f-9e53-a1b0fc657e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:34.319934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd54c9e-9723-4e9f-9e53-a1b0fc657e24 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:34.320631 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd54c9e-9723-4e9f-9e53-a1b0fc657e24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:34.322673 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd54c9e-9723-4e9f-9e53-a1b0fc657e24 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:34.342943 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 914/1806] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:38:34 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:34.348595 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd7927-cd0d-4d21-8c7b-dfc47f1b890f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:34.358778 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd7927-cd0d-4d21-8c7b-dfc47f1b890f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:34.364225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243c1a5-4d72-4e02-96de-b068a86dd95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:34.364876 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243c1a5-4d72-4e02-96de-b068a86dd95e admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:34.365160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243c1a5-4d72-4e02-96de-b068a86dd95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:34.365433 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243c1a5-4d72-4e02-96de-b068a86dd95e admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:34.366196 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243c1a5-4d72-4e02-96de-b068a86dd95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:34.367813 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0243c1a5-4d72-4e02-96de-b068a86dd95e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:34.378724 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 893/1807] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:34.382797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd54c9e-9723-4e9f-9e53-a1b0fc657e24 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:34.393037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd54c9e-9723-4e9f-9e53-a1b0fc657e24 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:34.398120 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b70a11-7f34-4864-97ff-231a3e29470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:34.399128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b70a11-7f34-4864-97ff-231a3e29470c admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:34.399451 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b70a11-7f34-4864-97ff-231a3e29470c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:34.399732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b70a11-7f34-4864-97ff-231a3e29470c admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:34.400460 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b70a11-7f34-4864-97ff-231a3e29470c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:34.402104 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b70a11-7f34-4864-97ff-231a3e29470c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:34.412610 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 915/1808] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:34.417230 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243c1a5-4d72-4e02-96de-b068a86dd95e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:34.428012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243c1a5-4d72-4e02-96de-b068a86dd95e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:34.432718 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63c8bd-0adf-4183-9acf-1fb5b30bf611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:34.433607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63c8bd-0adf-4183-9acf-1fb5b30bf611 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:34.433888 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63c8bd-0adf-4183-9acf-1fb5b30bf611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:34.434215 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63c8bd-0adf-4183-9acf-1fb5b30bf611 admin admin] PATH_INFO: `/v3/projects/eb268e5b5de74c41b5e1f88b0232a218/users/1921aebcac294b17928c6472fba85a50/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:34.451208 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63c8bd-0adf-4183-9acf-1fb5b30bf611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb268e5b5de74c41b5e1f88b0232a218, user_id=1921aebcac294b17928c6472fba85a50, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:34.453874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63c8bd-0adf-4183-9acf-1fb5b30bf611 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:34.470063 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 894/1809] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:38:34 2022] PUT /identity/v3/projects/eb268e5b5de74c41b5e1f88b0232a218/users/1921aebcac294b17928c6472fba85a50/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:34.475902 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26308830-3c66-4a6e-bc81-dda8bd57fb36 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:34.476201 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26308830-3c66-4a6e-bc81-dda8bd57fb36 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:34.476489 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26308830-3c66-4a6e-bc81-dda8bd57fb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:34.497318 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-26308830-3c66-4a6e-bc81-dda8bd57fb36 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:34.498607 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-26308830-3c66-4a6e-bc81-dda8bd57fb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:34.581431 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 916/1810] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:34.596317 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63c8bd-0adf-4183-9acf-1fb5b30bf611 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:34.598397 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3a63c8bd-0adf-4183-9acf-1fb5b30bf611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:34.663469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63c8bd-0adf-4183-9acf-1fb5b30bf611 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:34.667506 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35dceb-d10f-41f5-b8a9-ed200617aa59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:34.668181 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35dceb-d10f-41f5-b8a9-ed200617aa59 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:34.668461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35dceb-d10f-41f5-b8a9-ed200617aa59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:34.668733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35dceb-d10f-41f5-b8a9-ed200617aa59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:34.678673 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35dceb-d10f-41f5-b8a9-ed200617aa59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:34.680103 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35dceb-d10f-41f5-b8a9-ed200617aa59 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:34.690358 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 895/1811] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:35.513782 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40cf98-8a05-4f3b-82cf-0d37b303fa69 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:35.514333 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40cf98-8a05-4f3b-82cf-0d37b303fa69 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:35.514608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a40cf98-8a05-4f3b-82cf-0d37b303fa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:35.542539 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7a40cf98-8a05-4f3b-82cf-0d37b303fa69 None None] MFA Rules not processed for user `1921aebcac294b17928c6472fba85a50`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:35.543771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7a40cf98-8a05-4f3b-82cf-0d37b303fa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:35.613636 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 917/1812] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:35.618297 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35dceb-d10f-41f5-b8a9-ed200617aa59 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:35.629652 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35dceb-d10f-41f5-b8a9-ed200617aa59 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:35.634289 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a06d2-2e43-4b20-b1d4-5537cb2a829e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:35.634946 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a06d2-2e43-4b20-b1d4-5537cb2a829e admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:35.635232 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a06d2-2e43-4b20-b1d4-5537cb2a829e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:35.635507 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a06d2-2e43-4b20-b1d4-5537cb2a829e admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:35.636201 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a06d2-2e43-4b20-b1d4-5537cb2a829e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:35.638149 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a06d2-2e43-4b20-b1d4-5537cb2a829e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:35.676272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 896/1813] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:38:35 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:35.677678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40cf98-8a05-4f3b-82cf-0d37b303fa69 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:35.691676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a40cf98-8a05-4f3b-82cf-0d37b303fa69 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:35.743971 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:35.774017 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991a5fb-fa19-4c2f-853d-3109a6e15152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:35.774922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991a5fb-fa19-4c2f-853d-3109a6e15152 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:35.775291 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991a5fb-fa19-4c2f-853d-3109a6e15152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:35.775645 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991a5fb-fa19-4c2f-853d-3109a6e15152 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:35.776420 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991a5fb-fa19-4c2f-853d-3109a6e15152 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:35.778468 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991a5fb-fa19-4c2f-853d-3109a6e15152 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:35.807904 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 918/1814] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:38:35 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:35.812253 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a06d2-2e43-4b20-b1d4-5537cb2a829e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:35.825113 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a06d2-2e43-4b20-b1d4-5537cb2a829e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:35.832535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a86bbe-6cd5-46db-a439-9f943ec2c7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:35.833519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a86bbe-6cd5-46db-a439-9f943ec2c7ea admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:35.833847 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a86bbe-6cd5-46db-a439-9f943ec2c7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:35.834238 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a86bbe-6cd5-46db-a439-9f943ec2c7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:35.836010 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a86bbe-6cd5-46db-a439-9f943ec2c7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:35.837522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a86bbe-6cd5-46db-a439-9f943ec2c7ea admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:35.861983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 897/1815] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:35.866722 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991a5fb-fa19-4c2f-853d-3109a6e15152 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:35.879309 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991a5fb-fa19-4c2f-853d-3109a6e15152 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:35.891465 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded68e6-a4b3-45be-9092-9f2aa3a306c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:35.891465 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded68e6-a4b3-45be-9092-9f2aa3a306c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:35.891465 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded68e6-a4b3-45be-9092-9f2aa3a306c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:35.891465 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded68e6-a4b3-45be-9092-9f2aa3a306c1 admin admin] PATH_INFO: `/v3/projects/86104a64f9d54bb18b9fabfd1bf0c96b/users/008ff5db77ab42e49e2648cac5a006ed/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:35.904452 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded68e6-a4b3-45be-9092-9f2aa3a306c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86104a64f9d54bb18b9fabfd1bf0c96b, user_id=008ff5db77ab42e49e2648cac5a006ed, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:35.907174 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded68e6-a4b3-45be-9092-9f2aa3a306c1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:35.921702 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 919/1816] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:38:35 2022] PUT /identity/v3/projects/86104a64f9d54bb18b9fabfd1bf0c96b/users/008ff5db77ab42e49e2648cac5a006ed/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:35.926672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a86bbe-6cd5-46db-a439-9f943ec2c7ea admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:35.937556 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a86bbe-6cd5-46db-a439-9f943ec2c7ea admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:35.954590 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:35.997816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8a4c5-9f0e-4071-a54f-35854b861557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:35.998593 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8a4c5-9f0e-4071-a54f-35854b861557 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:35.998878 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8a4c5-9f0e-4071-a54f-35854b861557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:35.999155 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8a4c5-9f0e-4071-a54f-35854b861557 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:35.999872 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8a4c5-9f0e-4071-a54f-35854b861557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:36.001476 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8a4c5-9f0e-4071-a54f-35854b861557 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:36.012399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 898/1817] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:36.016674 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded68e6-a4b3-45be-9092-9f2aa3a306c1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:36.027223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded68e6-a4b3-45be-9092-9f2aa3a306c1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:36.031956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fa786-eab7-4458-bc41-798e2f4425fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:36.032828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fa786-eab7-4458-bc41-798e2f4425fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:36.033109 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fa786-eab7-4458-bc41-798e2f4425fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:36.033389 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fa786-eab7-4458-bc41-798e2f4425fc admin admin] PATH_INFO: `/v3/projects/86104a64f9d54bb18b9fabfd1bf0c96b/users/008ff5db77ab42e49e2648cac5a006ed/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:36.035371 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fa786-eab7-4458-bc41-798e2f4425fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=86104a64f9d54bb18b9fabfd1bf0c96b, user_id=008ff5db77ab42e49e2648cac5a006ed, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:36.039565 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fa786-eab7-4458-bc41-798e2f4425fc admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:36.054414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 920/1818] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:38:36 2022] PUT /identity/v3/projects/86104a64f9d54bb18b9fabfd1bf0c96b/users/008ff5db77ab42e49e2648cac5a006ed/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:37.582120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a841931-f436-4286-87fa-931acb65f75a None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:37.583089 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a841931-f436-4286-87fa-931acb65f75a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:37.583380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a841931-f436-4286-87fa-931acb65f75a None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:37.590570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 899/1819] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jul 14 15:38:37 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:38:37.606527 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7582e-d156-4b0f-9eff-a14441959757 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:37.608271 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7582e-d156-4b0f-9eff-a14441959757 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:37.609151 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7582e-d156-4b0f-9eff-a14441959757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:37.645989 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-50e7582e-d156-4b0f-9eff-a14441959757 None None] MFA Rules not processed for user `64f6b597a47c4a0eb08d1eabc4c0305c`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:37.647448 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-50e7582e-d156-4b0f-9eff-a14441959757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:37.766757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 921/1820] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jul 14 15:38:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:37.776682 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a841931-f436-4286-87fa-931acb65f75a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:37.778504 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5a841931-f436-4286-87fa-931acb65f75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:37.799262 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a841931-f436-4286-87fa-931acb65f75a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:37.807552 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7916f5d-4b07-4dc2-a969-42d56b622ea7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:37.808240 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7916f5d-4b07-4dc2-a969-42d56b622ea7 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:37.808523 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7916f5d-4b07-4dc2-a969-42d56b622ea7 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:37.808798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7916f5d-4b07-4dc2-a969-42d56b622ea7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:37.819119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7916f5d-4b07-4dc2-a969-42d56b622ea7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:37.820767 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7916f5d-4b07-4dc2-a969-42d56b622ea7 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:37.834394 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 900/1821] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:38.864564 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83031175-77d3-4617-9669-ff67337a5462 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:38.865109 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83031175-77d3-4617-9669-ff67337a5462 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:38.865109 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83031175-77d3-4617-9669-ff67337a5462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:38.957933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-83031175-77d3-4617-9669-ff67337a5462 None None] MFA Rules not processed for user `008ff5db77ab42e49e2648cac5a006ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:38.966274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-83031175-77d3-4617-9669-ff67337a5462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:39.181176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 922/1822] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:38 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:39.196627 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7916f5d-4b07-4dc2-a969-42d56b622ea7 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:39.200508 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b7916f5d-4b07-4dc2-a969-42d56b622ea7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:39.282578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7916f5d-4b07-4dc2-a969-42d56b622ea7 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:39.291004 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fa197-52e1-4bca-9056-501d9319bcb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:39.291926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fa197-52e1-4bca-9056-501d9319bcb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:39.292391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fa197-52e1-4bca-9056-501d9319bcb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:39.293955 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fa197-52e1-4bca-9056-501d9319bcb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:39.387174 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7fa197-52e1-4bca-9056-501d9319bcb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:39.388905 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7fa197-52e1-4bca-9056-501d9319bcb9 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:39.400855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 901/1823] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:40.971437 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83031175-77d3-4617-9669-ff67337a5462 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:40.981053 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83031175-77d3-4617-9669-ff67337a5462 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:40.984717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53522373-161e-4de4-8b6a-e44b7c1767ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:40.985363 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53522373-161e-4de4-8b6a-e44b7c1767ed service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:40.985649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53522373-161e-4de4-8b6a-e44b7c1767ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:40.986041 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53522373-161e-4de4-8b6a-e44b7c1767ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:40.992244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:40.996447 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53522373-161e-4de4-8b6a-e44b7c1767ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:40.998755 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53522373-161e-4de4-8b6a-e44b7c1767ed service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:41.009744 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 923/1824] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:40 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:42.425984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fa197-52e1-4bca-9056-501d9319bcb9 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:42.427700 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ca7fa197-52e1-4bca-9056-501d9319bcb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:42.532340 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:42.538573 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923dba8-1b27-48d5-9340-18260bce0778 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:42.539689 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923dba8-1b27-48d5-9340-18260bce0778 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:42.540388 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923dba8-1b27-48d5-9340-18260bce0778 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:42.542048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fa197-52e1-4bca-9056-501d9319bcb9 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:42.544418 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 924/1825] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jul 14 15:38:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:38:42.550956 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a32a53-c907-4350-83b0-7a2cafbaba2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:42.552297 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a32a53-c907-4350-83b0-7a2cafbaba2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:42.553136 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a32a53-c907-4350-83b0-7a2cafbaba2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:42.553851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a32a53-c907-4350-83b0-7a2cafbaba2e admin admin] PATH_INFO: `/v3/users/f5578fb4c3ad4225a85bc271ea363993` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:42.555848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a32a53-c907-4350-83b0-7a2cafbaba2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5578fb4c3ad4225a85bc271ea363993)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:42.558134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ca40e-5030-45a2-bc8b-11a1bfd8f9e5 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:42.558798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ca40e-5030-45a2-bc8b-11a1bfd8f9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:42.558896 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ca40e-5030-45a2-bc8b-11a1bfd8f9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:42.560147 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a32a53-c907-4350-83b0-7a2cafbaba2e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:42.606486 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b58ca40e-5030-45a2-bc8b-11a1bfd8f9e5 None None] MFA Rules not processed for user `64f6b597a47c4a0eb08d1eabc4c0305c`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:42.607996 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b58ca40e-5030-45a2-bc8b-11a1bfd8f9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:42.636245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 925/1826] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jul 14 15:38:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:42.657190 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ca40e-5030-45a2-bc8b-11a1bfd8f9e5 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:42.667690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-71a32a53-c907-4350-83b0-7a2cafbaba2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5578fb4c3ad4225a85bc271ea363993'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:42.671127 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ca40e-5030-45a2-bc8b-11a1bfd8f9e5 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:42.680033 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e12bc7-2978-451f-ada2-250448c0cb0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:42.680741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e12bc7-2978-451f-ada2-250448c0cb0e service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:42.681037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e12bc7-2978-451f-ada2-250448c0cb0e service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:42.681328 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e12bc7-2978-451f-ada2-250448c0cb0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:42.693796 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-71a32a53-c907-4350-83b0-7a2cafbaba2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5578fb4c3ad4225a85bc271ea363993'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:42.693925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e12bc7-2978-451f-ada2-250448c0cb0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:42.695700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e12bc7-2978-451f-ada2-250448c0cb0e service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:42.711572 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 926/1827] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:42.730742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-71a32a53-c907-4350-83b0-7a2cafbaba2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5578fb4c3ad4225a85bc271ea363993'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:42.741221 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-71a32a53-c907-4350-83b0-7a2cafbaba2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5578fb4c3ad4225a85bc271ea363993'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:42.743104 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-71a32a53-c907-4350-83b0-7a2cafbaba2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5578fb4c3ad4225a85bc271ea363993'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:42.754132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 902/1828] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:38:42 2022] DELETE /identity/v3/users/f5578fb4c3ad4225a85bc271ea363993 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:42.758679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebb589-1363-4288-b1c6-50b94b6f6f4e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:42.758679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebb589-1363-4288-b1c6-50b94b6f6f4e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:42.759765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebb589-1363-4288-b1c6-50b94b6f6f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:42.780819 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f7ebb589-1363-4288-b1c6-50b94b6f6f4e None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:42.782117 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f7ebb589-1363-4288-b1c6-50b94b6f6f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:42.858366 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 927/1829] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:42.870568 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a32a53-c907-4350-83b0-7a2cafbaba2e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:42.872302 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-71a32a53-c907-4350-83b0-7a2cafbaba2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:42.974982 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a32a53-c907-4350-83b0-7a2cafbaba2e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:42.979643 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727d9f4-6c6e-494b-94e1-0eb0975a983c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:42.980516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727d9f4-6c6e-494b-94e1-0eb0975a983c service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:42.980901 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727d9f4-6c6e-494b-94e1-0eb0975a983c service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:42.981277 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727d9f4-6c6e-494b-94e1-0eb0975a983c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:42.991600 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727d9f4-6c6e-494b-94e1-0eb0975a983c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:42.993190 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9727d9f4-6c6e-494b-94e1-0eb0975a983c service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:43.004688 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 903/1830] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:38:43.421661 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ebb589-1363-4288-b1c6-50b94b6f6f4e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:43.422905 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f7ebb589-1363-4288-b1c6-50b94b6f6f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:43.437334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ebb589-1363-4288-b1c6-50b94b6f6f4e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:43.444616 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cca010-712c-4880-bb24-5bd84f842715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:43.445498 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cca010-712c-4880-bb24-5bd84f842715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:43.445785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cca010-712c-4880-bb24-5bd84f842715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:43.446124 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cca010-712c-4880-bb24-5bd84f842715 admin admin] PATH_INFO: `/v3/projects/13addd5926c045e7a9d4b7d1924bf908` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:43.447347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cca010-712c-4880-bb24-5bd84f842715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13addd5926c045e7a9d4b7d1924bf908)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:43.449267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cca010-712c-4880-bb24-5bd84f842715 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:43.498565 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e4cca010-712c-4880-bb24-5bd84f842715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13addd5926c045e7a9d4b7d1924bf908', 'request_id': 'req-e4cca010-712c-4880-bb24-5bd84f842715'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:43.504629 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e4cca010-712c-4880-bb24-5bd84f842715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13addd5926c045e7a9d4b7d1924bf908', 'request_id': 'req-e4cca010-712c-4880-bb24-5bd84f842715'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:43.512152 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e4cca010-712c-4880-bb24-5bd84f842715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13addd5926c045e7a9d4b7d1924bf908', 'request_id': 'req-e4cca010-712c-4880-bb24-5bd84f842715'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:43.523973 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e4cca010-712c-4880-bb24-5bd84f842715 admin admin] The token cache is being invalidate because project 13addd5926c045e7a9d4b7d1924bf908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:43.524263 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e4cca010-712c-4880-bb24-5bd84f842715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:43.524968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e4cca010-712c-4880-bb24-5bd84f842715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:43.526546 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 928/1831] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:38:43 2022] DELETE /identity/v3/projects/13addd5926c045e7a9d4b7d1924bf908 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:43.530758 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727d9f4-6c6e-494b-94e1-0eb0975a983c service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:43.543210 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727d9f4-6c6e-494b-94e1-0eb0975a983c service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:43.609650 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f4d37-efaa-4347-a3f7-820b0511fd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:43.610618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f4d37-efaa-4347-a3f7-820b0511fd7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:43.611102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f4d37-efaa-4347-a3f7-820b0511fd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:43.611221 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f4d37-efaa-4347-a3f7-820b0511fd7d admin admin] PATH_INFO: `/v3/users/48208c350bec41ea832e2425c06d3cd3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:43.612409 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f4d37-efaa-4347-a3f7-820b0511fd7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=48208c350bec41ea832e2425c06d3cd3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:43.614420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f4d37-efaa-4347-a3f7-820b0511fd7d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:43.638743 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:43.667020 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9d3f4d37-efaa-4347-a3f7-820b0511fd7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48208c350bec41ea832e2425c06d3cd3'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:43.674554 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9d3f4d37-efaa-4347-a3f7-820b0511fd7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48208c350bec41ea832e2425c06d3cd3'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:43.687433 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9d3f4d37-efaa-4347-a3f7-820b0511fd7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48208c350bec41ea832e2425c06d3cd3'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:43.695332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9d3f4d37-efaa-4347-a3f7-820b0511fd7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48208c350bec41ea832e2425c06d3cd3'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:43.696343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9d3f4d37-efaa-4347-a3f7-820b0511fd7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48208c350bec41ea832e2425c06d3cd3'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:43.703254 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 904/1832] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:38:43 2022] DELETE /identity/v3/users/48208c350bec41ea832e2425c06d3cd3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:44.078164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cca010-712c-4880-bb24-5bd84f842715 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:44.080634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e4cca010-712c-4880-bb24-5bd84f842715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:44.102546 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cca010-712c-4880-bb24-5bd84f842715 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:44.194150 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:44.203826 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f173f2-df07-4b1c-8853-c86a0cd68f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:44.205014 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f173f2-df07-4b1c-8853-c86a0cd68f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:44.205484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f173f2-df07-4b1c-8853-c86a0cd68f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:44.205898 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f173f2-df07-4b1c-8853-c86a0cd68f8c admin admin] PATH_INFO: `/v3/projects/6d567aece73342f2bb0f76cca72459f6` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:44.207538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f173f2-df07-4b1c-8853-c86a0cd68f8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d567aece73342f2bb0f76cca72459f6)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:44.211353 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f173f2-df07-4b1c-8853-c86a0cd68f8c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:44.282750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-97f173f2-df07-4b1c-8853-c86a0cd68f8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d567aece73342f2bb0f76cca72459f6', 'request_id': 'req-97f173f2-df07-4b1c-8853-c86a0cd68f8c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:44.291084 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-97f173f2-df07-4b1c-8853-c86a0cd68f8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d567aece73342f2bb0f76cca72459f6', 'request_id': 'req-97f173f2-df07-4b1c-8853-c86a0cd68f8c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:44.308389 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-97f173f2-df07-4b1c-8853-c86a0cd68f8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d567aece73342f2bb0f76cca72459f6', 'request_id': 'req-97f173f2-df07-4b1c-8853-c86a0cd68f8c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:44.324092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-97f173f2-df07-4b1c-8853-c86a0cd68f8c admin admin] The token cache is being invalidate because project 6d567aece73342f2bb0f76cca72459f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:44.324512 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-97f173f2-df07-4b1c-8853-c86a0cd68f8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:44.325279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-97f173f2-df07-4b1c-8853-c86a0cd68f8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:44.327118 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 929/1833] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:38:44 2022] DELETE /identity/v3/projects/6d567aece73342f2bb0f76cca72459f6 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:44.332552 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68e490-9aef-4774-8ec2-19cdefc07843 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:44.332850 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68e490-9aef-4774-8ec2-19cdefc07843 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:44.333130 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68e490-9aef-4774-8ec2-19cdefc07843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:44.355024 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3e68e490-9aef-4774-8ec2-19cdefc07843 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:44.356336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3e68e490-9aef-4774-8ec2-19cdefc07843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:44.430885 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 905/1834] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:44.439690 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0370048-f8ac-428c-ace7-3fdd380c1d5b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:44.440109 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0370048-f8ac-428c-ace7-3fdd380c1d5b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:44.440624 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0370048-f8ac-428c-ace7-3fdd380c1d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:44.462520 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c0370048-f8ac-428c-ace7-3fdd380c1d5b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:44.463752 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c0370048-f8ac-428c-ace7-3fdd380c1d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:44.473354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 930/1835] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:44.477456 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68e490-9aef-4774-8ec2-19cdefc07843 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:44.488147 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68e490-9aef-4774-8ec2-19cdefc07843 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:44.492732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543a4a3-3bc8-45d5-8949-70b377b98b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:44.493396 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543a4a3-3bc8-45d5-8949-70b377b98b30 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:44.493685 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543a4a3-3bc8-45d5-8949-70b377b98b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:44.493960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543a4a3-3bc8-45d5-8949-70b377b98b30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:44.494720 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543a4a3-3bc8-45d5-8949-70b377b98b30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:38:44.495026 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543a4a3-3bc8-45d5-8949-70b377b98b30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:44.496657 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543a4a3-3bc8-45d5-8949-70b377b98b30 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:44.509613 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 906/1836] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:44.514325 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0370048-f8ac-428c-ace7-3fdd380c1d5b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:44.524182 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0370048-f8ac-428c-ace7-3fdd380c1d5b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:44.529524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2391bb6-3b3e-4286-9376-4b9d3a513f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:44.530215 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2391bb6-3b3e-4286-9376-4b9d3a513f28 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:44.530501 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2391bb6-3b3e-4286-9376-4b9d3a513f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:44.530776 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2391bb6-3b3e-4286-9376-4b9d3a513f28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:44.531462 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2391bb6-3b3e-4286-9376-4b9d3a513f28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:44.533906 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2391bb6-3b3e-4286-9376-4b9d3a513f28 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:44.565346 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 931/1837] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:38:44 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:38:44.566736 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543a4a3-3bc8-45d5-8949-70b377b98b30 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:44.576932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543a4a3-3bc8-45d5-8949-70b377b98b30 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:44.636439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f073461-153d-41fc-8069-521f8bd8d326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:44.637106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f073461-153d-41fc-8069-521f8bd8d326 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:44.637391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f073461-153d-41fc-8069-521f8bd8d326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:44.637669 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f073461-153d-41fc-8069-521f8bd8d326 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:44.638395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f073461-153d-41fc-8069-521f8bd8d326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:44.640310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f073461-153d-41fc-8069-521f8bd8d326 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:44.660282 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 907/1838] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:38:44 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:44.664473 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2391bb6-3b3e-4286-9376-4b9d3a513f28 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:44.675931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2391bb6-3b3e-4286-9376-4b9d3a513f28 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:44.680784 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa97bbb-d814-4240-9747-9c490e9b4659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:44.681450 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa97bbb-d814-4240-9747-9c490e9b4659 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:44.681737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa97bbb-d814-4240-9747-9c490e9b4659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:44.682016 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa97bbb-d814-4240-9747-9c490e9b4659 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:44.682788 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa97bbb-d814-4240-9747-9c490e9b4659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:44.684457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa97bbb-d814-4240-9747-9c490e9b4659 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:44.695191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 932/1839] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:44.699178 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f073461-153d-41fc-8069-521f8bd8d326 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:44.709913 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f073461-153d-41fc-8069-521f8bd8d326 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:44.715289 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e651b6-bcd3-43a8-bc65-17e0b18d86ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:44.715970 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e651b6-bcd3-43a8-bc65-17e0b18d86ef admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:44.716280 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e651b6-bcd3-43a8-bc65-17e0b18d86ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:44.716583 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e651b6-bcd3-43a8-bc65-17e0b18d86ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:44.717301 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e651b6-bcd3-43a8-bc65-17e0b18d86ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:44.718984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e651b6-bcd3-43a8-bc65-17e0b18d86ef admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:44.730933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 908/1840] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:44.735253 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa97bbb-d814-4240-9747-9c490e9b4659 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:44.746084 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa97bbb-d814-4240-9747-9c490e9b4659 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:44.750573 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5b6af-313c-4d4c-942d-69da7a595b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:44.751450 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5b6af-313c-4d4c-942d-69da7a595b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:44.751734 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5b6af-313c-4d4c-942d-69da7a595b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:44.752045 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5b6af-313c-4d4c-942d-69da7a595b90 admin admin] PATH_INFO: `/v3/projects/cb2b29088ca64e2789b52af5d3cae10d/users/a818d08446704000adcc8dac8f6fb695/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:44.766772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5b6af-313c-4d4c-942d-69da7a595b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb2b29088ca64e2789b52af5d3cae10d, user_id=a818d08446704000adcc8dac8f6fb695, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:44.770270 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5b6af-313c-4d4c-942d-69da7a595b90 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:44.784641 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 933/1841] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:38:44 2022] PUT /identity/v3/projects/cb2b29088ca64e2789b52af5d3cae10d/users/a818d08446704000adcc8dac8f6fb695/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:44.797469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55673c5-6c75-42a2-a23f-4fe8440f06a6 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:44.797771 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55673c5-6c75-42a2-a23f-4fe8440f06a6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:44.798036 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55673c5-6c75-42a2-a23f-4fe8440f06a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:44.804912 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:44.825729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c55673c5-6c75-42a2-a23f-4fe8440f06a6 None None] MFA Rules not processed for user `a818d08446704000adcc8dac8f6fb695`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:44.826975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c55673c5-6c75-42a2-a23f-4fe8440f06a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:44.897671 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 909/1842] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:44.903363 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5b6af-313c-4d4c-942d-69da7a595b90 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:45.014457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5b6af-313c-4d4c-942d-69da7a595b90 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:45.020238 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddb886-38bd-4228-98da-90419bbf2ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:45.020918 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddb886-38bd-4228-98da-90419bbf2ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:45.021209 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddb886-38bd-4228-98da-90419bbf2ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:45.021515 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddb886-38bd-4228-98da-90419bbf2ec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:45.022219 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddb886-38bd-4228-98da-90419bbf2ec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:45.024393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddb886-38bd-4228-98da-90419bbf2ec6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:45.077051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 934/1843] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:38:44 2022] POST /identity/v3/projects => generated 399 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:38:45.082589 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55673c5-6c75-42a2-a23f-4fe8440f06a6 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:45.094169 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55673c5-6c75-42a2-a23f-4fe8440f06a6 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:45.208314 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d387af-50f5-428e-9a8c-b8d07b5ea773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:45.209335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d387af-50f5-428e-9a8c-b8d07b5ea773 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:45.209557 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d387af-50f5-428e-9a8c-b8d07b5ea773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:45.209872 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d387af-50f5-428e-9a8c-b8d07b5ea773 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:45.211015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d387af-50f5-428e-9a8c-b8d07b5ea773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:45.213500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d387af-50f5-428e-9a8c-b8d07b5ea773 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:45.267909 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 910/1844] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:38:45 2022] POST /identity/v3/users => generated 306 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:38:45.272070 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddb886-38bd-4228-98da-90419bbf2ec6 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:45.287940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddb886-38bd-4228-98da-90419bbf2ec6 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:45.305492 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bf8e1-370f-4073-a377-0d3c671d81b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:45.306354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bf8e1-370f-4073-a377-0d3c671d81b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:45.306751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bf8e1-370f-4073-a377-0d3c671d81b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:45.307136 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bf8e1-370f-4073-a377-0d3c671d81b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:45.308105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bf8e1-370f-4073-a377-0d3c671d81b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:45.309734 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bf8e1-370f-4073-a377-0d3c671d81b2 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:45.318960 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:45.346284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 935/1845] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:45.348208 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d387af-50f5-428e-9a8c-b8d07b5ea773 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:45.366091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d387af-50f5-428e-9a8c-b8d07b5ea773 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:45.382485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b2cba-120b-4cb4-9704-dc52ab0a9aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:45.384358 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b2cba-120b-4cb4-9704-dc52ab0a9aa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:45.384830 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b2cba-120b-4cb4-9704-dc52ab0a9aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:45.385370 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b2cba-120b-4cb4-9704-dc52ab0a9aa4 admin admin] PATH_INFO: `/v3/projects/7c32cd6c24dc4da695d97e3201314aeb/users/0fbdb59b48b041249cd2b84abccf94b9/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:45.426183 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b2cba-120b-4cb4-9704-dc52ab0a9aa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c32cd6c24dc4da695d97e3201314aeb, user_id=0fbdb59b48b041249cd2b84abccf94b9, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:45.431646 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b2cba-120b-4cb4-9704-dc52ab0a9aa4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:45.472949 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 911/1846] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:38:45 2022] PUT /identity/v3/projects/7c32cd6c24dc4da695d97e3201314aeb/users/0fbdb59b48b041249cd2b84abccf94b9/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:45.474237 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bf8e1-370f-4073-a377-0d3c671d81b2 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:45.484637 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bf8e1-370f-4073-a377-0d3c671d81b2 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:45.553333 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c4d6d-d506-4b51-88e2-12aa10cc254f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:45.554007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c4d6d-d506-4b51-88e2-12aa10cc254f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:45.554329 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c4d6d-d506-4b51-88e2-12aa10cc254f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:45.554612 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c4d6d-d506-4b51-88e2-12aa10cc254f admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:45.555344 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c4d6d-d506-4b51-88e2-12aa10cc254f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:45.556959 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c4d6d-d506-4b51-88e2-12aa10cc254f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:45.567115 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 936/1847] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:38:45.571255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b2cba-120b-4cb4-9704-dc52ab0a9aa4 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:45.582509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b2cba-120b-4cb4-9704-dc52ab0a9aa4 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:45.587298 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8bea1-704f-4c30-a5e9-5f6235747f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:45.588262 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8bea1-704f-4c30-a5e9-5f6235747f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:45.588614 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8bea1-704f-4c30-a5e9-5f6235747f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:45.588963 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8bea1-704f-4c30-a5e9-5f6235747f65 admin admin] PATH_INFO: `/v3/projects/7c32cd6c24dc4da695d97e3201314aeb/users/0fbdb59b48b041249cd2b84abccf94b9/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:45.591542 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8bea1-704f-4c30-a5e9-5f6235747f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c32cd6c24dc4da695d97e3201314aeb, user_id=0fbdb59b48b041249cd2b84abccf94b9, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:45.594374 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8bea1-704f-4c30-a5e9-5f6235747f65 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:45.607463 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 912/1848] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:38:45 2022] PUT /identity/v3/projects/7c32cd6c24dc4da695d97e3201314aeb/users/0fbdb59b48b041249cd2b84abccf94b9/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:45.619161 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee9e4a-4421-400a-963c-ca4f8271da50 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:45.619474 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee9e4a-4421-400a-963c-ca4f8271da50 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:45.619749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee9e4a-4421-400a-963c-ca4f8271da50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:45.653364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a2ee9e4a-4421-400a-963c-ca4f8271da50 None None] MFA Rules not processed for user `0fbdb59b48b041249cd2b84abccf94b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:45.654652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a2ee9e4a-4421-400a-963c-ca4f8271da50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:45.740564 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 937/1849] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:45 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:45.751855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8bea1-704f-4c30-a5e9-5f6235747f65 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:45.753929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8da8bea1-704f-4c30-a5e9-5f6235747f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:45.825983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:45.833779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8bea1-704f-4c30-a5e9-5f6235747f65 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:45.838822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f09a0-66c2-4ef2-ab03-2f1a3ca71b29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:45.839611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f09a0-66c2-4ef2-ab03-2f1a3ca71b29 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:45.839963 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f09a0-66c2-4ef2-ab03-2f1a3ca71b29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:45.840257 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f09a0-66c2-4ef2-ab03-2f1a3ca71b29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:45.871383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f09a0-66c2-4ef2-ab03-2f1a3ca71b29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:45.873177 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f09a0-66c2-4ef2-ab03-2f1a3ca71b29 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:45.887805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 913/1850] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:45 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:45.991586 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee9e4a-4421-400a-963c-ca4f8271da50 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:46.001766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee9e4a-4421-400a-963c-ca4f8271da50 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:46.005694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05701fd-4f5a-4ece-94d6-98ae293f3a5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:46.006466 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05701fd-4f5a-4ece-94d6-98ae293f3a5d service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:46.006828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05701fd-4f5a-4ece-94d6-98ae293f3a5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:46.007185 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05701fd-4f5a-4ece-94d6-98ae293f3a5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:46.081181 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05701fd-4f5a-4ece-94d6-98ae293f3a5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:46.082752 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05701fd-4f5a-4ece-94d6-98ae293f3a5d service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:46.093527 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 938/1851] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:55.881656 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:56.090799 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:57.828780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f09a0-66c2-4ef2-ab03-2f1a3ca71b29 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:57.894912 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f09a0-66c2-4ef2-ab03-2f1a3ca71b29 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:57.899615 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0de7e-e4d3-4e21-8763-5c24a945706c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:57.900491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0de7e-e4d3-4e21-8763-5c24a945706c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:57.900777 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0de7e-e4d3-4e21-8763-5c24a945706c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:57.901055 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0de7e-e4d3-4e21-8763-5c24a945706c admin admin] PATH_INFO: `/v3/users/a818d08446704000adcc8dac8f6fb695` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:57.902311 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0de7e-e4d3-4e21-8763-5c24a945706c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a818d08446704000adcc8dac8f6fb695)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:57.904244 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0de7e-e4d3-4e21-8763-5c24a945706c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:57.952882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d2d0de7e-e4d3-4e21-8763-5c24a945706c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a818d08446704000adcc8dac8f6fb695'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:57.961625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d2d0de7e-e4d3-4e21-8763-5c24a945706c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a818d08446704000adcc8dac8f6fb695'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:57.973852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d2d0de7e-e4d3-4e21-8763-5c24a945706c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a818d08446704000adcc8dac8f6fb695'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:57.981813 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d2d0de7e-e4d3-4e21-8763-5c24a945706c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a818d08446704000adcc8dac8f6fb695'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:57.982630 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d2d0de7e-e4d3-4e21-8763-5c24a945706c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a818d08446704000adcc8dac8f6fb695'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:57.989736 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 914/1852] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:38:57 2022] DELETE /identity/v3/users/a818d08446704000adcc8dac8f6fb695 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:57.994323 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e763f-1c03-4e06-843d-9a1d9fa28dc8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:57.994807 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e763f-1c03-4e06-843d-9a1d9fa28dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:57.994903 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e763f-1c03-4e06-843d-9a1d9fa28dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:58.013703 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-013e763f-1c03-4e06-843d-9a1d9fa28dc8 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:58.014975 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-013e763f-1c03-4e06-843d-9a1d9fa28dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:58.076921 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 939/1853] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:58.087504 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0de7e-e4d3-4e21-8763-5c24a945706c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:58.088956 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d2d0de7e-e4d3-4e21-8763-5c24a945706c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:58.155255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0de7e-e4d3-4e21-8763-5c24a945706c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:58.159436 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064c173-47bc-4a8b-ba2b-6392b2ee733e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:58.160080 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064c173-47bc-4a8b-ba2b-6392b2ee733e service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:58.160364 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064c173-47bc-4a8b-ba2b-6392b2ee733e service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:58.160640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064c173-47bc-4a8b-ba2b-6392b2ee733e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:58.170370 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064c173-47bc-4a8b-ba2b-6392b2ee733e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:58.171857 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064c173-47bc-4a8b-ba2b-6392b2ee733e service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:58.182132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 915/1854] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:38:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:38:58.594211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e763f-1c03-4e06-843d-9a1d9fa28dc8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:58.595713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-013e763f-1c03-4e06-843d-9a1d9fa28dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:58.611693 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e763f-1c03-4e06-843d-9a1d9fa28dc8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:58.619123 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cc881-2806-4bcb-a225-80dc378e8cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:58.621487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cc881-2806-4bcb-a225-80dc378e8cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:58.621787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cc881-2806-4bcb-a225-80dc378e8cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:58.622104 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cc881-2806-4bcb-a225-80dc378e8cc1 admin admin] PATH_INFO: `/v3/projects/cb2b29088ca64e2789b52af5d3cae10d` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:58.623371 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cc881-2806-4bcb-a225-80dc378e8cc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb2b29088ca64e2789b52af5d3cae10d)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:58.625318 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597cc881-2806-4bcb-a225-80dc378e8cc1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:58.728163 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-597cc881-2806-4bcb-a225-80dc378e8cc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb2b29088ca64e2789b52af5d3cae10d', 'request_id': 'req-597cc881-2806-4bcb-a225-80dc378e8cc1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:58.735069 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-597cc881-2806-4bcb-a225-80dc378e8cc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb2b29088ca64e2789b52af5d3cae10d', 'request_id': 'req-597cc881-2806-4bcb-a225-80dc378e8cc1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:58.749003 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-597cc881-2806-4bcb-a225-80dc378e8cc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb2b29088ca64e2789b52af5d3cae10d', 'request_id': 'req-597cc881-2806-4bcb-a225-80dc378e8cc1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:58.778260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-597cc881-2806-4bcb-a225-80dc378e8cc1 admin admin] The token cache is being invalidate because project cb2b29088ca64e2789b52af5d3cae10d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:58.778592 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-597cc881-2806-4bcb-a225-80dc378e8cc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:58.786725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-597cc881-2806-4bcb-a225-80dc378e8cc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:58.791884 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 940/1855] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:38:58 2022] DELETE /identity/v3/projects/cb2b29088ca64e2789b52af5d3cae10d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:58.795527 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064c173-47bc-4a8b-ba2b-6392b2ee733e service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:58.806905 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064c173-47bc-4a8b-ba2b-6392b2ee733e service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:58.835050 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:58.901184 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3bfcc-6020-41a3-a846-0331330aac24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:58.902112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3bfcc-6020-41a3-a846-0331330aac24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:58.902395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3bfcc-6020-41a3-a846-0331330aac24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:58.902673 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3bfcc-6020-41a3-a846-0331330aac24 admin admin] PATH_INFO: `/v3/users/0fbdb59b48b041249cd2b84abccf94b9` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:58.903900 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3bfcc-6020-41a3-a846-0331330aac24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fbdb59b48b041249cd2b84abccf94b9)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:58.905848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3bfcc-6020-41a3-a846-0331330aac24 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:58.968971 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0ca3bfcc-6020-41a3-a846-0331330aac24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fbdb59b48b041249cd2b84abccf94b9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:58.981436 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0ca3bfcc-6020-41a3-a846-0331330aac24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fbdb59b48b041249cd2b84abccf94b9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:58.997431 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0ca3bfcc-6020-41a3-a846-0331330aac24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fbdb59b48b041249cd2b84abccf94b9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:59.008580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0ca3bfcc-6020-41a3-a846-0331330aac24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fbdb59b48b041249cd2b84abccf94b9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:59.009850 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0ca3bfcc-6020-41a3-a846-0331330aac24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fbdb59b48b041249cd2b84abccf94b9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:59.024475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 916/1856] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:38:58 2022] DELETE /identity/v3/users/0fbdb59b48b041249cd2b84abccf94b9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:59.384308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cc881-2806-4bcb-a225-80dc378e8cc1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:59.385847 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-597cc881-2806-4bcb-a225-80dc378e8cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:59.406499 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cc881-2806-4bcb-a225-80dc378e8cc1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:59.480611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4f3d0-3f41-481f-9cbe-fdf5e47e022e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:59.481509 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4f3d0-3f41-481f-9cbe-fdf5e47e022e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:59.481799 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4f3d0-3f41-481f-9cbe-fdf5e47e022e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:59.482106 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4f3d0-3f41-481f-9cbe-fdf5e47e022e admin admin] PATH_INFO: `/v3/projects/7c32cd6c24dc4da695d97e3201314aeb` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:59.483350 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4f3d0-3f41-481f-9cbe-fdf5e47e022e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c32cd6c24dc4da695d97e3201314aeb)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:59.485289 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4f3d0-3f41-481f-9cbe-fdf5e47e022e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:59.525588 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:59.559734 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d6a4f3d0-3f41-481f-9cbe-fdf5e47e022e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c32cd6c24dc4da695d97e3201314aeb', 'request_id': 'req-d6a4f3d0-3f41-481f-9cbe-fdf5e47e022e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:59.570902 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d6a4f3d0-3f41-481f-9cbe-fdf5e47e022e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c32cd6c24dc4da695d97e3201314aeb', 'request_id': 'req-d6a4f3d0-3f41-481f-9cbe-fdf5e47e022e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:59.580193 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d6a4f3d0-3f41-481f-9cbe-fdf5e47e022e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c32cd6c24dc4da695d97e3201314aeb', 'request_id': 'req-d6a4f3d0-3f41-481f-9cbe-fdf5e47e022e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:59.593576 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d6a4f3d0-3f41-481f-9cbe-fdf5e47e022e admin admin] The token cache is being invalidate because project 7c32cd6c24dc4da695d97e3201314aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:38:59.593896 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d6a4f3d0-3f41-481f-9cbe-fdf5e47e022e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:59.594733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d6a4f3d0-3f41-481f-9cbe-fdf5e47e022e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:38:59.597142 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 941/1857] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:38:59 2022] DELETE /identity/v3/projects/7c32cd6c24dc4da695d97e3201314aeb => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:38:59.602368 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd206cad-51b2-46f0-9e47-357ff7a1bfb7 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:59.602671 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd206cad-51b2-46f0-9e47-357ff7a1bfb7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:59.602957 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd206cad-51b2-46f0-9e47-357ff7a1bfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:59.632059 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-bd206cad-51b2-46f0-9e47-357ff7a1bfb7 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:59.633402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bd206cad-51b2-46f0-9e47-357ff7a1bfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:59.716201 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 917/1858] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:38:59.725166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71be885-ed39-47f5-b2ad-a384729b8b26 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:59.725462 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71be885-ed39-47f5-b2ad-a384729b8b26 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:59.725750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71be885-ed39-47f5-b2ad-a384729b8b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:59.749496 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b71be885-ed39-47f5-b2ad-a384729b8b26 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:38:59.751794 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b71be885-ed39-47f5-b2ad-a384729b8b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:38:59.763614 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 942/1859] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:38:59.768043 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd206cad-51b2-46f0-9e47-357ff7a1bfb7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:59.780596 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd206cad-51b2-46f0-9e47-357ff7a1bfb7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:59.788527 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54668d3c-ee16-43d4-ad6d-4507bea14ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:59.789222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54668d3c-ee16-43d4-ad6d-4507bea14ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:59.789513 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54668d3c-ee16-43d4-ad6d-4507bea14ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:59.789794 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54668d3c-ee16-43d4-ad6d-4507bea14ff1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:59.790833 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54668d3c-ee16-43d4-ad6d-4507bea14ff1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:38:59.791187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54668d3c-ee16-43d4-ad6d-4507bea14ff1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:59.792938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54668d3c-ee16-43d4-ad6d-4507bea14ff1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:59.819143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 918/1860] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:38:59.820138 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71be885-ed39-47f5-b2ad-a384729b8b26 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:59.832662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71be885-ed39-47f5-b2ad-a384729b8b26 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:59.849991 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8065b-80f1-440b-9b6c-09f3d634795d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:38:59.850773 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8065b-80f1-440b-9b6c-09f3d634795d admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:38:59.851011 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8065b-80f1-440b-9b6c-09f3d634795d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:38:59.852897 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8065b-80f1-440b-9b6c-09f3d634795d admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:38:59.854394 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8065b-80f1-440b-9b6c-09f3d634795d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:38:59.860703 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8065b-80f1-440b-9b6c-09f3d634795d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:38:59.903160 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 943/1861] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:38:59 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:38:59.906710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54668d3c-ee16-43d4-ad6d-4507bea14ff1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:38:59.934385 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54668d3c-ee16-43d4-ad6d-4507bea14ff1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:38:59.981803 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:00.053414 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d167d-1f7c-43da-a1b3-ca7230512033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:00.054246 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d167d-1f7c-43da-a1b3-ca7230512033 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:00.054775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d167d-1f7c-43da-a1b3-ca7230512033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:00.056343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d167d-1f7c-43da-a1b3-ca7230512033 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:00.056343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d167d-1f7c-43da-a1b3-ca7230512033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:00.059403 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d167d-1f7c-43da-a1b3-ca7230512033 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:00.107362 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 919/1862] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:38:59 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:00.111333 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8065b-80f1-440b-9b6c-09f3d634795d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:00.132420 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8065b-80f1-440b-9b6c-09f3d634795d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:00.140534 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cefe3-33c6-4445-a3f5-388e6e6a5c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:00.152153 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cefe3-33c6-4445-a3f5-388e6e6a5c5a admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:00.152284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cefe3-33c6-4445-a3f5-388e6e6a5c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:00.152574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cefe3-33c6-4445-a3f5-388e6e6a5c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:00.153366 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cefe3-33c6-4445-a3f5-388e6e6a5c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:00.157724 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cefe3-33c6-4445-a3f5-388e6e6a5c5a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:00.183708 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 944/1863] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:39:00.188011 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d167d-1f7c-43da-a1b3-ca7230512033 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:00.208422 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d167d-1f7c-43da-a1b3-ca7230512033 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:00.217551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5683f4-268e-4942-93e3-a35ddb9ce83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:00.220368 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5683f4-268e-4942-93e3-a35ddb9ce83e admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:00.220879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5683f4-268e-4942-93e3-a35ddb9ce83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:00.222277 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5683f4-268e-4942-93e3-a35ddb9ce83e admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:00.225064 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5683f4-268e-4942-93e3-a35ddb9ce83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:00.228160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5683f4-268e-4942-93e3-a35ddb9ce83e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:00.246435 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 920/1864] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:39:00.251464 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cefe3-33c6-4445-a3f5-388e6e6a5c5a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:00.266791 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cefe3-33c6-4445-a3f5-388e6e6a5c5a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:00.274217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b974d32-bf1f-4928-b889-c3e37afa6757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:00.275127 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b974d32-bf1f-4928-b889-c3e37afa6757 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:00.275423 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b974d32-bf1f-4928-b889-c3e37afa6757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:00.276067 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b974d32-bf1f-4928-b889-c3e37afa6757 admin admin] PATH_INFO: `/v3/projects/e1754690012c496fb0f88e0afefb7cb7/users/23d0f8cae4654293a26e01e19707a894/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:00.301537 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b974d32-bf1f-4928-b889-c3e37afa6757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1754690012c496fb0f88e0afefb7cb7, user_id=23d0f8cae4654293a26e01e19707a894, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:00.306758 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b974d32-bf1f-4928-b889-c3e37afa6757 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:00.336854 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 945/1865] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:39:00 2022] PUT /identity/v3/projects/e1754690012c496fb0f88e0afefb7cb7/users/23d0f8cae4654293a26e01e19707a894/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:00.362411 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cce029-4c93-4953-a4c4-48921d60b4ed None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:00.362411 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cce029-4c93-4953-a4c4-48921d60b4ed None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:00.362411 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cce029-4c93-4953-a4c4-48921d60b4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:00.404242 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-49cce029-4c93-4953-a4c4-48921d60b4ed None None] MFA Rules not processed for user `23d0f8cae4654293a26e01e19707a894`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:00.405531 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-49cce029-4c93-4953-a4c4-48921d60b4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:00.485889 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 921/1866] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:00.498143 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b974d32-bf1f-4928-b889-c3e37afa6757 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:00.500112 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3b974d32-bf1f-4928-b889-c3e37afa6757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:00.571246 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b974d32-bf1f-4928-b889-c3e37afa6757 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:00.577961 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699128b-e292-4575-8e6e-f95b37025464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:00.579094 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699128b-e292-4575-8e6e-f95b37025464 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:00.579434 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699128b-e292-4575-8e6e-f95b37025464 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:00.579769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699128b-e292-4575-8e6e-f95b37025464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:00.589650 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699128b-e292-4575-8e6e-f95b37025464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:00.591196 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699128b-e292-4575-8e6e-f95b37025464 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:00.600651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 946/1867] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:39:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:00.620165 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cce029-4c93-4953-a4c4-48921d60b4ed None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:00.684328 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cce029-4c93-4953-a4c4-48921d60b4ed None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:00.688962 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fc5d9-3f47-4b2e-9fef-eef21d642781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:00.689839 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fc5d9-3f47-4b2e-9fef-eef21d642781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:00.690150 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fc5d9-3f47-4b2e-9fef-eef21d642781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:00.690446 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fc5d9-3f47-4b2e-9fef-eef21d642781 admin admin] PATH_INFO: `/v3/users/23d0f8cae4654293a26e01e19707a894` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:00.691841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fc5d9-3f47-4b2e-9fef-eef21d642781 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23d0f8cae4654293a26e01e19707a894)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:00.693754 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fc5d9-3f47-4b2e-9fef-eef21d642781 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:00.734918 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:00.742441 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-670fc5d9-3f47-4b2e-9fef-eef21d642781 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23d0f8cae4654293a26e01e19707a894'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:00.749542 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-670fc5d9-3f47-4b2e-9fef-eef21d642781 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23d0f8cae4654293a26e01e19707a894'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:00.762884 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-670fc5d9-3f47-4b2e-9fef-eef21d642781 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23d0f8cae4654293a26e01e19707a894'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:00.772172 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-670fc5d9-3f47-4b2e-9fef-eef21d642781 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23d0f8cae4654293a26e01e19707a894'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:00.774258 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-670fc5d9-3f47-4b2e-9fef-eef21d642781 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23d0f8cae4654293a26e01e19707a894'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:00.780871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 922/1868] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:39:00 2022] DELETE /identity/v3/users/23d0f8cae4654293a26e01e19707a894 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:00.786140 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fe201-6692-465a-a9ed-69068e76013b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:00.786440 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fe201-6692-465a-a9ed-69068e76013b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:00.786726 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fe201-6692-465a-a9ed-69068e76013b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:00.805407 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a60fe201-6692-465a-a9ed-69068e76013b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:00.806669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a60fe201-6692-465a-a9ed-69068e76013b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:00.857755 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:00.873096 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 947/1869] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:00.884345 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fc5d9-3f47-4b2e-9fef-eef21d642781 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:00.885893 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-670fc5d9-3f47-4b2e-9fef-eef21d642781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:00.949284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fc5d9-3f47-4b2e-9fef-eef21d642781 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:00.953126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573597a-efee-4ab8-88aa-45a3e5c0b829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:00.953771 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573597a-efee-4ab8-88aa-45a3e5c0b829 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:00.954054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573597a-efee-4ab8-88aa-45a3e5c0b829 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:00.954357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573597a-efee-4ab8-88aa-45a3e5c0b829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:00.964622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573597a-efee-4ab8-88aa-45a3e5c0b829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:00.966058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573597a-efee-4ab8-88aa-45a3e5c0b829 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:00.975888 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 923/1870] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:01.841112 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fe201-6692-465a-a9ed-69068e76013b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:01.843152 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a60fe201-6692-465a-a9ed-69068e76013b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:01.872195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fe201-6692-465a-a9ed-69068e76013b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:01.878936 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831bb20-cc65-4c62-8fa7-a0b7e7ded71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:01.879862 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831bb20-cc65-4c62-8fa7-a0b7e7ded71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:01.880329 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831bb20-cc65-4c62-8fa7-a0b7e7ded71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:01.880775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831bb20-cc65-4c62-8fa7-a0b7e7ded71a admin admin] PATH_INFO: `/v3/projects/e1754690012c496fb0f88e0afefb7cb7` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:01.882221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831bb20-cc65-4c62-8fa7-a0b7e7ded71a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1754690012c496fb0f88e0afefb7cb7)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:01.885519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831bb20-cc65-4c62-8fa7-a0b7e7ded71a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:02.037238 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8831bb20-cc65-4c62-8fa7-a0b7e7ded71a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1754690012c496fb0f88e0afefb7cb7', 'request_id': 'req-8831bb20-cc65-4c62-8fa7-a0b7e7ded71a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:02.057232 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8831bb20-cc65-4c62-8fa7-a0b7e7ded71a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1754690012c496fb0f88e0afefb7cb7', 'request_id': 'req-8831bb20-cc65-4c62-8fa7-a0b7e7ded71a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:02.069026 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8831bb20-cc65-4c62-8fa7-a0b7e7ded71a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1754690012c496fb0f88e0afefb7cb7', 'request_id': 'req-8831bb20-cc65-4c62-8fa7-a0b7e7ded71a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:02.085542 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8831bb20-cc65-4c62-8fa7-a0b7e7ded71a admin admin] The token cache is being invalidate because project e1754690012c496fb0f88e0afefb7cb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:39:02.085843 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8831bb20-cc65-4c62-8fa7-a0b7e7ded71a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:02.086644 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8831bb20-cc65-4c62-8fa7-a0b7e7ded71a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:02.088243 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 948/1871] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:39:01 2022] DELETE /identity/v3/projects/e1754690012c496fb0f88e0afefb7cb7 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:02.095901 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ec773-ec3c-425a-b58f-738c6ddb95d2 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:02.096346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ec773-ec3c-425a-b58f-738c6ddb95d2 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:02.096634 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ec773-ec3c-425a-b58f-738c6ddb95d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:02.117912 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a83ec773-ec3c-425a-b58f-738c6ddb95d2 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:02.119611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a83ec773-ec3c-425a-b58f-738c6ddb95d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:02.200364 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 924/1872] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:02.212165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2210347-5a98-48d2-b687-3802d7ab3888 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:02.212457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2210347-5a98-48d2-b687-3802d7ab3888 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:02.212735 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2210347-5a98-48d2-b687-3802d7ab3888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:02.237675 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e2210347-5a98-48d2-b687-3802d7ab3888 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:02.239402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e2210347-5a98-48d2-b687-3802d7ab3888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:02.248039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 949/1873] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:02.257527 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ec773-ec3c-425a-b58f-738c6ddb95d2 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:02.267999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ec773-ec3c-425a-b58f-738c6ddb95d2 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:02.273334 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654b224-82b2-429d-a93b-c8df57cc8d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:02.274195 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654b224-82b2-429d-a93b-c8df57cc8d13 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:02.274485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654b224-82b2-429d-a93b-c8df57cc8d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:02.274764 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654b224-82b2-429d-a93b-c8df57cc8d13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:02.275492 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654b224-82b2-429d-a93b-c8df57cc8d13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:02.275998 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654b224-82b2-429d-a93b-c8df57cc8d13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:02.277636 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654b224-82b2-429d-a93b-c8df57cc8d13 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:02.294866 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 925/1874] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:02.298975 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2210347-5a98-48d2-b687-3802d7ab3888 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:02.310154 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2210347-5a98-48d2-b687-3802d7ab3888 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:02.320610 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e405373-9c78-4389-b727-ac08b716dc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:02.321690 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e405373-9c78-4389-b727-ac08b716dc14 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:02.322278 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e405373-9c78-4389-b727-ac08b716dc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:02.322652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e405373-9c78-4389-b727-ac08b716dc14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:02.323946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e405373-9c78-4389-b727-ac08b716dc14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:02.325609 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e405373-9c78-4389-b727-ac08b716dc14 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:02.362145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 950/1875] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:39:02 2022] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:02.364678 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654b224-82b2-429d-a93b-c8df57cc8d13 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:02.374721 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654b224-82b2-429d-a93b-c8df57cc8d13 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:02.421778 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:02.436011 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e21754-d3fc-471d-a14d-0447a916969f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:02.436692 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e21754-d3fc-471d-a14d-0447a916969f admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:02.436979 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e21754-d3fc-471d-a14d-0447a916969f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:02.437257 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e21754-d3fc-471d-a14d-0447a916969f admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:02.437963 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e21754-d3fc-471d-a14d-0447a916969f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:02.440027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e21754-d3fc-471d-a14d-0447a916969f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:02.461339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 926/1876] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:39:02 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:39:02.465490 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e405373-9c78-4389-b727-ac08b716dc14 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:02.476334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e405373-9c78-4389-b727-ac08b716dc14 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:02.481587 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9a010-eb0e-402f-9433-24ecdb699929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:02.482281 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9a010-eb0e-402f-9433-24ecdb699929 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:02.482569 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9a010-eb0e-402f-9433-24ecdb699929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:02.482850 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9a010-eb0e-402f-9433-24ecdb699929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:02.483607 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9a010-eb0e-402f-9433-24ecdb699929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:02.485216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9a010-eb0e-402f-9433-24ecdb699929 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:02.495857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 951/1877] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:39:02.500071 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e21754-d3fc-471d-a14d-0447a916969f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:02.511626 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e21754-d3fc-471d-a14d-0447a916969f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:02.516321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47532f8d-82d1-4aaa-82c3-43e6fbf4e92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:02.517004 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47532f8d-82d1-4aaa-82c3-43e6fbf4e92d admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:02.517284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47532f8d-82d1-4aaa-82c3-43e6fbf4e92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:02.517553 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47532f8d-82d1-4aaa-82c3-43e6fbf4e92d admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:02.518301 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47532f8d-82d1-4aaa-82c3-43e6fbf4e92d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:02.520430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47532f8d-82d1-4aaa-82c3-43e6fbf4e92d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:02.530609 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 927/1878] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:39:02.534701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9a010-eb0e-402f-9433-24ecdb699929 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:02.545165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9a010-eb0e-402f-9433-24ecdb699929 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:02.550540 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982091d-b1a8-4111-818e-f1ca8f221308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:02.552074 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982091d-b1a8-4111-818e-f1ca8f221308 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:02.553134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982091d-b1a8-4111-818e-f1ca8f221308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:02.553429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982091d-b1a8-4111-818e-f1ca8f221308 admin admin] PATH_INFO: `/v3/projects/fbf06ae40adb43329947dc4ef6e3a57f/users/d89bace71c0a47fe8c011cb736a7f2e8/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:02.570321 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982091d-b1a8-4111-818e-f1ca8f221308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf06ae40adb43329947dc4ef6e3a57f, user_id=d89bace71c0a47fe8c011cb736a7f2e8, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:02.572515 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982091d-b1a8-4111-818e-f1ca8f221308 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:02.586029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 952/1879] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:39:02 2022] PUT /identity/v3/projects/fbf06ae40adb43329947dc4ef6e3a57f/users/d89bace71c0a47fe8c011cb736a7f2e8/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:02.596334 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d84c3e-66ac-441f-8a2b-7014466735e7 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:02.597200 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d84c3e-66ac-441f-8a2b-7014466735e7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:02.597482 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d84c3e-66ac-441f-8a2b-7014466735e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:02.624915 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-32d84c3e-66ac-441f-8a2b-7014466735e7 None None] MFA Rules not processed for user `d89bace71c0a47fe8c011cb736a7f2e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:02.626150 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-32d84c3e-66ac-441f-8a2b-7014466735e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:02.701310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 928/1880] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:02.713989 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982091d-b1a8-4111-818e-f1ca8f221308 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:02.716191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7982091d-b1a8-4111-818e-f1ca8f221308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:02.811702 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982091d-b1a8-4111-818e-f1ca8f221308 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:02.817221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988a5c4-4731-4c02-9294-0383b07ddb4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14c582c1127142f8a4ebf64bb7b34516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:02.817973 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988a5c4-4731-4c02-9294-0383b07ddb4f service glance] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:02.818298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988a5c4-4731-4c02-9294-0383b07ddb4f service glance] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:02.818569 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988a5c4-4731-4c02-9294-0383b07ddb4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:02.826918 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:02.829667 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988a5c4-4731-4c02-9294-0383b07ddb4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:02.833062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988a5c4-4731-4c02-9294-0383b07ddb4f service glance] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:02.843594 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 953/1881] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:39:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:04.336555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77493bed-08af-4778-a3cf-d5985297e51b None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:04.337488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77493bed-08af-4778-a3cf-d5985297e51b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:04.337918 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77493bed-08af-4778-a3cf-d5985297e51b None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:04.339497 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 929/1882] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jul 14 15:39:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:39:04.354223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43d1cf-32a3-454a-a193-56c23fc2be12 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:04.354806 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43d1cf-32a3-454a-a193-56c23fc2be12 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:04.354916 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43d1cf-32a3-454a-a193-56c23fc2be12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:04.374976 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7c43d1cf-32a3-454a-a193-56c23fc2be12 None None] MFA Rules not processed for user `1d1dbca57a4c43ce9bc37c2303417d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:04.376248 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7c43d1cf-32a3-454a-a193-56c23fc2be12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:04.483169 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 954/1883] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jul 14 15:39:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:04.524146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77493bed-08af-4778-a3cf-d5985297e51b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:04.526225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-77493bed-08af-4778-a3cf-d5985297e51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:04.563899 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77493bed-08af-4778-a3cf-d5985297e51b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:04.574002 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbbe51-bc1e-4e47-b9ec-317d7927cd60 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:04.575523 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbbe51-bc1e-4e47-b9ec-317d7927cd60 service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:04.576054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbbe51-bc1e-4e47-b9ec-317d7927cd60 service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:04.576590 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbbe51-bc1e-4e47-b9ec-317d7927cd60 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:04.599725 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbbe51-bc1e-4e47-b9ec-317d7927cd60 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:04.601489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbbe51-bc1e-4e47-b9ec-317d7927cd60 service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:04.621139 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 930/1884] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:39:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:05.434947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43d1cf-32a3-454a-a193-56c23fc2be12 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:05.438677 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7c43d1cf-32a3-454a-a193-56c23fc2be12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:05.520140 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43d1cf-32a3-454a-a193-56c23fc2be12 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:05.533139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881f7c2-da6f-4add-be17-61a84fe24da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:05.533139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881f7c2-da6f-4add-be17-61a84fe24da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:05.533139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881f7c2-da6f-4add-be17-61a84fe24da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:05.533139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881f7c2-da6f-4add-be17-61a84fe24da1 admin admin] PATH_INFO: `/v3/users/1921aebcac294b17928c6472fba85a50` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:05.533540 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881f7c2-da6f-4add-be17-61a84fe24da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1921aebcac294b17928c6472fba85a50)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:05.533540 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881f7c2-da6f-4add-be17-61a84fe24da1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:05.602394 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f881f7c2-da6f-4add-be17-61a84fe24da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1921aebcac294b17928c6472fba85a50'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:05.603066 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f881f7c2-da6f-4add-be17-61a84fe24da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1921aebcac294b17928c6472fba85a50'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:05.618046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f881f7c2-da6f-4add-be17-61a84fe24da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1921aebcac294b17928c6472fba85a50'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:05.635052 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f881f7c2-da6f-4add-be17-61a84fe24da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1921aebcac294b17928c6472fba85a50'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:05.662898 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f881f7c2-da6f-4add-be17-61a84fe24da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1921aebcac294b17928c6472fba85a50'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:05.672203 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 955/1885] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:39:05 2022] DELETE /identity/v3/users/1921aebcac294b17928c6472fba85a50 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:05.914796 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbbe51-bc1e-4e47-b9ec-317d7927cd60 service placement] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:05.928331 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbbe51-bc1e-4e47-b9ec-317d7927cd60 service placement] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:06.017217 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f70ff1-654c-434e-924f-b4a367031d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:06.018887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f70ff1-654c-434e-924f-b4a367031d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:06.019173 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f70ff1-654c-434e-924f-b4a367031d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:06.019454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f70ff1-654c-434e-924f-b4a367031d4a admin admin] PATH_INFO: `/v3/projects/eb268e5b5de74c41b5e1f88b0232a218` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:06.020805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f70ff1-654c-434e-924f-b4a367031d4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb268e5b5de74c41b5e1f88b0232a218)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:06.022758 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f70ff1-654c-434e-924f-b4a367031d4a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:06.076837 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:06.083107 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-51f70ff1-654c-434e-924f-b4a367031d4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb268e5b5de74c41b5e1f88b0232a218', 'request_id': 'req-51f70ff1-654c-434e-924f-b4a367031d4a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:06.090396 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-51f70ff1-654c-434e-924f-b4a367031d4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb268e5b5de74c41b5e1f88b0232a218', 'request_id': 'req-51f70ff1-654c-434e-924f-b4a367031d4a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:06.095923 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-51f70ff1-654c-434e-924f-b4a367031d4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb268e5b5de74c41b5e1f88b0232a218', 'request_id': 'req-51f70ff1-654c-434e-924f-b4a367031d4a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:06.108592 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-51f70ff1-654c-434e-924f-b4a367031d4a admin admin] The token cache is being invalidate because project eb268e5b5de74c41b5e1f88b0232a218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:39:06.108882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-51f70ff1-654c-434e-924f-b4a367031d4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:06.109522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-51f70ff1-654c-434e-924f-b4a367031d4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:06.111213 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 931/1886] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:39:05 2022] DELETE /identity/v3/projects/eb268e5b5de74c41b5e1f88b0232a218 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:06.115995 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881f7c2-da6f-4add-be17-61a84fe24da1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:06.117462 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f881f7c2-da6f-4add-be17-61a84fe24da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:06.131324 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881f7c2-da6f-4add-be17-61a84fe24da1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:06.140994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:06.195327 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0f2231-0a55-44dd-a73a-fed582ec90eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:06.196209 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f2231-0a55-44dd-a73a-fed582ec90eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:06.196497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f2231-0a55-44dd-a73a-fed582ec90eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:06.196776 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0f2231-0a55-44dd-a73a-fed582ec90eb admin admin] PATH_INFO: `/v3/users/008ff5db77ab42e49e2648cac5a006ed` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:06.197985 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f2231-0a55-44dd-a73a-fed582ec90eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=008ff5db77ab42e49e2648cac5a006ed)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:06.199955 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0f2231-0a55-44dd-a73a-fed582ec90eb admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:06.261558 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-fd0f2231-0a55-44dd-a73a-fed582ec90eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '008ff5db77ab42e49e2648cac5a006ed'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:06.262245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-fd0f2231-0a55-44dd-a73a-fed582ec90eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '008ff5db77ab42e49e2648cac5a006ed'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:06.270455 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-fd0f2231-0a55-44dd-a73a-fed582ec90eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '008ff5db77ab42e49e2648cac5a006ed'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:06.279921 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-fd0f2231-0a55-44dd-a73a-fed582ec90eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '008ff5db77ab42e49e2648cac5a006ed'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:06.292715 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-fd0f2231-0a55-44dd-a73a-fed582ec90eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '008ff5db77ab42e49e2648cac5a006ed'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:06.299231 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 956/1887] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:39:06 2022] DELETE /identity/v3/users/008ff5db77ab42e49e2648cac5a006ed => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:06.488999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f70ff1-654c-434e-924f-b4a367031d4a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:06.490640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-51f70ff1-654c-434e-924f-b4a367031d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:06.511041 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f70ff1-654c-434e-924f-b4a367031d4a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:06.584926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57b79e-1250-4cb2-b8fd-6060d8bbb9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:06.586144 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57b79e-1250-4cb2-b8fd-6060d8bbb9b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:06.586428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57b79e-1250-4cb2-b8fd-6060d8bbb9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:06.586703 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57b79e-1250-4cb2-b8fd-6060d8bbb9b7 admin admin] PATH_INFO: `/v3/projects/86104a64f9d54bb18b9fabfd1bf0c96b` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:06.587983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57b79e-1250-4cb2-b8fd-6060d8bbb9b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86104a64f9d54bb18b9fabfd1bf0c96b)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:06.590022 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57b79e-1250-4cb2-b8fd-6060d8bbb9b7 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:06.647167 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6b57b79e-1250-4cb2-b8fd-6060d8bbb9b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86104a64f9d54bb18b9fabfd1bf0c96b', 'request_id': 'req-6b57b79e-1250-4cb2-b8fd-6060d8bbb9b7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:06.653521 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6b57b79e-1250-4cb2-b8fd-6060d8bbb9b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86104a64f9d54bb18b9fabfd1bf0c96b', 'request_id': 'req-6b57b79e-1250-4cb2-b8fd-6060d8bbb9b7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:06.660662 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6b57b79e-1250-4cb2-b8fd-6060d8bbb9b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86104a64f9d54bb18b9fabfd1bf0c96b', 'request_id': 'req-6b57b79e-1250-4cb2-b8fd-6060d8bbb9b7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:06.678975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6b57b79e-1250-4cb2-b8fd-6060d8bbb9b7 admin admin] The token cache is being invalidate because project 86104a64f9d54bb18b9fabfd1bf0c96b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:39:06.679261 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6b57b79e-1250-4cb2-b8fd-6060d8bbb9b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:06.680049 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6b57b79e-1250-4cb2-b8fd-6060d8bbb9b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:06.681545 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 932/1888] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:39:06 2022] DELETE /identity/v3/projects/86104a64f9d54bb18b9fabfd1bf0c96b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:06.686399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a16570-0eab-4a7d-aa06-ec0b85a9af50 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:06.686920 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a16570-0eab-4a7d-aa06-ec0b85a9af50 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:06.687166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a16570-0eab-4a7d-aa06-ec0b85a9af50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:06.708661 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-55a16570-0eab-4a7d-aa06-ec0b85a9af50 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:06.709889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-55a16570-0eab-4a7d-aa06-ec0b85a9af50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:06.787141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 957/1889] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:06.795491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b1dc1-c8e8-46b3-8a50-6a4a914aa466 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:06.795712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b1dc1-c8e8-46b3-8a50-6a4a914aa466 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:06.796000 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b1dc1-c8e8-46b3-8a50-6a4a914aa466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:06.815594 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ae3b1dc1-c8e8-46b3-8a50-6a4a914aa466 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:06.816820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ae3b1dc1-c8e8-46b3-8a50-6a4a914aa466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:06.824805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 933/1890] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:06.829048 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a16570-0eab-4a7d-aa06-ec0b85a9af50 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:06.839381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a16570-0eab-4a7d-aa06-ec0b85a9af50 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:06.844224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9347c-000a-4a85-b727-bfc755330964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:06.844974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9347c-000a-4a85-b727-bfc755330964 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:06.845258 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9347c-000a-4a85-b727-bfc755330964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:06.845537 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9347c-000a-4a85-b727-bfc755330964 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:06.846974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9347c-000a-4a85-b727-bfc755330964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:06.847357 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9347c-000a-4a85-b727-bfc755330964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:06.849048 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9347c-000a-4a85-b727-bfc755330964 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:06.864588 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 958/1891] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:06.865970 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b1dc1-c8e8-46b3-8a50-6a4a914aa466 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:06.875712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b1dc1-c8e8-46b3-8a50-6a4a914aa466 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:06.881059 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce262d15-a2ee-4616-ac54-92369f7d8d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:06.881725 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce262d15-a2ee-4616-ac54-92369f7d8d3f admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:06.882010 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce262d15-a2ee-4616-ac54-92369f7d8d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:06.882342 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce262d15-a2ee-4616-ac54-92369f7d8d3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:06.883040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce262d15-a2ee-4616-ac54-92369f7d8d3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:06.885157 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce262d15-a2ee-4616-ac54-92369f7d8d3f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:06.916405 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 934/1892] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:39:06 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:06.920613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9347c-000a-4a85-b727-bfc755330964 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:06.931141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9347c-000a-4a85-b727-bfc755330964 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:06.945284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:06.999048 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8b56d-8847-409f-9bbd-ad6f910e3890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:06.999727 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8b56d-8847-409f-9bbd-ad6f910e3890 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:07.000081 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8b56d-8847-409f-9bbd-ad6f910e3890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:07.000283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8b56d-8847-409f-9bbd-ad6f910e3890 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:07.000963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8b56d-8847-409f-9bbd-ad6f910e3890 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:07.003493 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8b56d-8847-409f-9bbd-ad6f910e3890 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:07.032257 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 959/1893] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:39:06 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:07.037532 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce262d15-a2ee-4616-ac54-92369f7d8d3f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:07.048883 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce262d15-a2ee-4616-ac54-92369f7d8d3f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:07.055166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78817d9-4402-4669-852c-e61f1b7bee67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:07.055999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78817d9-4402-4669-852c-e61f1b7bee67 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:07.056436 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78817d9-4402-4669-852c-e61f1b7bee67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:07.056723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78817d9-4402-4669-852c-e61f1b7bee67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:07.057472 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78817d9-4402-4669-852c-e61f1b7bee67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:07.059242 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78817d9-4402-4669-852c-e61f1b7bee67 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:07.078375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 935/1894] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:39:07.083219 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8b56d-8847-409f-9bbd-ad6f910e3890 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:07.095599 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8b56d-8847-409f-9bbd-ad6f910e3890 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:07.101483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122126ca-68e3-478e-a902-1286eafda803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:07.102226 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122126ca-68e3-478e-a902-1286eafda803 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:07.102574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122126ca-68e3-478e-a902-1286eafda803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:07.102859 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122126ca-68e3-478e-a902-1286eafda803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:07.103594 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122126ca-68e3-478e-a902-1286eafda803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:07.105203 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122126ca-68e3-478e-a902-1286eafda803 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:07.119843 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 960/1895] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:39:07.124210 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78817d9-4402-4669-852c-e61f1b7bee67 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:07.135068 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78817d9-4402-4669-852c-e61f1b7bee67 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:07.140150 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172a424-e8f0-48ac-9302-70f9a640edff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:07.141144 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172a424-e8f0-48ac-9302-70f9a640edff admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:07.141505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172a424-e8f0-48ac-9302-70f9a640edff admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:07.141822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172a424-e8f0-48ac-9302-70f9a640edff admin admin] PATH_INFO: `/v3/projects/b29d1dc3b9a24ee8a67b0edddb2622ab/users/86a12ce4f6134290ac938abe56342c14/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:07.158722 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172a424-e8f0-48ac-9302-70f9a640edff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29d1dc3b9a24ee8a67b0edddb2622ab, user_id=86a12ce4f6134290ac938abe56342c14, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:07.162439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172a424-e8f0-48ac-9302-70f9a640edff admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:07.176980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:07.184396 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 936/1896] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:39:07 2022] PUT /identity/v3/projects/b29d1dc3b9a24ee8a67b0edddb2622ab/users/86a12ce4f6134290ac938abe56342c14/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:07.196592 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbac4e9-b4fe-40a3-a06b-b320b51331d8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:07.197005 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbac4e9-b4fe-40a3-a06b-b320b51331d8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:07.197360 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbac4e9-b4fe-40a3-a06b-b320b51331d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:07.227738 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2fbac4e9-b4fe-40a3-a06b-b320b51331d8 None None] MFA Rules not processed for user `86a12ce4f6134290ac938abe56342c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:07.228995 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2fbac4e9-b4fe-40a3-a06b-b320b51331d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:07.297953 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 961/1897] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:07.303537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172a424-e8f0-48ac-9302-70f9a640edff admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:07.372214 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172a424-e8f0-48ac-9302-70f9a640edff admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:07.376867 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c17838-70eb-443e-a99f-733e8328cf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:07.377592 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c17838-70eb-443e-a99f-733e8328cf14 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:07.378499 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c17838-70eb-443e-a99f-733e8328cf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:07.379057 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c17838-70eb-443e-a99f-733e8328cf14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:07.379488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c17838-70eb-443e-a99f-733e8328cf14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:07.381485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c17838-70eb-443e-a99f-733e8328cf14 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:07.408078 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 937/1898] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:39:07 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:07.413168 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbac4e9-b4fe-40a3-a06b-b320b51331d8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:07.425681 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbac4e9-b4fe-40a3-a06b-b320b51331d8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:07.486378 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fb0eb-631b-487c-bb81-626f09f86686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:07.487696 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fb0eb-631b-487c-bb81-626f09f86686 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:07.487983 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fb0eb-631b-487c-bb81-626f09f86686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:07.488324 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37fb0eb-631b-487c-bb81-626f09f86686 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:07.489029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fb0eb-631b-487c-bb81-626f09f86686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:07.491062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37fb0eb-631b-487c-bb81-626f09f86686 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:07.512270 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 962/1899] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:39:07 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:07.516315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c17838-70eb-443e-a99f-733e8328cf14 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:07.527077 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c17838-70eb-443e-a99f-733e8328cf14 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:07.531608 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79bb1a-0961-4f1d-97cf-92421df0a8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:07.532265 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79bb1a-0961-4f1d-97cf-92421df0a8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:07.532552 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79bb1a-0961-4f1d-97cf-92421df0a8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:07.532825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79bb1a-0961-4f1d-97cf-92421df0a8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:07.533565 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79bb1a-0961-4f1d-97cf-92421df0a8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:07.535302 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79bb1a-0961-4f1d-97cf-92421df0a8c0 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:07.547030 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 938/1900] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:39:07.551525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fb0eb-631b-487c-bb81-626f09f86686 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:07.562476 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37fb0eb-631b-487c-bb81-626f09f86686 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:07.568373 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dec70-832a-4f79-a5c4-f83501544702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:07.569274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dec70-832a-4f79-a5c4-f83501544702 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:07.569564 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dec70-832a-4f79-a5c4-f83501544702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:07.569875 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dec70-832a-4f79-a5c4-f83501544702 admin admin] PATH_INFO: `/v3/projects/76ab4a73afea43239323e69722f00212/users/030da561d63848b490f4aa82e498bc3c/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:07.583613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:07.587595 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2dec70-832a-4f79-a5c4-f83501544702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ab4a73afea43239323e69722f00212, user_id=030da561d63848b490f4aa82e498bc3c, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:07.591357 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2dec70-832a-4f79-a5c4-f83501544702 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:07.606934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 963/1901] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:39:07 2022] PUT /identity/v3/projects/76ab4a73afea43239323e69722f00212/users/030da561d63848b490f4aa82e498bc3c/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:07.613741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79bb1a-0961-4f1d-97cf-92421df0a8c0 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:07.627159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79bb1a-0961-4f1d-97cf-92421df0a8c0 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:07.696532 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3255b-df87-4460-8a50-ff5b15c88d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:07.697204 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3255b-df87-4460-8a50-ff5b15c88d80 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:07.697488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3255b-df87-4460-8a50-ff5b15c88d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:07.697764 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3255b-df87-4460-8a50-ff5b15c88d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:07.698535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3255b-df87-4460-8a50-ff5b15c88d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:07.700137 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3255b-df87-4460-8a50-ff5b15c88d80 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:07.712989 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 939/1902] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:39:07.716974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dec70-832a-4f79-a5c4-f83501544702 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:07.728878 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dec70-832a-4f79-a5c4-f83501544702 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:07.738653 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a488e-62a8-4dc7-b4dc-c49cfe48d5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:07.739567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a488e-62a8-4dc7-b4dc-c49cfe48d5ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:07.739856 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a488e-62a8-4dc7-b4dc-c49cfe48d5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:07.740202 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a488e-62a8-4dc7-b4dc-c49cfe48d5ac admin admin] PATH_INFO: `/v3/projects/76ab4a73afea43239323e69722f00212/users/030da561d63848b490f4aa82e498bc3c/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:07.742186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a488e-62a8-4dc7-b4dc-c49cfe48d5ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ab4a73afea43239323e69722f00212, user_id=030da561d63848b490f4aa82e498bc3c, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:07.744996 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a488e-62a8-4dc7-b4dc-c49cfe48d5ac admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:07.759034 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 964/1903] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:39:07 2022] PUT /identity/v3/projects/76ab4a73afea43239323e69722f00212/users/030da561d63848b490f4aa82e498bc3c/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:07.770345 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f323a0-c937-44fd-a0a9-ede7920be01e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:07.770677 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f323a0-c937-44fd-a0a9-ede7920be01e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:07.770958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f323a0-c937-44fd-a0a9-ede7920be01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:07.807755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-31f323a0-c937-44fd-a0a9-ede7920be01e None None] MFA Rules not processed for user `030da561d63848b490f4aa82e498bc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:07.809032 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-31f323a0-c937-44fd-a0a9-ede7920be01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:07.882784 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:07.899226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 940/1904] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:07.914767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a488e-62a8-4dc7-b4dc-c49cfe48d5ac admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:07.916796 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5b7a488e-62a8-4dc7-b4dc-c49cfe48d5ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:08.015047 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a488e-62a8-4dc7-b4dc-c49cfe48d5ac admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:08.019758 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556c6b6-e75a-42e9-bd13-112d4e5a64a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:08.020413 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556c6b6-e75a-42e9-bd13-112d4e5a64a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:08.020707 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556c6b6-e75a-42e9-bd13-112d4e5a64a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:08.021120 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556c6b6-e75a-42e9-bd13-112d4e5a64a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:08.101960 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556c6b6-e75a-42e9-bd13-112d4e5a64a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:08.103458 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556c6b6-e75a-42e9-bd13-112d4e5a64a8 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:08.113179 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 965/1905] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:39:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:12.955396 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f323a0-c937-44fd-a0a9-ede7920be01e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:12.957700 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-31f323a0-c937-44fd-a0a9-ede7920be01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:13.037668 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f323a0-c937-44fd-a0a9-ede7920be01e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:13.045872 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc960b-2bf4-42be-a023-92a959bfc6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:13.046980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc960b-2bf4-42be-a023-92a959bfc6ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:13.047267 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc960b-2bf4-42be-a023-92a959bfc6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:13.047542 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc960b-2bf4-42be-a023-92a959bfc6ec admin admin] PATH_INFO: `/v3/users/d4aff069d9e24bbc962abd8065867fb4` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:13.048772 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc960b-2bf4-42be-a023-92a959bfc6ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4aff069d9e24bbc962abd8065867fb4)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:13.051064 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc960b-2bf4-42be-a023-92a959bfc6ec admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:13.113995 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-86cc960b-2bf4-42be-a023-92a959bfc6ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4aff069d9e24bbc962abd8065867fb4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:13.124495 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-86cc960b-2bf4-42be-a023-92a959bfc6ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4aff069d9e24bbc962abd8065867fb4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:13.141728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-86cc960b-2bf4-42be-a023-92a959bfc6ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4aff069d9e24bbc962abd8065867fb4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:13.150548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-86cc960b-2bf4-42be-a023-92a959bfc6ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4aff069d9e24bbc962abd8065867fb4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:13.151136 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-86cc960b-2bf4-42be-a023-92a959bfc6ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4aff069d9e24bbc962abd8065867fb4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:13.157440 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 941/1906] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:39:12 2022] DELETE /identity/v3/users/d4aff069d9e24bbc962abd8065867fb4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:13.162462 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daf1b7-5de4-43e4-bc10-1769f8ca709c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:13.163040 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daf1b7-5de4-43e4-bc10-1769f8ca709c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:13.163040 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5daf1b7-5de4-43e4-bc10-1769f8ca709c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:13.182739 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a5daf1b7-5de4-43e4-bc10-1769f8ca709c None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:13.183977 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a5daf1b7-5de4-43e4-bc10-1769f8ca709c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:13.249152 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 966/1907] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:13.259551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc960b-2bf4-42be-a023-92a959bfc6ec admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:13.260961 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-86cc960b-2bf4-42be-a023-92a959bfc6ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:13.339412 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc960b-2bf4-42be-a023-92a959bfc6ec admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:13.343773 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe78a6e-8f79-4779-bbcf-a0e10f035e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:13.344430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe78a6e-8f79-4779-bbcf-a0e10f035e1a service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:13.344719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe78a6e-8f79-4779-bbcf-a0e10f035e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:13.345036 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe78a6e-8f79-4779-bbcf-a0e10f035e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:13.356072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe78a6e-8f79-4779-bbcf-a0e10f035e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:13.358259 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe78a6e-8f79-4779-bbcf-a0e10f035e1a service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:13.369607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 942/1908] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:13.509806 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daf1b7-5de4-43e4-bc10-1769f8ca709c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:13.511356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a5daf1b7-5de4-43e4-bc10-1769f8ca709c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:13.555598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:13.588823 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5daf1b7-5de4-43e4-bc10-1769f8ca709c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:13.592764 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b367f-53d8-49f4-8235-9e64024a5dc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:13.593411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b367f-53d8-49f4-8235-9e64024a5dc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:13.593723 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b367f-53d8-49f4-8235-9e64024a5dc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:13.594061 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b367f-53d8-49f4-8235-9e64024a5dc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:13.595858 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0d9b367f-53d8-49f4-8235-9e64024a5dc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:13.680603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b367f-53d8-49f4-8235-9e64024a5dc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:13.682286 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b367f-53d8-49f4-8235-9e64024a5dc3 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:13.694199 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 967/1909] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:39:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:13.806615 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe78a6e-8f79-4779-bbcf-a0e10f035e1a service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:13.809265 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-afe78a6e-8f79-4779-bbcf-a0e10f035e1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:13.842897 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe78a6e-8f79-4779-bbcf-a0e10f035e1a service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:13.852333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f3594-0960-403e-9359-5019d087e56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:13.853778 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f3594-0960-403e-9359-5019d087e56d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:13.854248 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f3594-0960-403e-9359-5019d087e56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:13.854673 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f3594-0960-403e-9359-5019d087e56d admin admin] PATH_INFO: `/v3/projects/ed30c37a188e47b9bd2edb1721fb4450` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:13.856549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f3594-0960-403e-9359-5019d087e56d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed30c37a188e47b9bd2edb1721fb4450)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:13.860011 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f3594-0960-403e-9359-5019d087e56d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:13.876346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:13.951093 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2a8f3594-0960-403e-9359-5019d087e56d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed30c37a188e47b9bd2edb1721fb4450', 'request_id': 'req-2a8f3594-0960-403e-9359-5019d087e56d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:13.959221 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2a8f3594-0960-403e-9359-5019d087e56d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed30c37a188e47b9bd2edb1721fb4450', 'request_id': 'req-2a8f3594-0960-403e-9359-5019d087e56d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:13.966957 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2a8f3594-0960-403e-9359-5019d087e56d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed30c37a188e47b9bd2edb1721fb4450', 'request_id': 'req-2a8f3594-0960-403e-9359-5019d087e56d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:13.998196 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2a8f3594-0960-403e-9359-5019d087e56d admin admin] The token cache is being invalidate because project ed30c37a188e47b9bd2edb1721fb4450 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:39:13.999668 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2a8f3594-0960-403e-9359-5019d087e56d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:14.004061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2a8f3594-0960-403e-9359-5019d087e56d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:14.010390 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 943/1910] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:39:13 2022] DELETE /identity/v3/projects/ed30c37a188e47b9bd2edb1721fb4450 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:39:14.013049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b367f-53d8-49f4-8235-9e64024a5dc3 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:14.031949 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b367f-53d8-49f4-8235-9e64024a5dc3 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:14.239832 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98099611-bfbe-4365-9a42-f03b751e0a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:14.242345 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98099611-bfbe-4365-9a42-f03b751e0a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:14.242582 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98099611-bfbe-4365-9a42-f03b751e0a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:14.244344 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98099611-bfbe-4365-9a42-f03b751e0a2f admin admin] PATH_INFO: `/v3/users/6bf24a2aef3f4feeaf3c61015d27132c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:14.248846 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98099611-bfbe-4365-9a42-f03b751e0a2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf24a2aef3f4feeaf3c61015d27132c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:14.265557 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98099611-bfbe-4365-9a42-f03b751e0a2f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:14.360596 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-98099611-bfbe-4365-9a42-f03b751e0a2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf24a2aef3f4feeaf3c61015d27132c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:14.371039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-98099611-bfbe-4365-9a42-f03b751e0a2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf24a2aef3f4feeaf3c61015d27132c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:14.371502 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-98099611-bfbe-4365-9a42-f03b751e0a2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf24a2aef3f4feeaf3c61015d27132c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:14.382195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-98099611-bfbe-4365-9a42-f03b751e0a2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf24a2aef3f4feeaf3c61015d27132c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:14.411800 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-98099611-bfbe-4365-9a42-f03b751e0a2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf24a2aef3f4feeaf3c61015d27132c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:14.448462 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 968/1911] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:39:14 2022] DELETE /identity/v3/users/6bf24a2aef3f4feeaf3c61015d27132c => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:15.044753 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f3594-0960-403e-9359-5019d087e56d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:15.046842 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2a8f3594-0960-403e-9359-5019d087e56d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:15.060587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f3594-0960-403e-9359-5019d087e56d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:15.120014 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85177a6-97b4-4172-b6c2-a3a82e20a2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:15.120879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85177a6-97b4-4172-b6c2-a3a82e20a2f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:15.121163 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85177a6-97b4-4172-b6c2-a3a82e20a2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:15.121441 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85177a6-97b4-4172-b6c2-a3a82e20a2f5 admin admin] PATH_INFO: `/v3/projects/4197d55569f54781a9029285c46dac28` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:15.122664 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85177a6-97b4-4172-b6c2-a3a82e20a2f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4197d55569f54781a9029285c46dac28)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:15.124614 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85177a6-97b4-4172-b6c2-a3a82e20a2f5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:15.181209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a85177a6-97b4-4172-b6c2-a3a82e20a2f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4197d55569f54781a9029285c46dac28', 'request_id': 'req-a85177a6-97b4-4172-b6c2-a3a82e20a2f5'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:15.194746 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a85177a6-97b4-4172-b6c2-a3a82e20a2f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4197d55569f54781a9029285c46dac28', 'request_id': 'req-a85177a6-97b4-4172-b6c2-a3a82e20a2f5'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:15.201990 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a85177a6-97b4-4172-b6c2-a3a82e20a2f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4197d55569f54781a9029285c46dac28', 'request_id': 'req-a85177a6-97b4-4172-b6c2-a3a82e20a2f5'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:15.216968 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a85177a6-97b4-4172-b6c2-a3a82e20a2f5 admin admin] The token cache is being invalidate because project 4197d55569f54781a9029285c46dac28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:39:15.217179 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a85177a6-97b4-4172-b6c2-a3a82e20a2f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:15.217843 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a85177a6-97b4-4172-b6c2-a3a82e20a2f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:15.219946 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 944/1912] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:39:15 2022] DELETE /identity/v3/projects/4197d55569f54781a9029285c46dac28 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:15.225794 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03356339-77d4-4faa-8eaa-0bc0ce9aba2b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:15.226263 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03356339-77d4-4faa-8eaa-0bc0ce9aba2b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:15.226684 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03356339-77d4-4faa-8eaa-0bc0ce9aba2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:15.233756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:15.249313 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-03356339-77d4-4faa-8eaa-0bc0ce9aba2b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:15.250596 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-03356339-77d4-4faa-8eaa-0bc0ce9aba2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:15.339461 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 969/1913] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:15.341850 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2794de3-0e74-44ab-9450-0f2a768a0af6 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:15.342215 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2794de3-0e74-44ab-9450-0f2a768a0af6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:15.342609 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2794de3-0e74-44ab-9450-0f2a768a0af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:15.376754 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b2794de3-0e74-44ab-9450-0f2a768a0af6 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:15.381163 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b2794de3-0e74-44ab-9450-0f2a768a0af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:15.391750 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 945/1914] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:15.396622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03356339-77d4-4faa-8eaa-0bc0ce9aba2b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:15.409477 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03356339-77d4-4faa-8eaa-0bc0ce9aba2b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:15.415053 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac3667-0b28-492f-953d-c0cd84beaa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:15.416371 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac3667-0b28-492f-953d-c0cd84beaa15 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:15.416677 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac3667-0b28-492f-953d-c0cd84beaa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:15.423251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac3667-0b28-492f-953d-c0cd84beaa15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:15.432461 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac3667-0b28-492f-953d-c0cd84beaa15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:15.432884 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac3667-0b28-492f-953d-c0cd84beaa15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:15.434779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac3667-0b28-492f-953d-c0cd84beaa15 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:15.454925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 970/1915] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:15.460773 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2794de3-0e74-44ab-9450-0f2a768a0af6 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:15.478870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2794de3-0e74-44ab-9450-0f2a768a0af6 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:15.484128 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd0662-88e5-473e-ad13-6fdc1381b021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:15.484876 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd0662-88e5-473e-ad13-6fdc1381b021 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:15.485166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd0662-88e5-473e-ad13-6fdc1381b021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:15.485442 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd0662-88e5-473e-ad13-6fdc1381b021 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:15.486244 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd0662-88e5-473e-ad13-6fdc1381b021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:15.489861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd0662-88e5-473e-ad13-6fdc1381b021 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:15.524234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:15.545884 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 946/1916] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:39:15 2022] POST /identity/v3/projects => generated 357 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:15.551888 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac3667-0b28-492f-953d-c0cd84beaa15 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:15.566969 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac3667-0b28-492f-953d-c0cd84beaa15 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:15.646002 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3564a0e-a3ef-4be0-9cc7-b0bf9e4f69e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:15.647132 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3564a0e-a3ef-4be0-9cc7-b0bf9e4f69e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:15.647659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3564a0e-a3ef-4be0-9cc7-b0bf9e4f69e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:15.647941 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3564a0e-a3ef-4be0-9cc7-b0bf9e4f69e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:15.648864 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3564a0e-a3ef-4be0-9cc7-b0bf9e4f69e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:15.651456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3564a0e-a3ef-4be0-9cc7-b0bf9e4f69e3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:15.678853 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 971/1917] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:39:15 2022] POST /identity/v3/users => generated 279 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:15.687970 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd0662-88e5-473e-ad13-6fdc1381b021 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:15.699990 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd0662-88e5-473e-ad13-6fdc1381b021 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:15.704920 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60775cf8-2c54-4fd4-af9b-272dc0814998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:15.705532 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60775cf8-2c54-4fd4-af9b-272dc0814998 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:15.705830 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60775cf8-2c54-4fd4-af9b-272dc0814998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:15.706136 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60775cf8-2c54-4fd4-af9b-272dc0814998 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:15.706882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60775cf8-2c54-4fd4-af9b-272dc0814998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:15.708508 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60775cf8-2c54-4fd4-af9b-272dc0814998 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:15.720281 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 947/1918] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:39:15.725890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3564a0e-a3ef-4be0-9cc7-b0bf9e4f69e3 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:15.738305 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3564a0e-a3ef-4be0-9cc7-b0bf9e4f69e3 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:15.743181 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fee5f-8b2f-4ff1-a609-f2b2ef52c22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:15.743847 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fee5f-8b2f-4ff1-a609-f2b2ef52c22b admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:15.744183 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fee5f-8b2f-4ff1-a609-f2b2ef52c22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:15.744468 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fee5f-8b2f-4ff1-a609-f2b2ef52c22b admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:15.745196 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fee5f-8b2f-4ff1-a609-f2b2ef52c22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:15.747024 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fee5f-8b2f-4ff1-a609-f2b2ef52c22b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:15.769927 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 972/1919] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:39:15.775219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60775cf8-2c54-4fd4-af9b-272dc0814998 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:15.786410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60775cf8-2c54-4fd4-af9b-272dc0814998 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:15.792384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a70887-bc44-4ff0-883f-7b516b0fe90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:15.793284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a70887-bc44-4ff0-883f-7b516b0fe90d admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:15.793568 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a70887-bc44-4ff0-883f-7b516b0fe90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:15.793847 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a70887-bc44-4ff0-883f-7b516b0fe90d admin admin] PATH_INFO: `/v3/projects/a0a429ad336846ebbf3e79b682671da4/users/747b0b0cf7e64e9bbd8e38fccaf88235/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:15.818175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a70887-bc44-4ff0-883f-7b516b0fe90d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0a429ad336846ebbf3e79b682671da4, user_id=747b0b0cf7e64e9bbd8e38fccaf88235, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:15.820740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a70887-bc44-4ff0-883f-7b516b0fe90d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:15.842160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 948/1920] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:39:15 2022] PUT /identity/v3/projects/a0a429ad336846ebbf3e79b682671da4/users/747b0b0cf7e64e9bbd8e38fccaf88235/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:15.852380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd61e78-b1fb-4936-9c26-f7a6b11302c0 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:15.852708 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd61e78-b1fb-4936-9c26-f7a6b11302c0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:15.852991 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd61e78-b1fb-4936-9c26-f7a6b11302c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:15.882182 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4bd61e78-b1fb-4936-9c26-f7a6b11302c0 None None] MFA Rules not processed for user `747b0b0cf7e64e9bbd8e38fccaf88235`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:15.883656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4bd61e78-b1fb-4936-9c26-f7a6b11302c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:15.951465 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:15.959892 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 973/1921] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:15 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:15.963264 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a70887-bc44-4ff0-883f-7b516b0fe90d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:16.043971 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a70887-bc44-4ff0-883f-7b516b0fe90d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:16.049208 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afdd34-ddea-422e-acc3-94b850831898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:16.050853 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afdd34-ddea-422e-acc3-94b850831898 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:16.051140 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afdd34-ddea-422e-acc3-94b850831898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:16.051420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afdd34-ddea-422e-acc3-94b850831898 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:16.052346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afdd34-ddea-422e-acc3-94b850831898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:16.055160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afdd34-ddea-422e-acc3-94b850831898 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:16.097809 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 949/1922] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:39:15 2022] POST /identity/v3/projects => generated 357 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:16.099905 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd61e78-b1fb-4936-9c26-f7a6b11302c0 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:16.113327 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd61e78-b1fb-4936-9c26-f7a6b11302c0 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:16.206974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f56cd1-641b-4505-8067-32e946170c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:16.207705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f56cd1-641b-4505-8067-32e946170c95 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:16.207998 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f56cd1-641b-4505-8067-32e946170c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:16.208278 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f56cd1-641b-4505-8067-32e946170c95 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:16.208978 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f56cd1-641b-4505-8067-32e946170c95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:16.211067 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f56cd1-641b-4505-8067-32e946170c95 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:16.233146 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 974/1923] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:39:16 2022] POST /identity/v3/users => generated 285 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:39:16.238442 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afdd34-ddea-422e-acc3-94b850831898 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:16.251508 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afdd34-ddea-422e-acc3-94b850831898 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:16.259247 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a65e2-26fb-4a76-806e-b5265766ec37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:16.259998 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a65e2-26fb-4a76-806e-b5265766ec37 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:16.260289 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a65e2-26fb-4a76-806e-b5265766ec37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:16.260627 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a65e2-26fb-4a76-806e-b5265766ec37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:16.261373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a65e2-26fb-4a76-806e-b5265766ec37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:16.263468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a65e2-26fb-4a76-806e-b5265766ec37 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:16.281242 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f56cd1-641b-4505-8067-32e946170c95 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:16.286181 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 950/1924] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:39:16.295231 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f56cd1-641b-4505-8067-32e946170c95 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:16.303074 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb55f9f-3b63-4d40-9c2c-c42155a4bb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:16.304456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb55f9f-3b63-4d40-9c2c-c42155a4bb72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:16.304456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb55f9f-3b63-4d40-9c2c-c42155a4bb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:16.305159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb55f9f-3b63-4d40-9c2c-c42155a4bb72 admin admin] PATH_INFO: `/v3/projects/f4934572abb54b3f9c4fe221a1dab3ec/users/5699f89798a94dc98f3e36c272f9a1d0/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:16.328743 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb55f9f-3b63-4d40-9c2c-c42155a4bb72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4934572abb54b3f9c4fe221a1dab3ec, user_id=5699f89798a94dc98f3e36c272f9a1d0, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:16.332279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb55f9f-3b63-4d40-9c2c-c42155a4bb72 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:16.349273 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 975/1925] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:39:16 2022] PUT /identity/v3/projects/f4934572abb54b3f9c4fe221a1dab3ec/users/5699f89798a94dc98f3e36c272f9a1d0/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:16.353920 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a65e2-26fb-4a76-806e-b5265766ec37 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:16.366388 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a65e2-26fb-4a76-806e-b5265766ec37 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:16.444563 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ed0c5-7042-434d-8c44-b0e77ec20152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:16.445377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ed0c5-7042-434d-8c44-b0e77ec20152 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:16.445732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ed0c5-7042-434d-8c44-b0e77ec20152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:16.446102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ed0c5-7042-434d-8c44-b0e77ec20152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:16.446934 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ed0c5-7042-434d-8c44-b0e77ec20152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:16.448555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ed0c5-7042-434d-8c44-b0e77ec20152 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:16.458960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 951/1926] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:39:16.463479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb55f9f-3b63-4d40-9c2c-c42155a4bb72 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:16.474658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb55f9f-3b63-4d40-9c2c-c42155a4bb72 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:16.479927 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389197e-ce2a-4ac1-84b3-b4730aa5723e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:16.481055 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389197e-ce2a-4ac1-84b3-b4730aa5723e admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:16.481343 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389197e-ce2a-4ac1-84b3-b4730aa5723e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:16.481651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389197e-ce2a-4ac1-84b3-b4730aa5723e admin admin] PATH_INFO: `/v3/projects/f4934572abb54b3f9c4fe221a1dab3ec/users/5699f89798a94dc98f3e36c272f9a1d0/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:16.483891 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389197e-ce2a-4ac1-84b3-b4730aa5723e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4934572abb54b3f9c4fe221a1dab3ec, user_id=5699f89798a94dc98f3e36c272f9a1d0, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:16.487061 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389197e-ce2a-4ac1-84b3-b4730aa5723e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:16.498328 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 976/1927] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:39:16 2022] PUT /identity/v3/projects/f4934572abb54b3f9c4fe221a1dab3ec/users/5699f89798a94dc98f3e36c272f9a1d0/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:16.509975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3850e06-a502-4249-8d14-564334f9601b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:16.511752 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3850e06-a502-4249-8d14-564334f9601b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:16.511752 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3850e06-a502-4249-8d14-564334f9601b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:16.543461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a3850e06-a502-4249-8d14-564334f9601b None None] MFA Rules not processed for user `5699f89798a94dc98f3e36c272f9a1d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:16.547786 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a3850e06-a502-4249-8d14-564334f9601b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:16.593333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:16.653904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 952/1928] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:16 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:39:16.674611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389197e-ce2a-4ac1-84b3-b4730aa5723e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:16.676512 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0389197e-ce2a-4ac1-84b3-b4730aa5723e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:16.795546 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389197e-ce2a-4ac1-84b3-b4730aa5723e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:16.802794 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b02990-dd61-41ce-8638-84a98ba18ca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:16.802794 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b02990-dd61-41ce-8638-84a98ba18ca4 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:16.802794 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b02990-dd61-41ce-8638-84a98ba18ca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:16.802794 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b02990-dd61-41ce-8638-84a98ba18ca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:16.813573 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b02990-dd61-41ce-8638-84a98ba18ca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:16.816381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b02990-dd61-41ce-8638-84a98ba18ca4 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:16.828950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 977/1929] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:39:16 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:16.927151 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3850e06-a502-4249-8d14-564334f9601b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:16.928657 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a3850e06-a502-4249-8d14-564334f9601b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:16.942283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3850e06-a502-4249-8d14-564334f9601b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:16.946184 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc554d7-aa16-44b1-bda2-7fc77aeb5aef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:16.946844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc554d7-aa16-44b1-bda2-7fc77aeb5aef service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:16.947139 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc554d7-aa16-44b1-bda2-7fc77aeb5aef service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:16.947419 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc554d7-aa16-44b1-bda2-7fc77aeb5aef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:17.009055 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc554d7-aa16-44b1-bda2-7fc77aeb5aef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:17.010568 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc554d7-aa16-44b1-bda2-7fc77aeb5aef service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:17.020557 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 953/1930] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:39:16 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:19.065270 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b02990-dd61-41ce-8638-84a98ba18ca4 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:19.066748 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-60b02990-dd61-41ce-8638-84a98ba18ca4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:19.124558 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:19.138428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b02990-dd61-41ce-8638-84a98ba18ca4 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:19.143080 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1d99c-ce0b-45a0-90cc-c67f06c7ac77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:19.143958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1d99c-ce0b-45a0-90cc-c67f06c7ac77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:19.144243 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1d99c-ce0b-45a0-90cc-c67f06c7ac77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:19.144521 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1d99c-ce0b-45a0-90cc-c67f06c7ac77 admin admin] PATH_INFO: `/v3/users/86a12ce4f6134290ac938abe56342c14` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:19.145717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1d99c-ce0b-45a0-90cc-c67f06c7ac77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a12ce4f6134290ac938abe56342c14)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:19.147796 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1d99c-ce0b-45a0-90cc-c67f06c7ac77 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:19.198708 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-92e1d99c-ce0b-45a0-90cc-c67f06c7ac77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a12ce4f6134290ac938abe56342c14'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:19.199311 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-92e1d99c-ce0b-45a0-90cc-c67f06c7ac77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a12ce4f6134290ac938abe56342c14'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:19.207049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-92e1d99c-ce0b-45a0-90cc-c67f06c7ac77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a12ce4f6134290ac938abe56342c14'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:19.214526 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-92e1d99c-ce0b-45a0-90cc-c67f06c7ac77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a12ce4f6134290ac938abe56342c14'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:19.227825 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-92e1d99c-ce0b-45a0-90cc-c67f06c7ac77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a12ce4f6134290ac938abe56342c14'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:19.239126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 978/1931] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:39:19 2022] DELETE /identity/v3/users/86a12ce4f6134290ac938abe56342c14 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:19.243692 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737dc0f-e0c2-4681-afbc-ebaf3687e21f None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:19.244193 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737dc0f-e0c2-4681-afbc-ebaf3687e21f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:19.244287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737dc0f-e0c2-4681-afbc-ebaf3687e21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:19.262108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-4737dc0f-e0c2-4681-afbc-ebaf3687e21f None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:19.263498 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4737dc0f-e0c2-4681-afbc-ebaf3687e21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:19.344527 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 954/1932] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:19.357214 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1d99c-ce0b-45a0-90cc-c67f06c7ac77 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:19.358853 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-92e1d99c-ce0b-45a0-90cc-c67f06c7ac77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:19.485172 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1d99c-ce0b-45a0-90cc-c67f06c7ac77 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:19.497548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89660def-b55b-4184-81d2-4d2830df9cfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:19.500287 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89660def-b55b-4184-81d2-4d2830df9cfb service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:19.501016 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89660def-b55b-4184-81d2-4d2830df9cfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:19.501715 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89660def-b55b-4184-81d2-4d2830df9cfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:19.532382 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89660def-b55b-4184-81d2-4d2830df9cfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:19.534576 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89660def-b55b-4184-81d2-4d2830df9cfb service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:19.563948 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 979/1933] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:20.207212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737dc0f-e0c2-4681-afbc-ebaf3687e21f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:20.208843 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4737dc0f-e0c2-4681-afbc-ebaf3687e21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:20.232684 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737dc0f-e0c2-4681-afbc-ebaf3687e21f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:20.239997 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d7de7-83d2-41dc-9f3a-3fd3e157ca83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:20.240955 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d7de7-83d2-41dc-9f3a-3fd3e157ca83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:20.241144 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d7de7-83d2-41dc-9f3a-3fd3e157ca83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:20.241427 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d7de7-83d2-41dc-9f3a-3fd3e157ca83 admin admin] PATH_INFO: `/v3/projects/b29d1dc3b9a24ee8a67b0edddb2622ab` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:20.242734 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d7de7-83d2-41dc-9f3a-3fd3e157ca83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b29d1dc3b9a24ee8a67b0edddb2622ab)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:20.244749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d7de7-83d2-41dc-9f3a-3fd3e157ca83 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:20.307366 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-223d7de7-83d2-41dc-9f3a-3fd3e157ca83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b29d1dc3b9a24ee8a67b0edddb2622ab', 'request_id': 'req-223d7de7-83d2-41dc-9f3a-3fd3e157ca83'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:20.314358 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-223d7de7-83d2-41dc-9f3a-3fd3e157ca83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b29d1dc3b9a24ee8a67b0edddb2622ab', 'request_id': 'req-223d7de7-83d2-41dc-9f3a-3fd3e157ca83'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:20.315907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:20.323042 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-223d7de7-83d2-41dc-9f3a-3fd3e157ca83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b29d1dc3b9a24ee8a67b0edddb2622ab', 'request_id': 'req-223d7de7-83d2-41dc-9f3a-3fd3e157ca83'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:20.338848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-223d7de7-83d2-41dc-9f3a-3fd3e157ca83 admin admin] The token cache is being invalidate because project b29d1dc3b9a24ee8a67b0edddb2622ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:39:20.339145 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-223d7de7-83d2-41dc-9f3a-3fd3e157ca83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:20.340024 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-223d7de7-83d2-41dc-9f3a-3fd3e157ca83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:20.342282 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 955/1934] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:39:20 2022] DELETE /identity/v3/projects/b29d1dc3b9a24ee8a67b0edddb2622ab => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:39:20.348013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89660def-b55b-4184-81d2-4d2830df9cfb service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:20.357819 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89660def-b55b-4184-81d2-4d2830df9cfb service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:20.463410 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a193c-8991-493a-904b-c2fee2e4f041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:20.464345 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a193c-8991-493a-904b-c2fee2e4f041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:20.464688 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a193c-8991-493a-904b-c2fee2e4f041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:20.465083 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a193c-8991-493a-904b-c2fee2e4f041 admin admin] PATH_INFO: `/v3/users/030da561d63848b490f4aa82e498bc3c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:20.466822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a193c-8991-493a-904b-c2fee2e4f041 admin admin] RBAC: Authorizing `identity:delete_user(user_id=030da561d63848b490f4aa82e498bc3c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:20.468910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a193c-8991-493a-904b-c2fee2e4f041 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:20.493850 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:20.559797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ca3a193c-8991-493a-904b-c2fee2e4f041 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '030da561d63848b490f4aa82e498bc3c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:20.561549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ca3a193c-8991-493a-904b-c2fee2e4f041 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '030da561d63848b490f4aa82e498bc3c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:20.573195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ca3a193c-8991-493a-904b-c2fee2e4f041 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '030da561d63848b490f4aa82e498bc3c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:20.583575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ca3a193c-8991-493a-904b-c2fee2e4f041 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '030da561d63848b490f4aa82e498bc3c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:20.601441 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ca3a193c-8991-493a-904b-c2fee2e4f041 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '030da561d63848b490f4aa82e498bc3c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:20.613335 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 980/1935] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:39:20 2022] DELETE /identity/v3/users/030da561d63848b490f4aa82e498bc3c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:20.914690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d7de7-83d2-41dc-9f3a-3fd3e157ca83 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:20.916843 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-223d7de7-83d2-41dc-9f3a-3fd3e157ca83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:20.934157 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d7de7-83d2-41dc-9f3a-3fd3e157ca83 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:21.004480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35af1e-6330-47d6-a34c-df8353f0c009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:21.005978 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35af1e-6330-47d6-a34c-df8353f0c009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:21.006305 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35af1e-6330-47d6-a34c-df8353f0c009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:21.006586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35af1e-6330-47d6-a34c-df8353f0c009 admin admin] PATH_INFO: `/v3/projects/76ab4a73afea43239323e69722f00212` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:21.007943 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35af1e-6330-47d6-a34c-df8353f0c009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76ab4a73afea43239323e69722f00212)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:21.009876 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35af1e-6330-47d6-a34c-df8353f0c009 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:21.069629 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4c35af1e-6330-47d6-a34c-df8353f0c009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76ab4a73afea43239323e69722f00212', 'request_id': 'req-4c35af1e-6330-47d6-a34c-df8353f0c009'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:21.077221 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4c35af1e-6330-47d6-a34c-df8353f0c009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76ab4a73afea43239323e69722f00212', 'request_id': 'req-4c35af1e-6330-47d6-a34c-df8353f0c009'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:21.084700 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4c35af1e-6330-47d6-a34c-df8353f0c009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76ab4a73afea43239323e69722f00212', 'request_id': 'req-4c35af1e-6330-47d6-a34c-df8353f0c009'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:21.107578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4c35af1e-6330-47d6-a34c-df8353f0c009 admin admin] The token cache is being invalidate because project 76ab4a73afea43239323e69722f00212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:39:21.107908 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4c35af1e-6330-47d6-a34c-df8353f0c009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:21.108556 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4c35af1e-6330-47d6-a34c-df8353f0c009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:21.110121 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 956/1936] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:39:20 2022] DELETE /identity/v3/projects/76ab4a73afea43239323e69722f00212 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:21.116780 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c881c-2beb-40c9-b350-5f7047b86fb2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:21.117395 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c881c-2beb-40c9-b350-5f7047b86fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:21.118002 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c881c-2beb-40c9-b350-5f7047b86fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:21.147628 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-569c881c-2beb-40c9-b350-5f7047b86fb2 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:21.149585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-569c881c-2beb-40c9-b350-5f7047b86fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:21.230039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 981/1937] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:21.239112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb0e28-87de-401f-bbb3-7a22a3a459b2 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:21.239404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb0e28-87de-401f-bbb3-7a22a3a459b2 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:21.239685 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb0e28-87de-401f-bbb3-7a22a3a459b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:21.273223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f8bb0e28-87de-401f-bbb3-7a22a3a459b2 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:21.275484 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f8bb0e28-87de-401f-bbb3-7a22a3a459b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:21.292159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 957/1938] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:21.292698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c881c-2beb-40c9-b350-5f7047b86fb2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:21.308321 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c881c-2beb-40c9-b350-5f7047b86fb2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:21.319910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34070732-67d0-4e89-99fe-623bb4d49e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:21.320704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34070732-67d0-4e89-99fe-623bb4d49e06 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:21.321109 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34070732-67d0-4e89-99fe-623bb4d49e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:21.321478 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34070732-67d0-4e89-99fe-623bb4d49e06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:21.323219 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34070732-67d0-4e89-99fe-623bb4d49e06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:21.325281 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34070732-67d0-4e89-99fe-623bb4d49e06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:21.327053 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34070732-67d0-4e89-99fe-623bb4d49e06 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:21.345347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 982/1939] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:21.347717 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb0e28-87de-401f-bbb3-7a22a3a459b2 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:21.359565 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb0e28-87de-401f-bbb3-7a22a3a459b2 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:21.365085 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997406a-5b5f-47a5-b91f-0666d57f224a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:21.365905 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997406a-5b5f-47a5-b91f-0666d57f224a admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:21.366234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997406a-5b5f-47a5-b91f-0666d57f224a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:21.366517 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997406a-5b5f-47a5-b91f-0666d57f224a admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:21.367312 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997406a-5b5f-47a5-b91f-0666d57f224a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:21.369527 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997406a-5b5f-47a5-b91f-0666d57f224a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:21.400213 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 958/1940] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:39:21 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:21.404491 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34070732-67d0-4e89-99fe-623bb4d49e06 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:21.420372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34070732-67d0-4e89-99fe-623bb4d49e06 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:21.504046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fda646-8db0-4c49-aaaa-9e09240cf483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:21.504725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fda646-8db0-4c49-aaaa-9e09240cf483 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:21.505008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fda646-8db0-4c49-aaaa-9e09240cf483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:21.505280 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fda646-8db0-4c49-aaaa-9e09240cf483 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:21.506212 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fda646-8db0-4c49-aaaa-9e09240cf483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:21.508330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fda646-8db0-4c49-aaaa-9e09240cf483 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:21.540753 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 983/1941] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:39:21 2022] POST /identity/v3/users => generated 287 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:21.542099 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997406a-5b5f-47a5-b91f-0666d57f224a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:21.564809 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997406a-5b5f-47a5-b91f-0666d57f224a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:21.579185 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3262d4-94a3-4d87-a375-3ec9b5d3629a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:21.580901 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3262d4-94a3-4d87-a375-3ec9b5d3629a admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:21.581179 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3262d4-94a3-4d87-a375-3ec9b5d3629a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:21.581828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3262d4-94a3-4d87-a375-3ec9b5d3629a admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:21.583886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3262d4-94a3-4d87-a375-3ec9b5d3629a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:21.585697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3262d4-94a3-4d87-a375-3ec9b5d3629a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:21.617141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 959/1942] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:39:21.632205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fda646-8db0-4c49-aaaa-9e09240cf483 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:21.652390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fda646-8db0-4c49-aaaa-9e09240cf483 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:21.662682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5132e-22e9-4f16-b4f3-cd1a317119da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:21.663671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5132e-22e9-4f16-b4f3-cd1a317119da admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:21.664073 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5132e-22e9-4f16-b4f3-cd1a317119da admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:21.664451 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5132e-22e9-4f16-b4f3-cd1a317119da admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:21.665740 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5132e-22e9-4f16-b4f3-cd1a317119da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:21.667886 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5132e-22e9-4f16-b4f3-cd1a317119da admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:21.678699 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:21.700217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 984/1943] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:39:21.703420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3262d4-94a3-4d87-a375-3ec9b5d3629a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:21.724118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3262d4-94a3-4d87-a375-3ec9b5d3629a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:21.731906 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73232db7-698f-459a-a768-898b0366a065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:21.732980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73232db7-698f-459a-a768-898b0366a065 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:21.733264 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73232db7-698f-459a-a768-898b0366a065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:21.733536 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73232db7-698f-459a-a768-898b0366a065 admin admin] PATH_INFO: `/v3/projects/a7b0366910d7445d98c67365c5ca6ccb/users/ea35144aa9164de3a94173a64650fd50/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:21.751862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73232db7-698f-459a-a768-898b0366a065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b0366910d7445d98c67365c5ca6ccb, user_id=ea35144aa9164de3a94173a64650fd50, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:21.755270 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73232db7-698f-459a-a768-898b0366a065 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:21.770534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 960/1944] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:39:21 2022] PUT /identity/v3/projects/a7b0366910d7445d98c67365c5ca6ccb/users/ea35144aa9164de3a94173a64650fd50/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:21.775694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf28b69-b40e-4115-9e31-ee8452a4edcd None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:21.776792 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf28b69-b40e-4115-9e31-ee8452a4edcd None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:21.777084 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf28b69-b40e-4115-9e31-ee8452a4edcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:21.809941 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8cf28b69-b40e-4115-9e31-ee8452a4edcd None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:21.812606 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8cf28b69-b40e-4115-9e31-ee8452a4edcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:21.911267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 985/1945] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:21.924350 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73232db7-698f-459a-a768-898b0366a065 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:21.927677 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-73232db7-698f-459a-a768-898b0366a065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:21.946036 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:22.042137 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73232db7-698f-459a-a768-898b0366a065 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:22.049581 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90723803-87fd-4917-896b-c757b03dd835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:22.050613 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90723803-87fd-4917-896b-c757b03dd835 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:22.051003 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90723803-87fd-4917-896b-c757b03dd835 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:22.051386 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90723803-87fd-4917-896b-c757b03dd835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:22.063178 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90723803-87fd-4917-896b-c757b03dd835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:22.065473 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90723803-87fd-4917-896b-c757b03dd835 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:22.078326 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 961/1946] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:39:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:23.126027 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61a6d0-182f-49bd-9da7-86bcbc5a4f44 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:23.126987 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61a6d0-182f-49bd-9da7-86bcbc5a4f44 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:23.127947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61a6d0-182f-49bd-9da7-86bcbc5a4f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:23.160091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ef61a6d0-182f-49bd-9da7-86bcbc5a4f44 None None] MFA Rules not processed for user `ea35144aa9164de3a94173a64650fd50`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:23.161539 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ef61a6d0-182f-49bd-9da7-86bcbc5a4f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:23.247333 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 986/1947] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:23.256243 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90723803-87fd-4917-896b-c757b03dd835 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:23.259111 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-90723803-87fd-4917-896b-c757b03dd835 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:23.335727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90723803-87fd-4917-896b-c757b03dd835 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:23.348955 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944cb6d7-0bd0-4ccc-a965-8d9b8e05cb25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:23.349798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cb6d7-0bd0-4ccc-a965-8d9b8e05cb25 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:23.350177 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cb6d7-0bd0-4ccc-a965-8d9b8e05cb25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:23.350551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cb6d7-0bd0-4ccc-a965-8d9b8e05cb25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:23.361842 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944cb6d7-0bd0-4ccc-a965-8d9b8e05cb25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:23.363558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944cb6d7-0bd0-4ccc-a965-8d9b8e05cb25 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:23.376852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 962/1948] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:39:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:24.925534 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09f621-6b17-45a5-b9c3-86a7f713517e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:24.926128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09f621-6b17-45a5-b9c3-86a7f713517e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:24.926128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d09f621-6b17-45a5-b9c3-86a7f713517e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:24.945450 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5d09f621-6b17-45a5-b9c3-86a7f713517e None None] MFA Rules not processed for user `ea35144aa9164de3a94173a64650fd50`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:24.946779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5d09f621-6b17-45a5-b9c3-86a7f713517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:24.953986 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 987/1949] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:33.372103 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=48 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:34.939101 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=62 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:45.739160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944cb6d7-0bd0-4ccc-a965-8d9b8e05cb25 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:45.741412 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-944cb6d7-0bd0-4ccc-a965-8d9b8e05cb25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:45.762820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944cb6d7-0bd0-4ccc-a965-8d9b8e05cb25 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:45.769459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d3db2-d997-4d04-b7b5-a306ecb91d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:45.771656 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d3db2-d997-4d04-b7b5-a306ecb91d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:45.772100 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d3db2-d997-4d04-b7b5-a306ecb91d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:45.772533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d3db2-d997-4d04-b7b5-a306ecb91d70 admin admin] PATH_INFO: `/v3/users/747b0b0cf7e64e9bbd8e38fccaf88235` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:45.774798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d3db2-d997-4d04-b7b5-a306ecb91d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=747b0b0cf7e64e9bbd8e38fccaf88235)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:45.777980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d3db2-d997-4d04-b7b5-a306ecb91d70 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:45.857389 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-720d3db2-d997-4d04-b7b5-a306ecb91d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '747b0b0cf7e64e9bbd8e38fccaf88235'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:45.865404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-720d3db2-d997-4d04-b7b5-a306ecb91d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '747b0b0cf7e64e9bbd8e38fccaf88235'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:45.880801 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-720d3db2-d997-4d04-b7b5-a306ecb91d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '747b0b0cf7e64e9bbd8e38fccaf88235'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:45.891286 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-720d3db2-d997-4d04-b7b5-a306ecb91d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '747b0b0cf7e64e9bbd8e38fccaf88235'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:45.892520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-720d3db2-d997-4d04-b7b5-a306ecb91d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '747b0b0cf7e64e9bbd8e38fccaf88235'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:45.901265 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 963/1950] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:39:45 2022] DELETE /identity/v3/users/747b0b0cf7e64e9bbd8e38fccaf88235 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:45.905867 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af5972-a087-4444-b6ee-069f8c0b3dc7 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:45.905867 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af5972-a087-4444-b6ee-069f8c0b3dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:45.906523 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af5972-a087-4444-b6ee-069f8c0b3dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:45.930660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d0af5972-a087-4444-b6ee-069f8c0b3dc7 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:45.932076 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d0af5972-a087-4444-b6ee-069f8c0b3dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:46.055622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 988/1951] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:39:46.075917 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d3db2-d997-4d04-b7b5-a306ecb91d70 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:46.077377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-720d3db2-d997-4d04-b7b5-a306ecb91d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:46.152400 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d3db2-d997-4d04-b7b5-a306ecb91d70 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:46.167288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cd35f-e780-4e3e-a5fd-67ab5114585c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:46.169363 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cd35f-e780-4e3e-a5fd-67ab5114585c service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:46.170437 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cd35f-e780-4e3e-a5fd-67ab5114585c service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:46.170729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cd35f-e780-4e3e-a5fd-67ab5114585c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:46.188455 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cd35f-e780-4e3e-a5fd-67ab5114585c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:46.190850 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cd35f-e780-4e3e-a5fd-67ab5114585c service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:46.201305 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 964/1952] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:39:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:46.604974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af5972-a087-4444-b6ee-069f8c0b3dc7 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:46.606573 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d0af5972-a087-4444-b6ee-069f8c0b3dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:46.621287 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af5972-a087-4444-b6ee-069f8c0b3dc7 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:46.629269 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f9e2c-8167-4ca5-89ae-8925b14ef983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:46.630601 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f9e2c-8167-4ca5-89ae-8925b14ef983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:46.630896 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f9e2c-8167-4ca5-89ae-8925b14ef983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:46.631283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f9e2c-8167-4ca5-89ae-8925b14ef983 admin admin] PATH_INFO: `/v3/projects/a0a429ad336846ebbf3e79b682671da4` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:46.632590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f9e2c-8167-4ca5-89ae-8925b14ef983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0a429ad336846ebbf3e79b682671da4)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:46.634799 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f9e2c-8167-4ca5-89ae-8925b14ef983 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:46.684466 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-bd3f9e2c-8167-4ca5-89ae-8925b14ef983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0a429ad336846ebbf3e79b682671da4', 'request_id': 'req-bd3f9e2c-8167-4ca5-89ae-8925b14ef983'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:46.691579 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-bd3f9e2c-8167-4ca5-89ae-8925b14ef983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0a429ad336846ebbf3e79b682671da4', 'request_id': 'req-bd3f9e2c-8167-4ca5-89ae-8925b14ef983'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:46.699429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-bd3f9e2c-8167-4ca5-89ae-8925b14ef983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0a429ad336846ebbf3e79b682671da4', 'request_id': 'req-bd3f9e2c-8167-4ca5-89ae-8925b14ef983'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:46.711836 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-bd3f9e2c-8167-4ca5-89ae-8925b14ef983 admin admin] The token cache is being invalidate because project a0a429ad336846ebbf3e79b682671da4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:39:46.712129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-bd3f9e2c-8167-4ca5-89ae-8925b14ef983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:46.712800 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-bd3f9e2c-8167-4ca5-89ae-8925b14ef983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:46.714383 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 989/1953] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:39:46 2022] DELETE /identity/v3/projects/a0a429ad336846ebbf3e79b682671da4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:46.718633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cd35f-e780-4e3e-a5fd-67ab5114585c service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:46.729371 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cd35f-e780-4e3e-a5fd-67ab5114585c service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:46.788197 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd28a3-fb8b-40af-ad73-2993d18e11ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:46.789127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd28a3-fb8b-40af-ad73-2993d18e11ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:46.789410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd28a3-fb8b-40af-ad73-2993d18e11ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:46.789991 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd28a3-fb8b-40af-ad73-2993d18e11ba admin admin] PATH_INFO: `/v3/users/5699f89798a94dc98f3e36c272f9a1d0` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:46.791228 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd28a3-fb8b-40af-ad73-2993d18e11ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5699f89798a94dc98f3e36c272f9a1d0)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:46.793211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd28a3-fb8b-40af-ad73-2993d18e11ba admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:46.811276 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:46.857585 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-79cd28a3-fb8b-40af-ad73-2993d18e11ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5699f89798a94dc98f3e36c272f9a1d0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:46.867854 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-79cd28a3-fb8b-40af-ad73-2993d18e11ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5699f89798a94dc98f3e36c272f9a1d0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:46.915474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-79cd28a3-fb8b-40af-ad73-2993d18e11ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5699f89798a94dc98f3e36c272f9a1d0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:46.932382 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-79cd28a3-fb8b-40af-ad73-2993d18e11ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5699f89798a94dc98f3e36c272f9a1d0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:46.933231 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-79cd28a3-fb8b-40af-ad73-2993d18e11ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5699f89798a94dc98f3e36c272f9a1d0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:46.948792 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 965/1954] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:39:46 2022] DELETE /identity/v3/users/5699f89798a94dc98f3e36c272f9a1d0 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:47.382181 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f9e2c-8167-4ca5-89ae-8925b14ef983 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:47.383797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-bd3f9e2c-8167-4ca5-89ae-8925b14ef983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:47.404466 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f9e2c-8167-4ca5-89ae-8925b14ef983 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:47.473272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387bc90-c6a7-42f6-9bed-b342f50c7388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:47.474247 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387bc90-c6a7-42f6-9bed-b342f50c7388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:47.474539 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387bc90-c6a7-42f6-9bed-b342f50c7388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:47.474885 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387bc90-c6a7-42f6-9bed-b342f50c7388 admin admin] PATH_INFO: `/v3/projects/f4934572abb54b3f9c4fe221a1dab3ec` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:47.476138 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387bc90-c6a7-42f6-9bed-b342f50c7388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4934572abb54b3f9c4fe221a1dab3ec)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:47.478049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387bc90-c6a7-42f6-9bed-b342f50c7388 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:47.511965 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:47.533553 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c387bc90-c6a7-42f6-9bed-b342f50c7388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4934572abb54b3f9c4fe221a1dab3ec', 'request_id': 'req-c387bc90-c6a7-42f6-9bed-b342f50c7388'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:47.539206 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c387bc90-c6a7-42f6-9bed-b342f50c7388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4934572abb54b3f9c4fe221a1dab3ec', 'request_id': 'req-c387bc90-c6a7-42f6-9bed-b342f50c7388'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:47.546687 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c387bc90-c6a7-42f6-9bed-b342f50c7388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4934572abb54b3f9c4fe221a1dab3ec', 'request_id': 'req-c387bc90-c6a7-42f6-9bed-b342f50c7388'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:47.558417 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c387bc90-c6a7-42f6-9bed-b342f50c7388 admin admin] The token cache is being invalidate because project f4934572abb54b3f9c4fe221a1dab3ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:39:47.558643 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c387bc90-c6a7-42f6-9bed-b342f50c7388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:47.559290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c387bc90-c6a7-42f6-9bed-b342f50c7388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:47.560875 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 990/1955] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:39:47 2022] DELETE /identity/v3/projects/f4934572abb54b3f9c4fe221a1dab3ec => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:39:47.566867 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40714943-1a71-43bd-a44e-3080099bb1ee None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:47.567155 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40714943-1a71-43bd-a44e-3080099bb1ee None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:47.567454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40714943-1a71-43bd-a44e-3080099bb1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:47.585955 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-40714943-1a71-43bd-a44e-3080099bb1ee None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:47.587206 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-40714943-1a71-43bd-a44e-3080099bb1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:47.646606 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 966/1956] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:39:47.654921 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b0ff0-d44d-43d9-8cb9-6b31f6dba67e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:47.655221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b0ff0-d44d-43d9-8cb9-6b31f6dba67e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:47.655511 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b0ff0-d44d-43d9-8cb9-6b31f6dba67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:47.676163 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-150b0ff0-d44d-43d9-8cb9-6b31f6dba67e None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:47.677392 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-150b0ff0-d44d-43d9-8cb9-6b31f6dba67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:47.685496 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 991/1957] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:47.690378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40714943-1a71-43bd-a44e-3080099bb1ee None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:47.700209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40714943-1a71-43bd-a44e-3080099bb1ee None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:47.706290 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1deb1e2-c559-410f-88e3-c161b47e104c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:47.706943 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1deb1e2-c559-410f-88e3-c161b47e104c admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:47.707234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1deb1e2-c559-410f-88e3-c161b47e104c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:47.707512 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1deb1e2-c559-410f-88e3-c161b47e104c admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:47.708236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1deb1e2-c559-410f-88e3-c161b47e104c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:47.708548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1deb1e2-c559-410f-88e3-c161b47e104c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:47.710547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1deb1e2-c559-410f-88e3-c161b47e104c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:47.724453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 967/1958] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:39:47.728825 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b0ff0-d44d-43d9-8cb9-6b31f6dba67e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:47.738199 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b0ff0-d44d-43d9-8cb9-6b31f6dba67e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:47.742765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd2bd3-4777-4d6a-b19d-10336652ffd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:47.743405 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd2bd3-4777-4d6a-b19d-10336652ffd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:47.743685 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd2bd3-4777-4d6a-b19d-10336652ffd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:47.743960 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd2bd3-4777-4d6a-b19d-10336652ffd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:47.744648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd2bd3-4777-4d6a-b19d-10336652ffd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:47.746577 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd2bd3-4777-4d6a-b19d-10336652ffd6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:47.772429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 992/1959] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:39:47 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:47.776646 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1deb1e2-c559-410f-88e3-c161b47e104c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:47.787688 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1deb1e2-c559-410f-88e3-c161b47e104c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:47.844457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8eb774-9625-4f23-9f80-ab6e587de7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:47.845280 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8eb774-9625-4f23-9f80-ab6e587de7fc admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:47.846052 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8eb774-9625-4f23-9f80-ab6e587de7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:47.846363 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8eb774-9625-4f23-9f80-ab6e587de7fc admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:47.847051 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8eb774-9625-4f23-9f80-ab6e587de7fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:47.848995 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8eb774-9625-4f23-9f80-ab6e587de7fc admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:47.869182 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 968/1960] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:39:47 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:47.873351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd2bd3-4777-4d6a-b19d-10336652ffd6 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:47.883467 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd2bd3-4777-4d6a-b19d-10336652ffd6 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:47.887963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8878c36-a8e2-4839-b326-bb9e1e3bc207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:47.888620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8878c36-a8e2-4839-b326-bb9e1e3bc207 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:47.888904 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8878c36-a8e2-4839-b326-bb9e1e3bc207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:47.889184 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8878c36-a8e2-4839-b326-bb9e1e3bc207 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:47.890046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8878c36-a8e2-4839-b326-bb9e1e3bc207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:47.891556 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8878c36-a8e2-4839-b326-bb9e1e3bc207 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:47.902472 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 993/1961] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:39:47.906594 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8eb774-9625-4f23-9f80-ab6e587de7fc admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:47.917663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8eb774-9625-4f23-9f80-ab6e587de7fc admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:47.922301 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe07753-e0ba-46bf-abad-b45abcabe395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:47.922957 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe07753-e0ba-46bf-abad-b45abcabe395 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:47.923868 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe07753-e0ba-46bf-abad-b45abcabe395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:47.924181 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe07753-e0ba-46bf-abad-b45abcabe395 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:47.924909 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe07753-e0ba-46bf-abad-b45abcabe395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:47.926538 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe07753-e0ba-46bf-abad-b45abcabe395 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:47.932288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:47.938697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 969/1962] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:39:47.944013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8878c36-a8e2-4839-b326-bb9e1e3bc207 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:47.958540 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8878c36-a8e2-4839-b326-bb9e1e3bc207 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:47.963494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621492a9-e553-4ebc-b0e8-028c9ad5405b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:47.964381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621492a9-e553-4ebc-b0e8-028c9ad5405b admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:47.964676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621492a9-e553-4ebc-b0e8-028c9ad5405b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:47.964960 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621492a9-e553-4ebc-b0e8-028c9ad5405b admin admin] PATH_INFO: `/v3/projects/337053c36e4748b79f94e5e3096e9fa3/users/f19342827ecc47088ae7920c6b8b890e/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:47.981002 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621492a9-e553-4ebc-b0e8-028c9ad5405b admin admin] RBAC: Authorizing `identity:create_grant(project_id=337053c36e4748b79f94e5e3096e9fa3, user_id=f19342827ecc47088ae7920c6b8b890e, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:47.983745 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621492a9-e553-4ebc-b0e8-028c9ad5405b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:47.999768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 994/1963] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:39:47 2022] PUT /identity/v3/projects/337053c36e4748b79f94e5e3096e9fa3/users/f19342827ecc47088ae7920c6b8b890e/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:48.010861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fc537-a12c-40c7-934e-bfd8f73151bf None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:48.011155 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fc537-a12c-40c7-934e-bfd8f73151bf None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:48.011438 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fc537-a12c-40c7-934e-bfd8f73151bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:48.039237 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-0a4fc537-a12c-40c7-934e-bfd8f73151bf None None] MFA Rules not processed for user `f19342827ecc47088ae7920c6b8b890e`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:48.040729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0a4fc537-a12c-40c7-934e-bfd8f73151bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:48.105493 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 970/1964] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:48.110320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621492a9-e553-4ebc-b0e8-028c9ad5405b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:48.175610 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621492a9-e553-4ebc-b0e8-028c9ad5405b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:48.180606 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79966dd-0a75-44d7-a970-76d7c3f68d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:48.181277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79966dd-0a75-44d7-a970-76d7c3f68d46 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:48.181564 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79966dd-0a75-44d7-a970-76d7c3f68d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:48.181843 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79966dd-0a75-44d7-a970-76d7c3f68d46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:48.182590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79966dd-0a75-44d7-a970-76d7c3f68d46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:48.184543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79966dd-0a75-44d7-a970-76d7c3f68d46 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:48.210613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 995/1965] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:39:48 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:48.214829 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fc537-a12c-40c7-934e-bfd8f73151bf None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:48.226766 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fc537-a12c-40c7-934e-bfd8f73151bf None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:48.287847 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d69331-28b2-4c34-85da-90b765504868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:48.288532 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d69331-28b2-4c34-85da-90b765504868 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:48.288825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d69331-28b2-4c34-85da-90b765504868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:48.289110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d69331-28b2-4c34-85da-90b765504868 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:48.290173 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d69331-28b2-4c34-85da-90b765504868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:48.292360 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d69331-28b2-4c34-85da-90b765504868 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:48.319007 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 971/1966] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:39:48 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:48.322759 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79966dd-0a75-44d7-a970-76d7c3f68d46 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:48.334446 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79966dd-0a75-44d7-a970-76d7c3f68d46 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:48.340554 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c4336-2ea0-4eac-bbad-d72343f9e439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:48.341517 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c4336-2ea0-4eac-bbad-d72343f9e439 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:48.341807 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c4336-2ea0-4eac-bbad-d72343f9e439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:48.342249 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c4336-2ea0-4eac-bbad-d72343f9e439 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:48.343113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c4336-2ea0-4eac-bbad-d72343f9e439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:48.344756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c4336-2ea0-4eac-bbad-d72343f9e439 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:48.361422 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 996/1967] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:39:48.365670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d69331-28b2-4c34-85da-90b765504868 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:48.379899 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d69331-28b2-4c34-85da-90b765504868 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:48.386696 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c723b-2406-46c9-ad37-eae242a868dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:48.388007 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c723b-2406-46c9-ad37-eae242a868dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:48.388363 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c723b-2406-46c9-ad37-eae242a868dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:48.388597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c723b-2406-46c9-ad37-eae242a868dc admin admin] PATH_INFO: `/v3/projects/03c0577b0eeb4e6e8bb5ff73759ecba9/users/d79a902ee809499494cc865d27a0106c/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:48.416450 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c723b-2406-46c9-ad37-eae242a868dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=03c0577b0eeb4e6e8bb5ff73759ecba9, user_id=d79a902ee809499494cc865d27a0106c, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:48.419648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c723b-2406-46c9-ad37-eae242a868dc admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:48.447213 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 972/1968] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:39:48 2022] PUT /identity/v3/projects/03c0577b0eeb4e6e8bb5ff73759ecba9/users/d79a902ee809499494cc865d27a0106c/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:48.451678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c4336-2ea0-4eac-bbad-d72343f9e439 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:48.464076 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c4336-2ea0-4eac-bbad-d72343f9e439 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:48.491473 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:48.534831 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf605414-32fb-4938-86ad-e7aebcfd6699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:48.535504 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf605414-32fb-4938-86ad-e7aebcfd6699 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:48.535814 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf605414-32fb-4938-86ad-e7aebcfd6699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:48.536094 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf605414-32fb-4938-86ad-e7aebcfd6699 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:48.536814 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf605414-32fb-4938-86ad-e7aebcfd6699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:48.538513 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf605414-32fb-4938-86ad-e7aebcfd6699 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:48.549783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 997/1969] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:39:48.553921 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c723b-2406-46c9-ad37-eae242a868dc admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:48.564818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c723b-2406-46c9-ad37-eae242a868dc admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:48.569464 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43634d-cb72-49b7-85d0-7e55db83d5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:48.570391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43634d-cb72-49b7-85d0-7e55db83d5dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:48.570672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43634d-cb72-49b7-85d0-7e55db83d5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:48.570944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43634d-cb72-49b7-85d0-7e55db83d5dd admin admin] PATH_INFO: `/v3/projects/03c0577b0eeb4e6e8bb5ff73759ecba9/users/d79a902ee809499494cc865d27a0106c/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:48.572924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43634d-cb72-49b7-85d0-7e55db83d5dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=03c0577b0eeb4e6e8bb5ff73759ecba9, user_id=d79a902ee809499494cc865d27a0106c, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:48.575599 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43634d-cb72-49b7-85d0-7e55db83d5dd admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:48.589273 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 973/1970] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:39:48 2022] PUT /identity/v3/projects/03c0577b0eeb4e6e8bb5ff73759ecba9/users/d79a902ee809499494cc865d27a0106c/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:48.600941 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a50ad-173c-4e36-8436-724b52e636eb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:48.601242 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a50ad-173c-4e36-8436-724b52e636eb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:48.601528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a50ad-173c-4e36-8436-724b52e636eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:48.627882 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-213a50ad-173c-4e36-8436-724b52e636eb None None] MFA Rules not processed for user `d79a902ee809499494cc865d27a0106c`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:48.629047 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-213a50ad-173c-4e36-8436-724b52e636eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:48.696558 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 998/1971] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:48.708230 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43634d-cb72-49b7-85d0-7e55db83d5dd admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:48.709920 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9e43634d-cb72-49b7-85d0-7e55db83d5dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:48.756082 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:48.770820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43634d-cb72-49b7-85d0-7e55db83d5dd admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:48.774481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea7b3b-5bac-44f2-ac12-78155ff1fa45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:48.775133 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea7b3b-5bac-44f2-ac12-78155ff1fa45 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:48.775430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea7b3b-5bac-44f2-ac12-78155ff1fa45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:48.775695 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea7b3b-5bac-44f2-ac12-78155ff1fa45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:48.786191 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea7b3b-5bac-44f2-ac12-78155ff1fa45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:48.787644 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea7b3b-5bac-44f2-ac12-78155ff1fa45 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:48.798858 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 974/1972] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:39:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:48.900103 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a50ad-173c-4e36-8436-724b52e636eb None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:48.911111 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a50ad-173c-4e36-8436-724b52e636eb None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:48.915288 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a3f97-8c23-4e3f-87e1-83331bb0fa20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:48.915937 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a3f97-8c23-4e3f-87e1-83331bb0fa20 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:48.916228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a3f97-8c23-4e3f-87e1-83331bb0fa20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:48.916511 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a3f97-8c23-4e3f-87e1-83331bb0fa20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:48.976938 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a3f97-8c23-4e3f-87e1-83331bb0fa20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:48.978433 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a3f97-8c23-4e3f-87e1-83331bb0fa20 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:48.987787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 999/1973] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:39:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:55.554918 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5c73b-4cc5-46d2-82f1-5e9fc025f1bd None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:55.555395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5c73b-4cc5-46d2-82f1-5e9fc025f1bd None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:55.555395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5c73b-4cc5-46d2-82f1-5e9fc025f1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:55.575923 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-0cb5c73b-4cc5-46d2-82f1-5e9fc025f1bd None None] MFA Rules not processed for user `ea35144aa9164de3a94173a64650fd50`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:55.577217 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0cb5c73b-4cc5-46d2-82f1-5e9fc025f1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:55.637151 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 975/1974] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:55.759426 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a3f97-8c23-4e3f-87e1-83331bb0fa20 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:55.807801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:55.828358 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a3f97-8c23-4e3f-87e1-83331bb0fa20 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:55.833661 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6932d1a-e3ab-460d-a077-6534d435c2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:55.834568 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6932d1a-e3ab-460d-a077-6534d435c2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:55.834856 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6932d1a-e3ab-460d-a077-6534d435c2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:55.835138 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6932d1a-e3ab-460d-a077-6534d435c2e1 admin admin] PATH_INFO: `/v3/users/f19342827ecc47088ae7920c6b8b890e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:55.836332 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6932d1a-e3ab-460d-a077-6534d435c2e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f19342827ecc47088ae7920c6b8b890e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:55.838400 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6932d1a-e3ab-460d-a077-6534d435c2e1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:55.890523 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c6932d1a-e3ab-460d-a077-6534d435c2e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f19342827ecc47088ae7920c6b8b890e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:55.891208 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c6932d1a-e3ab-460d-a077-6534d435c2e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f19342827ecc47088ae7920c6b8b890e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:55.903946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c6932d1a-e3ab-460d-a077-6534d435c2e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f19342827ecc47088ae7920c6b8b890e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:55.914397 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c6932d1a-e3ab-460d-a077-6534d435c2e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f19342827ecc47088ae7920c6b8b890e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:55.930548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c6932d1a-e3ab-460d-a077-6534d435c2e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f19342827ecc47088ae7920c6b8b890e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:55.939111 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1000/1975] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:39:55 2022] DELETE /identity/v3/users/f19342827ecc47088ae7920c6b8b890e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:55.946296 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f4f37-4a01-49d9-a582-6d1c61e7093d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:55.947043 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f4f37-4a01-49d9-a582-6d1c61e7093d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:55.947571 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f4f37-4a01-49d9-a582-6d1c61e7093d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:55.969966 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-bc3f4f37-4a01-49d9-a582-6d1c61e7093d None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:55.971706 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bc3f4f37-4a01-49d9-a582-6d1c61e7093d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:56.060290 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 976/1976] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:56.070469 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6932d1a-e3ab-460d-a077-6534d435c2e1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:56.071986 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c6932d1a-e3ab-460d-a077-6534d435c2e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:56.135863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6932d1a-e3ab-460d-a077-6534d435c2e1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:56.139917 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e6705-c484-4b85-b249-2494ed55fd84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:56.140592 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6705-c484-4b85-b249-2494ed55fd84 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:56.141034 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6705-c484-4b85-b249-2494ed55fd84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:56.141324 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6705-c484-4b85-b249-2494ed55fd84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:56.152542 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e6705-c484-4b85-b249-2494ed55fd84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:56.154019 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e6705-c484-4b85-b249-2494ed55fd84 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:56.167378 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1001/1977] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:56.472123 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f4f37-4a01-49d9-a582-6d1c61e7093d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:56.473905 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bc3f4f37-4a01-49d9-a582-6d1c61e7093d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:56.493066 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f4f37-4a01-49d9-a582-6d1c61e7093d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:56.499711 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156551ec-d9ea-4761-8ef7-a7d7f933787f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:56.501660 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156551ec-d9ea-4761-8ef7-a7d7f933787f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:56.502440 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156551ec-d9ea-4761-8ef7-a7d7f933787f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:56.502440 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156551ec-d9ea-4761-8ef7-a7d7f933787f admin admin] PATH_INFO: `/v3/projects/337053c36e4748b79f94e5e3096e9fa3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:56.503818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156551ec-d9ea-4761-8ef7-a7d7f933787f admin admin] RBAC: Authorizing `identity:delete_project(project_id=337053c36e4748b79f94e5e3096e9fa3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:56.505747 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156551ec-d9ea-4761-8ef7-a7d7f933787f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:56.559860 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-156551ec-d9ea-4761-8ef7-a7d7f933787f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '337053c36e4748b79f94e5e3096e9fa3', 'request_id': 'req-156551ec-d9ea-4761-8ef7-a7d7f933787f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:56.570101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-156551ec-d9ea-4761-8ef7-a7d7f933787f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '337053c36e4748b79f94e5e3096e9fa3', 'request_id': 'req-156551ec-d9ea-4761-8ef7-a7d7f933787f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:56.578115 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-156551ec-d9ea-4761-8ef7-a7d7f933787f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '337053c36e4748b79f94e5e3096e9fa3', 'request_id': 'req-156551ec-d9ea-4761-8ef7-a7d7f933787f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:56.592545 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-156551ec-d9ea-4761-8ef7-a7d7f933787f admin admin] The token cache is being invalidate because project 337053c36e4748b79f94e5e3096e9fa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:39:56.592881 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-156551ec-d9ea-4761-8ef7-a7d7f933787f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:56.593586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-156551ec-d9ea-4761-8ef7-a7d7f933787f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:56.595209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 977/1978] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:39:56 2022] DELETE /identity/v3/projects/337053c36e4748b79f94e5e3096e9fa3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:56.599694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e6705-c484-4b85-b249-2494ed55fd84 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:56.611022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e6705-c484-4b85-b249-2494ed55fd84 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:56.688427 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03f3a2-a983-4e7a-b7db-825804ec5845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:56.690034 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03f3a2-a983-4e7a-b7db-825804ec5845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:56.690356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03f3a2-a983-4e7a-b7db-825804ec5845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:56.690639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03f3a2-a983-4e7a-b7db-825804ec5845 admin admin] PATH_INFO: `/v3/users/d79a902ee809499494cc865d27a0106c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:56.691889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03f3a2-a983-4e7a-b7db-825804ec5845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d79a902ee809499494cc865d27a0106c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:56.694705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03f3a2-a983-4e7a-b7db-825804ec5845 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:56.700779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:56.757880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2c03f3a2-a983-4e7a-b7db-825804ec5845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd79a902ee809499494cc865d27a0106c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:56.758670 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2c03f3a2-a983-4e7a-b7db-825804ec5845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd79a902ee809499494cc865d27a0106c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:56.766333 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2c03f3a2-a983-4e7a-b7db-825804ec5845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd79a902ee809499494cc865d27a0106c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:56.776011 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2c03f3a2-a983-4e7a-b7db-825804ec5845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd79a902ee809499494cc865d27a0106c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:56.792950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2c03f3a2-a983-4e7a-b7db-825804ec5845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd79a902ee809499494cc865d27a0106c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:56.801064 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1002/1979] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:39:56 2022] DELETE /identity/v3/users/d79a902ee809499494cc865d27a0106c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:57.283403 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156551ec-d9ea-4761-8ef7-a7d7f933787f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:57.283403 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-156551ec-d9ea-4761-8ef7-a7d7f933787f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:57.323599 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156551ec-d9ea-4761-8ef7-a7d7f933787f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:57.337277 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:57.393984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb91f64-fa22-447d-a43b-517f5bf84fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:57.394959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb91f64-fa22-447d-a43b-517f5bf84fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:57.395241 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb91f64-fa22-447d-a43b-517f5bf84fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:57.395994 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb91f64-fa22-447d-a43b-517f5bf84fef admin admin] PATH_INFO: `/v3/projects/03c0577b0eeb4e6e8bb5ff73759ecba9` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:57.396947 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb91f64-fa22-447d-a43b-517f5bf84fef admin admin] RBAC: Authorizing `identity:delete_project(project_id=03c0577b0eeb4e6e8bb5ff73759ecba9)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:57.398972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb91f64-fa22-447d-a43b-517f5bf84fef admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:57.484088 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-edb91f64-fa22-447d-a43b-517f5bf84fef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03c0577b0eeb4e6e8bb5ff73759ecba9', 'request_id': 'req-edb91f64-fa22-447d-a43b-517f5bf84fef'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:57.492533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-edb91f64-fa22-447d-a43b-517f5bf84fef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03c0577b0eeb4e6e8bb5ff73759ecba9', 'request_id': 'req-edb91f64-fa22-447d-a43b-517f5bf84fef'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:57.499332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-edb91f64-fa22-447d-a43b-517f5bf84fef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03c0577b0eeb4e6e8bb5ff73759ecba9', 'request_id': 'req-edb91f64-fa22-447d-a43b-517f5bf84fef'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:57.516487 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-edb91f64-fa22-447d-a43b-517f5bf84fef admin admin] The token cache is being invalidate because project 03c0577b0eeb4e6e8bb5ff73759ecba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:39:57.517448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-edb91f64-fa22-447d-a43b-517f5bf84fef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:57.518285 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-edb91f64-fa22-447d-a43b-517f5bf84fef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:57.523872 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 978/1980] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:39:57 2022] DELETE /identity/v3/projects/03c0577b0eeb4e6e8bb5ff73759ecba9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:57.525532 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0363b66-c96e-4ebd-a1cd-09c461eec471 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:57.525827 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0363b66-c96e-4ebd-a1cd-09c461eec471 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:57.526173 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0363b66-c96e-4ebd-a1cd-09c461eec471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:57.545618 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b0363b66-c96e-4ebd-a1cd-09c461eec471 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:57.546910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b0363b66-c96e-4ebd-a1cd-09c461eec471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:57.619031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1003/1981] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:57.628099 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8ebf2-a7c5-4aa6-9e84-8f59bbff6511 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:57.629018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8ebf2-a7c5-4aa6-9e84-8f59bbff6511 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:57.629522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8ebf2-a7c5-4aa6-9e84-8f59bbff6511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:57.652479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9ec8ebf2-a7c5-4aa6-9e84-8f59bbff6511 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:57.653866 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9ec8ebf2-a7c5-4aa6-9e84-8f59bbff6511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:57.671452 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 979/1982] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:57.677490 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0363b66-c96e-4ebd-a1cd-09c461eec471 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:57.690880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0363b66-c96e-4ebd-a1cd-09c461eec471 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:57.696743 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc6d22-5cbe-4ce6-8376-45fc0023600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:57.697647 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc6d22-5cbe-4ce6-8376-45fc0023600c admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:57.698185 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc6d22-5cbe-4ce6-8376-45fc0023600c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:57.698714 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc6d22-5cbe-4ce6-8376-45fc0023600c admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:57.699789 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc6d22-5cbe-4ce6-8376-45fc0023600c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:57.700308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc6d22-5cbe-4ce6-8376-45fc0023600c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:57.702204 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc6d22-5cbe-4ce6-8376-45fc0023600c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:57.718767 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1004/1983] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:39:57.723669 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8ebf2-a7c5-4aa6-9e84-8f59bbff6511 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:57.733451 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8ebf2-a7c5-4aa6-9e84-8f59bbff6511 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:57.742180 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42947b-fc46-4cdc-b271-8ed3b8c8d174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:57.743426 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42947b-fc46-4cdc-b271-8ed3b8c8d174 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:57.743576 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42947b-fc46-4cdc-b271-8ed3b8c8d174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:57.744121 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42947b-fc46-4cdc-b271-8ed3b8c8d174 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:57.745076 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42947b-fc46-4cdc-b271-8ed3b8c8d174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:57.747685 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42947b-fc46-4cdc-b271-8ed3b8c8d174 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:57.783998 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 980/1984] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:39:57 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:57.788975 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc6d22-5cbe-4ce6-8376-45fc0023600c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:57.801895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc6d22-5cbe-4ce6-8376-45fc0023600c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:57.874471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d9247-e940-41fa-95dc-3db698fdd424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:57.875452 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d9247-e940-41fa-95dc-3db698fdd424 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:57.875738 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d9247-e940-41fa-95dc-3db698fdd424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:57.876538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d9247-e940-41fa-95dc-3db698fdd424 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:57.877408 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d9247-e940-41fa-95dc-3db698fdd424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:57.879604 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d9247-e940-41fa-95dc-3db698fdd424 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:57.903710 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1005/1985] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:39:57 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:57.908274 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42947b-fc46-4cdc-b271-8ed3b8c8d174 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:57.927845 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42947b-fc46-4cdc-b271-8ed3b8c8d174 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:57.932839 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0accff-ff15-4e03-976a-0c780f0095f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:57.933543 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0accff-ff15-4e03-976a-0c780f0095f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:57.933842 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0accff-ff15-4e03-976a-0c780f0095f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:57.934133 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0accff-ff15-4e03-976a-0c780f0095f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:57.935045 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0accff-ff15-4e03-976a-0c780f0095f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:57.936659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0accff-ff15-4e03-976a-0c780f0095f5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:57.951591 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 981/1986] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:39:57.955706 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d9247-e940-41fa-95dc-3db698fdd424 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:57.961478 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:57.968930 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d9247-e940-41fa-95dc-3db698fdd424 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:57.977796 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e099cc-4592-474e-9760-286a8640c04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:57.978821 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e099cc-4592-474e-9760-286a8640c04d admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:57.979117 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e099cc-4592-474e-9760-286a8640c04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:57.979634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e099cc-4592-474e-9760-286a8640c04d admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:57.980473 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e099cc-4592-474e-9760-286a8640c04d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:57.982109 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e099cc-4592-474e-9760-286a8640c04d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:57.997555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1006/1987] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:39:57.998976 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0accff-ff15-4e03-976a-0c780f0095f5 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:58.010152 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0accff-ff15-4e03-976a-0c780f0095f5 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:58.020678 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420b329-3e36-4d3d-ba64-fbe3200b3870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:58.021765 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420b329-3e36-4d3d-ba64-fbe3200b3870 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:58.022189 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420b329-3e36-4d3d-ba64-fbe3200b3870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:58.022583 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420b329-3e36-4d3d-ba64-fbe3200b3870 admin admin] PATH_INFO: `/v3/projects/4fe8f04bf9ed4e65b535240dcfcf1825/users/b6fa9d9d16654634abf6f50600c3d3fd/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:58.045205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420b329-3e36-4d3d-ba64-fbe3200b3870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe8f04bf9ed4e65b535240dcfcf1825, user_id=b6fa9d9d16654634abf6f50600c3d3fd, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:58.049762 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420b329-3e36-4d3d-ba64-fbe3200b3870 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:58.077535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 982/1988] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:39:57 2022] PUT /identity/v3/projects/4fe8f04bf9ed4e65b535240dcfcf1825/users/b6fa9d9d16654634abf6f50600c3d3fd/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:58.090386 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c20219-3b1e-4c62-b27c-5189baf198eb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:58.090682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c20219-3b1e-4c62-b27c-5189baf198eb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:58.090966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c20219-3b1e-4c62-b27c-5189baf198eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:58.126991 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f9c20219-3b1e-4c62-b27c-5189baf198eb None None] MFA Rules not processed for user `b6fa9d9d16654634abf6f50600c3d3fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:58.128162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f9c20219-3b1e-4c62-b27c-5189baf198eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:58.226551 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1007/1989] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:58.241252 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420b329-3e36-4d3d-ba64-fbe3200b3870 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:58.243188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1420b329-3e36-4d3d-ba64-fbe3200b3870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:58.318117 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:58.355530 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420b329-3e36-4d3d-ba64-fbe3200b3870 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:58.365616 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3aa80-8781-415c-b56d-ab6647b17566 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:58.366028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3aa80-8781-415c-b56d-ab6647b17566 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:58.367091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3aa80-8781-415c-b56d-ab6647b17566 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:58.367280 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3aa80-8781-415c-b56d-ab6647b17566 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:58.395642 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3aa80-8781-415c-b56d-ab6647b17566 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:58.395642 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3aa80-8781-415c-b56d-ab6647b17566 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:58.410494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 983/1990] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:39:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:39:58.446299 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c20219-3b1e-4c62-b27c-5189baf198eb None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:58.544333 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c20219-3b1e-4c62-b27c-5189baf198eb None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:58.549905 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da71401-4f93-4fd4-a5f1-06a6e1023d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:58.551153 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da71401-4f93-4fd4-a5f1-06a6e1023d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:58.551567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da71401-4f93-4fd4-a5f1-06a6e1023d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:58.551959 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da71401-4f93-4fd4-a5f1-06a6e1023d92 admin admin] PATH_INFO: `/v3/users/b6fa9d9d16654634abf6f50600c3d3fd` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:58.554118 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da71401-4f93-4fd4-a5f1-06a6e1023d92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6fa9d9d16654634abf6f50600c3d3fd)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:58.555548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da71401-4f93-4fd4-a5f1-06a6e1023d92 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:58.625472 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0da71401-4f93-4fd4-a5f1-06a6e1023d92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6fa9d9d16654634abf6f50600c3d3fd'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:58.626648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0da71401-4f93-4fd4-a5f1-06a6e1023d92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6fa9d9d16654634abf6f50600c3d3fd'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:58.633810 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0da71401-4f93-4fd4-a5f1-06a6e1023d92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6fa9d9d16654634abf6f50600c3d3fd'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:58.642888 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0da71401-4f93-4fd4-a5f1-06a6e1023d92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6fa9d9d16654634abf6f50600c3d3fd'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:58.661150 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0da71401-4f93-4fd4-a5f1-06a6e1023d92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6fa9d9d16654634abf6f50600c3d3fd'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:58.663640 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:58.670239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1008/1991] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:39:58 2022] DELETE /identity/v3/users/b6fa9d9d16654634abf6f50600c3d3fd => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:58.674172 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548d817-6ddc-4230-9ae7-f0a1d58d167f None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:58.674769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548d817-6ddc-4230-9ae7-f0a1d58d167f None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:58.675489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548d817-6ddc-4230-9ae7-f0a1d58d167f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:58.694518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d548d817-6ddc-4230-9ae7-f0a1d58d167f None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:58.696308 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d548d817-6ddc-4230-9ae7-f0a1d58d167f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:58.769564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 984/1992] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:58.780097 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da71401-4f93-4fd4-a5f1-06a6e1023d92 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:58.781588 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0da71401-4f93-4fd4-a5f1-06a6e1023d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:58.851266 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da71401-4f93-4fd4-a5f1-06a6e1023d92 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:58.855139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d2b0a-0174-40e3-9ae9-a068a8d7c4d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:58.855904 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d2b0a-0174-40e3-9ae9-a068a8d7c4d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:58.857315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d2b0a-0174-40e3-9ae9-a068a8d7c4d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:58.857596 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d2b0a-0174-40e3-9ae9-a068a8d7c4d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:58.868730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d2b0a-0174-40e3-9ae9-a068a8d7c4d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:58.870267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d2b0a-0174-40e3-9ae9-a068a8d7c4d5 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:58.881240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1009/1993] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:39:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:39:59.298417 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548d817-6ddc-4230-9ae7-f0a1d58d167f None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:59.302698 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d548d817-6ddc-4230-9ae7-f0a1d58d167f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:59.316203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548d817-6ddc-4230-9ae7-f0a1d58d167f None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:59.321771 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668f82c-90cf-4b57-b012-e8a753542412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:59.322702 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668f82c-90cf-4b57-b012-e8a753542412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:59.323040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668f82c-90cf-4b57-b012-e8a753542412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:59.323419 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668f82c-90cf-4b57-b012-e8a753542412 admin admin] PATH_INFO: `/v3/projects/4fe8f04bf9ed4e65b535240dcfcf1825` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:59.324712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668f82c-90cf-4b57-b012-e8a753542412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fe8f04bf9ed4e65b535240dcfcf1825)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:59.327410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668f82c-90cf-4b57-b012-e8a753542412 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:59.412317 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9668f82c-90cf-4b57-b012-e8a753542412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fe8f04bf9ed4e65b535240dcfcf1825', 'request_id': 'req-9668f82c-90cf-4b57-b012-e8a753542412'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:59.421813 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9668f82c-90cf-4b57-b012-e8a753542412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fe8f04bf9ed4e65b535240dcfcf1825', 'request_id': 'req-9668f82c-90cf-4b57-b012-e8a753542412'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:59.437803 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9668f82c-90cf-4b57-b012-e8a753542412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fe8f04bf9ed4e65b535240dcfcf1825', 'request_id': 'req-9668f82c-90cf-4b57-b012-e8a753542412'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:59.455738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9668f82c-90cf-4b57-b012-e8a753542412 admin admin] The token cache is being invalidate because project 4fe8f04bf9ed4e65b535240dcfcf1825 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:39:59.456198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9668f82c-90cf-4b57-b012-e8a753542412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:59.457101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9668f82c-90cf-4b57-b012-e8a753542412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:59.458797 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 985/1994] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:39:59 2022] DELETE /identity/v3/projects/4fe8f04bf9ed4e65b535240dcfcf1825 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:39:59.464009 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47955db-a2bf-4ae6-86d4-0ff713a6c224 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:59.464296 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47955db-a2bf-4ae6-86d4-0ff713a6c224 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:59.464841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47955db-a2bf-4ae6-86d4-0ff713a6c224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:59.493447 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b47955db-a2bf-4ae6-86d4-0ff713a6c224 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:59.495086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b47955db-a2bf-4ae6-86d4-0ff713a6c224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:59.563878 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668f82c-90cf-4b57-b012-e8a753542412 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:59.565549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9668f82c-90cf-4b57-b012-e8a753542412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:59.627489 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1010/1995] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:39:59.631555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c40324-2b7d-4d3d-afde-c77773314508 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:59.632031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c40324-2b7d-4d3d-afde-c77773314508 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:59.632480 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c40324-2b7d-4d3d-afde-c77773314508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:59.672614 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-15c40324-2b7d-4d3d-afde-c77773314508 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:59.674251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668f82c-90cf-4b57-b012-e8a753542412 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:59.674883 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-15c40324-2b7d-4d3d-afde-c77773314508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:59.679846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da54e2-507c-4161-9297-9f5a9ba10be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:59.680873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da54e2-507c-4161-9297-9f5a9ba10be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:59.681264 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da54e2-507c-4161-9297-9f5a9ba10be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:59.681708 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da54e2-507c-4161-9297-9f5a9ba10be2 admin admin] PATH_INFO: `/v3/users/d89bace71c0a47fe8c011cb736a7f2e8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:59.683582 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da54e2-507c-4161-9297-9f5a9ba10be2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d89bace71c0a47fe8c011cb736a7f2e8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:59.686925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da54e2-507c-4161-9297-9f5a9ba10be2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:59.693376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1011/1996] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:39:59.694344 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:59.697852 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c40324-2b7d-4d3d-afde-c77773314508 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:59.715207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c40324-2b7d-4d3d-afde-c77773314508 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:59.725260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e49e1-c612-42db-97ff-fc6c196f8a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:59.725950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e49e1-c612-42db-97ff-fc6c196f8a6f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:59.726459 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e49e1-c612-42db-97ff-fc6c196f8a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:59.726743 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e49e1-c612-42db-97ff-fc6c196f8a6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:59.727508 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e49e1-c612-42db-97ff-fc6c196f8a6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:39:59.727845 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e49e1-c612-42db-97ff-fc6c196f8a6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:59.730131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e49e1-c612-42db-97ff-fc6c196f8a6f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:59.748779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1012/1997] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:39:59.754794 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e49e1-c612-42db-97ff-fc6c196f8a6f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:59.770185 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e49e1-c612-42db-97ff-fc6c196f8a6f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:59.777229 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f43554-ce4d-4100-9b7f-fb26f2152929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:39:59.778095 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f43554-ce4d-4100-9b7f-fb26f2152929 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:59.778410 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f43554-ce4d-4100-9b7f-fb26f2152929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:59.779236 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f43554-ce4d-4100-9b7f-fb26f2152929 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:59.779418 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f43554-ce4d-4100-9b7f-fb26f2152929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:39:59.781568 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f43554-ce4d-4100-9b7f-fb26f2152929 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:39:59.801113 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-78da54e2-507c-4161-9297-9f5a9ba10be2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd89bace71c0a47fe8c011cb736a7f2e8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:59.814973 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-78da54e2-507c-4161-9297-9f5a9ba10be2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd89bace71c0a47fe8c011cb736a7f2e8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:59.829788 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1013/1998] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:39:59 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:39:59.833619 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f43554-ce4d-4100-9b7f-fb26f2152929 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:39:59.839611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-78da54e2-507c-4161-9297-9f5a9ba10be2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd89bace71c0a47fe8c011cb736a7f2e8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:59.854114 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-78da54e2-507c-4161-9297-9f5a9ba10be2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd89bace71c0a47fe8c011cb736a7f2e8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:59.855112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-78da54e2-507c-4161-9297-9f5a9ba10be2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd89bace71c0a47fe8c011cb736a7f2e8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:39:59.869705 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 986/1999] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:39:59 2022] DELETE /identity/v3/users/d89bace71c0a47fe8c011cb736a7f2e8 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:39:59.874040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c1d2f-b89e-497c-8944-5ad30216c014 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:39:59.874597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c1d2f-b89e-497c-8944-5ad30216c014 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:39:59.874947 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c1d2f-b89e-497c-8944-5ad30216c014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:39:59.906583 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-375c1d2f-b89e-497c-8944-5ad30216c014 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:39:59.912640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-375c1d2f-b89e-497c-8944-5ad30216c014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:39:59.972627 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f43554-ce4d-4100-9b7f-fb26f2152929 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:39:59.986454 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:00.081474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 987/2000] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:00.147026 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c1d2f-b89e-497c-8944-5ad30216c014 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:00.147159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068c941-1630-4852-a982-2ebbdb3db2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:00.147810 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068c941-1630-4852-a982-2ebbdb3db2ed admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:00.148103 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068c941-1630-4852-a982-2ebbdb3db2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:00.148387 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068c941-1630-4852-a982-2ebbdb3db2ed admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:00.149204 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068c941-1630-4852-a982-2ebbdb3db2ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:00.151261 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068c941-1630-4852-a982-2ebbdb3db2ed admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:00.154130 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-375c1d2f-b89e-497c-8944-5ad30216c014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:00.215303 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1014/2001] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:39:59 2022] POST /identity/v3/users => generated 286 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:40:00.216291 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068c941-1630-4852-a982-2ebbdb3db2ed admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:00.225990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f068c941-1630-4852-a982-2ebbdb3db2ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:00.241865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068c941-1630-4852-a982-2ebbdb3db2ed admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:00.248381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097da4ab-7f0e-4229-beff-d93a58f0c6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:00.249079 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097da4ab-7f0e-4229-beff-d93a58f0c6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:00.249467 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097da4ab-7f0e-4229-beff-d93a58f0c6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:00.249822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097da4ab-7f0e-4229-beff-d93a58f0c6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:00.251669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097da4ab-7f0e-4229-beff-d93a58f0c6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:00.253865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097da4ab-7f0e-4229-beff-d93a58f0c6a2 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:00.270019 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1015/2002] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:00.275336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097da4ab-7f0e-4229-beff-d93a58f0c6a2 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:00.287130 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c1d2f-b89e-497c-8944-5ad30216c014 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:00.299298 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd87f54-901c-47b2-b87b-8eccdbb4d4d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:00.301218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd87f54-901c-47b2-b87b-8eccdbb4d4d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:00.301669 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd87f54-901c-47b2-b87b-8eccdbb4d4d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:00.303308 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd87f54-901c-47b2-b87b-8eccdbb4d4d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:00.305727 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097da4ab-7f0e-4229-beff-d93a58f0c6a2 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:00.316825 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3616ec-730a-4f7d-9f97-d452331b672e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:00.318679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3616ec-730a-4f7d-9f97-d452331b672e admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:00.320936 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3616ec-730a-4f7d-9f97-d452331b672e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:00.321421 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3616ec-730a-4f7d-9f97-d452331b672e admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:00.322706 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3616ec-730a-4f7d-9f97-d452331b672e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:00.327353 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd87f54-901c-47b2-b87b-8eccdbb4d4d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:00.328809 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd87f54-901c-47b2-b87b-8eccdbb4d4d3 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:00.330319 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3616ec-730a-4f7d-9f97-d452331b672e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:00.364970 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 988/2003] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:40:00.365280 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1016/2004] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:00.371171 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd87f54-901c-47b2-b87b-8eccdbb4d4d3 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:00.401594 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd87f54-901c-47b2-b87b-8eccdbb4d4d3 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:00.424489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc94be-29ca-4636-8134-0a4a7bbbe7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:00.425972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc94be-29ca-4636-8134-0a4a7bbbe7de admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:00.426471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc94be-29ca-4636-8134-0a4a7bbbe7de admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:00.427079 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc94be-29ca-4636-8134-0a4a7bbbe7de admin admin] PATH_INFO: `/v3/projects/87e42a9db84343199f7c5b1ad02a9c33/users/29f5de15c725415ca15d1e09e848d65d/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:00.457984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc94be-29ca-4636-8134-0a4a7bbbe7de admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e42a9db84343199f7c5b1ad02a9c33, user_id=29f5de15c725415ca15d1e09e848d65d, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:00.461275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc94be-29ca-4636-8134-0a4a7bbbe7de admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:00.493399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 989/2005] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:40:00 2022] PUT /identity/v3/projects/87e42a9db84343199f7c5b1ad02a9c33/users/29f5de15c725415ca15d1e09e848d65d/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:00.498018 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1c07a-ed84-4ff7-b9b4-f61ee173493f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:00.498018 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1c07a-ed84-4ff7-b9b4-f61ee173493f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:00.498018 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1c07a-ed84-4ff7-b9b4-f61ee173493f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:00.529190 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b1e1c07a-ed84-4ff7-b9b4-f61ee173493f None None] MFA Rules not processed for user `29f5de15c725415ca15d1e09e848d65d`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:00.530507 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b1e1c07a-ed84-4ff7-b9b4-f61ee173493f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:00.653399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1017/2006] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:00.659096 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc94be-29ca-4636-8134-0a4a7bbbe7de admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:00.666624 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:00.749469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc94be-29ca-4636-8134-0a4a7bbbe7de admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:00.756218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a2bff-41ee-467d-8dce-4533f0faf10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:00.757042 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a2bff-41ee-467d-8dce-4533f0faf10f admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:00.757514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a2bff-41ee-467d-8dce-4533f0faf10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:00.758227 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a2bff-41ee-467d-8dce-4533f0faf10f admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:00.758991 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a2bff-41ee-467d-8dce-4533f0faf10f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:00.761157 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a2bff-41ee-467d-8dce-4533f0faf10f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:00.813671 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 990/2007] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:40:00 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:40:00.822731 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1c07a-ed84-4ff7-b9b4-f61ee173493f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:00.855975 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1c07a-ed84-4ff7-b9b4-f61ee173493f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:00.910724 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a2bff-41ee-467d-8dce-4533f0faf10f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:00.913639 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-539a2bff-41ee-467d-8dce-4533f0faf10f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:00.932254 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a90716-2251-4124-a089-1a4e61f1ebea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:00.932967 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a90716-2251-4124-a089-1a4e61f1ebea admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:00.933638 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a90716-2251-4124-a089-1a4e61f1ebea admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:00.933638 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a90716-2251-4124-a089-1a4e61f1ebea admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:00.934246 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a90716-2251-4124-a089-1a4e61f1ebea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:00.936188 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a90716-2251-4124-a089-1a4e61f1ebea admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:00.947817 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:00.967355 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1018/2008] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:40:00 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:40:00.968298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a90716-2251-4124-a089-1a4e61f1ebea admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:00.979086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a90716-2251-4124-a089-1a4e61f1ebea admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:00.985829 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9dae98-1a9d-46a2-a77e-c9915e51e89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:00.986545 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dae98-1a9d-46a2-a77e-c9915e51e89c admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:00.986831 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dae98-1a9d-46a2-a77e-c9915e51e89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:00.987101 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dae98-1a9d-46a2-a77e-c9915e51e89c admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:00.987929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9dae98-1a9d-46a2-a77e-c9915e51e89c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:00.989545 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9dae98-1a9d-46a2-a77e-c9915e51e89c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:01.002315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1019/2009] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:01.006412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9dae98-1a9d-46a2-a77e-c9915e51e89c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:01.017822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9dae98-1a9d-46a2-a77e-c9915e51e89c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:01.027788 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f4e9d-f8f7-494c-962d-43ac252df390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:01.027980 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f4e9d-f8f7-494c-962d-43ac252df390 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:01.028125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f4e9d-f8f7-494c-962d-43ac252df390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:01.028693 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f4e9d-f8f7-494c-962d-43ac252df390 admin admin] PATH_INFO: `/v3/projects/d473ee72f0c24182b55a92bd537ec6e2/users/bcf4cc24eb434c7ab750142acd2dc692/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:01.033048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a2bff-41ee-467d-8dce-4533f0faf10f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:01.038489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503732c2-0fbe-42ea-ad5d-c76556fdcd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:01.039916 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503732c2-0fbe-42ea-ad5d-c76556fdcd74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:01.040315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503732c2-0fbe-42ea-ad5d-c76556fdcd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:01.040691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503732c2-0fbe-42ea-ad5d-c76556fdcd74 admin admin] PATH_INFO: `/v3/users/abca8080d1754da9911faf411b3230fb` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:01.042276 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503732c2-0fbe-42ea-ad5d-c76556fdcd74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abca8080d1754da9911faf411b3230fb)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:01.044520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503732c2-0fbe-42ea-ad5d-c76556fdcd74 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:01.047532 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f4e9d-f8f7-494c-962d-43ac252df390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d473ee72f0c24182b55a92bd537ec6e2, user_id=bcf4cc24eb434c7ab750142acd2dc692, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:01.050822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f4e9d-f8f7-494c-962d-43ac252df390 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:01.070169 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1020/2010] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:40:01 2022] PUT /identity/v3/projects/d473ee72f0c24182b55a92bd537ec6e2/users/bcf4cc24eb434c7ab750142acd2dc692/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:40:01.076685 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f4e9d-f8f7-494c-962d-43ac252df390 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:01.103932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-503732c2-0fbe-42ea-ad5d-c76556fdcd74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abca8080d1754da9911faf411b3230fb'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:01.112265 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-503732c2-0fbe-42ea-ad5d-c76556fdcd74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abca8080d1754da9911faf411b3230fb'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:01.127252 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-503732c2-0fbe-42ea-ad5d-c76556fdcd74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abca8080d1754da9911faf411b3230fb'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:01.135753 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-503732c2-0fbe-42ea-ad5d-c76556fdcd74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abca8080d1754da9911faf411b3230fb'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:01.137201 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-503732c2-0fbe-42ea-ad5d-c76556fdcd74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abca8080d1754da9911faf411b3230fb'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:01.148992 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 991/2011] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:40:00 2022] DELETE /identity/v3/users/abca8080d1754da9911faf411b3230fb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:01.171034 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f4e9d-f8f7-494c-962d-43ac252df390 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:01.251220 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503732c2-0fbe-42ea-ad5d-c76556fdcd74 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:01.253601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-503732c2-0fbe-42ea-ad5d-c76556fdcd74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:01.259294 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bccb6a-462e-459e-88c7-bcc5e9872c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:01.260399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bccb6a-462e-459e-88c7-bcc5e9872c34 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:01.260772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bccb6a-462e-459e-88c7-bcc5e9872c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:01.261207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bccb6a-462e-459e-88c7-bcc5e9872c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:01.262136 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bccb6a-462e-459e-88c7-bcc5e9872c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:01.278565 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bccb6a-462e-459e-88c7-bcc5e9872c34 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:01.298235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503732c2-0fbe-42ea-ad5d-c76556fdcd74 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:01.308611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1021/2012] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:40:01.313068 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bccb6a-462e-459e-88c7-bcc5e9872c34 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:01.315117 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec654d-a133-466c-bee2-40addc39bbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:01.315972 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d7bccb6a-462e-459e-88c7-bcc5e9872c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:01.317259 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec654d-a133-466c-bee2-40addc39bbac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:01.318146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec654d-a133-466c-bee2-40addc39bbac admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:01.318653 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec654d-a133-466c-bee2-40addc39bbac admin admin] PATH_INFO: `/v3/projects/fbf06ae40adb43329947dc4ef6e3a57f` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:01.320707 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec654d-a133-466c-bee2-40addc39bbac admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbf06ae40adb43329947dc4ef6e3a57f)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:01.326155 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec654d-a133-466c-bee2-40addc39bbac admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:01.332151 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:01.371227 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bccb6a-462e-459e-88c7-bcc5e9872c34 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:01.378720 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55c7dc-e0be-4e89-aa12-727dd345e886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:01.379877 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55c7dc-e0be-4e89-aa12-727dd345e886 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:01.380167 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55c7dc-e0be-4e89-aa12-727dd345e886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:01.380441 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55c7dc-e0be-4e89-aa12-727dd345e886 admin admin] PATH_INFO: `/v3/projects/d473ee72f0c24182b55a92bd537ec6e2/users/bcf4cc24eb434c7ab750142acd2dc692/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:01.383959 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55c7dc-e0be-4e89-aa12-727dd345e886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d473ee72f0c24182b55a92bd537ec6e2, user_id=bcf4cc24eb434c7ab750142acd2dc692, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:01.387022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55c7dc-e0be-4e89-aa12-727dd345e886 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:01.406272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1022/2013] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:40:01 2022] PUT /identity/v3/projects/d473ee72f0c24182b55a92bd537ec6e2/users/bcf4cc24eb434c7ab750142acd2dc692/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:40:01.420436 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55c7dc-e0be-4e89-aa12-727dd345e886 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:01.424153 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5c55c7dc-e0be-4e89-aa12-727dd345e886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:01.439013 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-03ec654d-a133-466c-bee2-40addc39bbac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf06ae40adb43329947dc4ef6e3a57f', 'request_id': 'req-03ec654d-a133-466c-bee2-40addc39bbac'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:01.449133 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-03ec654d-a133-466c-bee2-40addc39bbac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf06ae40adb43329947dc4ef6e3a57f', 'request_id': 'req-03ec654d-a133-466c-bee2-40addc39bbac'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:01.456248 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-03ec654d-a133-466c-bee2-40addc39bbac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf06ae40adb43329947dc4ef6e3a57f', 'request_id': 'req-03ec654d-a133-466c-bee2-40addc39bbac'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:01.475584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-03ec654d-a133-466c-bee2-40addc39bbac admin admin] The token cache is being invalidate because project fbf06ae40adb43329947dc4ef6e3a57f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:40:01.475874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-03ec654d-a133-466c-bee2-40addc39bbac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:01.476557 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-03ec654d-a133-466c-bee2-40addc39bbac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:01.478450 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 992/2014] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:40:01 2022] DELETE /identity/v3/projects/fbf06ae40adb43329947dc4ef6e3a57f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:01.479688 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e8782-0c8f-409f-8821-ae58e44cdc04 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:01.479979 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e8782-0c8f-409f-8821-ae58e44cdc04 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:01.480256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e8782-0c8f-409f-8821-ae58e44cdc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:01.510694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e88e8782-0c8f-409f-8821-ae58e44cdc04 None None] MFA Rules not processed for user `bcf4cc24eb434c7ab750142acd2dc692`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:01.510960 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:01.512297 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e88e8782-0c8f-409f-8821-ae58e44cdc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:01.528440 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55c7dc-e0be-4e89-aa12-727dd345e886 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:01.600008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2fcc9-0b75-44fc-9e20-658bc71d1336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:01.601178 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2fcc9-0b75-44fc-9e20-658bc71d1336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:01.601632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2fcc9-0b75-44fc-9e20-658bc71d1336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:01.601911 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2fcc9-0b75-44fc-9e20-658bc71d1336 admin admin] PATH_INFO: `/v3/projects/bf59c1987dee428bb706f058c9c93a09` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:01.602605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 993/2015] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:01.603928 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfad82e-6483-4a1d-b130-7c99fe74aa25 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:01.604220 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfad82e-6483-4a1d-b130-7c99fe74aa25 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:01.604498 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfad82e-6483-4a1d-b130-7c99fe74aa25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:01.607455 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2fcc9-0b75-44fc-9e20-658bc71d1336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf59c1987dee428bb706f058c9c93a09)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:01.609715 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2fcc9-0b75-44fc-9e20-658bc71d1336 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:01.627187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3bfad82e-6483-4a1d-b130-7c99fe74aa25 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:01.628835 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3bfad82e-6483-4a1d-b130-7c99fe74aa25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:01.637732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 994/2016] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:01.638921 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfad82e-6483-4a1d-b130-7c99fe74aa25 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:01.642629 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3bfad82e-6483-4a1d-b130-7c99fe74aa25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:01.672495 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-27e2fcc9-0b75-44fc-9e20-658bc71d1336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf59c1987dee428bb706f058c9c93a09', 'request_id': 'req-27e2fcc9-0b75-44fc-9e20-658bc71d1336'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:01.681766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-27e2fcc9-0b75-44fc-9e20-658bc71d1336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf59c1987dee428bb706f058c9c93a09', 'request_id': 'req-27e2fcc9-0b75-44fc-9e20-658bc71d1336'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:01.691535 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-27e2fcc9-0b75-44fc-9e20-658bc71d1336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf59c1987dee428bb706f058c9c93a09', 'request_id': 'req-27e2fcc9-0b75-44fc-9e20-658bc71d1336'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:01.708307 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-27e2fcc9-0b75-44fc-9e20-658bc71d1336 admin admin] The token cache is being invalidate because project bf59c1987dee428bb706f058c9c93a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:40:01.708714 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-27e2fcc9-0b75-44fc-9e20-658bc71d1336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:01.709489 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-27e2fcc9-0b75-44fc-9e20-658bc71d1336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:01.709924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfad82e-6483-4a1d-b130-7c99fe74aa25 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:01.714187 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1023/2017] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:40:01 2022] DELETE /identity/v3/projects/bf59c1987dee428bb706f058c9c93a09 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:01.714187 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2afc0a-9d9d-4c0d-9691-98e6a85e301c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:01.714187 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2afc0a-9d9d-4c0d-9691-98e6a85e301c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:01.714187 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2afc0a-9d9d-4c0d-9691-98e6a85e301c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:01.732795 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-1c2afc0a-9d9d-4c0d-9691-98e6a85e301c None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:01.734176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1c2afc0a-9d9d-4c0d-9691-98e6a85e301c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:01.748613 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:01.785777 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e893d70-c09a-4a12-a7ec-6bf213180184 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:01.786481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e893d70-c09a-4a12-a7ec-6bf213180184 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:01.786481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e893d70-c09a-4a12-a7ec-6bf213180184 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:01.786705 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e893d70-c09a-4a12-a7ec-6bf213180184 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:01.788533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9e893d70-c09a-4a12-a7ec-6bf213180184 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:01.805121 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1024/2018] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:01.806495 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee6549-4844-462d-96e0-4a3b09b57fb9 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:01.806787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee6549-4844-462d-96e0-4a3b09b57fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:01.807069 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee6549-4844-462d-96e0-4a3b09b57fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:01.828420 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ddee6549-4844-462d-96e0-4a3b09b57fb9 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:01.830357 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ddee6549-4844-462d-96e0-4a3b09b57fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:01.844158 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1025/2019] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:01.845973 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee6549-4844-462d-96e0-4a3b09b57fb9 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:01.860423 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee6549-4844-462d-96e0-4a3b09b57fb9 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:01.866657 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ff4ad-721f-4a29-8b1c-44c0c6ea772b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:01.867740 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ff4ad-721f-4a29-8b1c-44c0c6ea772b admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:01.868009 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e893d70-c09a-4a12-a7ec-6bf213180184 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:01.868369 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ff4ad-721f-4a29-8b1c-44c0c6ea772b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:01.868825 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ff4ad-721f-4a29-8b1c-44c0c6ea772b admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:01.869918 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e893d70-c09a-4a12-a7ec-6bf213180184 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:01.870026 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ff4ad-721f-4a29-8b1c-44c0c6ea772b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:40:01.871003 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ff4ad-721f-4a29-8b1c-44c0c6ea772b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:01.872979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ff4ad-721f-4a29-8b1c-44c0c6ea772b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:01.883623 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 995/2020] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:01.884989 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ab130-eb27-4aed-9eca-448e2359a5f8 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:01.885410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ab130-eb27-4aed-9eca-448e2359a5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:01.885696 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ab130-eb27-4aed-9eca-448e2359a5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:01.891210 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1026/2021] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:40:01.897844 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ff4ad-721f-4a29-8b1c-44c0c6ea772b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:01.909745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-cc3ab130-eb27-4aed-9eca-448e2359a5f8 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:01.911210 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cc3ab130-eb27-4aed-9eca-448e2359a5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:01.912407 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ff4ad-721f-4a29-8b1c-44c0c6ea772b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:01.918427 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45978614-387c-4e91-b01a-fe31ba6c0fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:01.919306 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45978614-387c-4e91-b01a-fe31ba6c0fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:01.919859 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45978614-387c-4e91-b01a-fe31ba6c0fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:01.920300 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 996/2022] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:01.920580 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45978614-387c-4e91-b01a-fe31ba6c0fd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:01.921381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45978614-387c-4e91-b01a-fe31ba6c0fd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:01.925420 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45978614-387c-4e91-b01a-fe31ba6c0fd3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:01.925609 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ab130-eb27-4aed-9eca-448e2359a5f8 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:01.930970 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:01.938218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ab130-eb27-4aed-9eca-448e2359a5f8 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:01.950046 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c28af-6df6-4362-80c5-277c95224e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:01.951052 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c28af-6df6-4362-80c5-277c95224e31 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:01.951451 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c28af-6df6-4362-80c5-277c95224e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:01.952252 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c28af-6df6-4362-80c5-277c95224e31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:01.955019 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c28af-6df6-4362-80c5-277c95224e31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:40:01.955420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c28af-6df6-4362-80c5-277c95224e31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:01.959045 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c28af-6df6-4362-80c5-277c95224e31 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:01.974728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1027/2023] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:40:01 2022] POST /identity/v3/projects => generated 369 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:40:01.978994 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 997/2024] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:40:01.982413 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45978614-387c-4e91-b01a-fe31ba6c0fd3 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:01.983738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c28af-6df6-4362-80c5-277c95224e31 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:01.995232 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c28af-6df6-4362-80c5-277c95224e31 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:02.065559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b318c0-8171-4b9d-a2ec-f71207e1c6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:02.066569 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b318c0-8171-4b9d-a2ec-f71207e1c6dd admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:02.066913 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b318c0-8171-4b9d-a2ec-f71207e1c6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:02.067195 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b318c0-8171-4b9d-a2ec-f71207e1c6dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:02.067898 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b318c0-8171-4b9d-a2ec-f71207e1c6dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:02.069837 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b318c0-8171-4b9d-a2ec-f71207e1c6dd admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:02.112034 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45978614-387c-4e91-b01a-fe31ba6c0fd3 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:02.115268 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 998/2025] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:40:01 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:40:02.116923 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b318c0-8171-4b9d-a2ec-f71207e1c6dd admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:02.194543 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:02.212015 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bff381-02ea-4cf9-a4b8-3075d9d5e289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:02.212729 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bff381-02ea-4cf9-a4b8-3075d9d5e289 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:02.213021 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bff381-02ea-4cf9-a4b8-3075d9d5e289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:02.213305 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bff381-02ea-4cf9-a4b8-3075d9d5e289 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:02.214003 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bff381-02ea-4cf9-a4b8-3075d9d5e289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:02.216013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bff381-02ea-4cf9-a4b8-3075d9d5e289 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:02.217043 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b318c0-8171-4b9d-a2ec-f71207e1c6dd admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:02.223340 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1569c-ae48-48f4-ad54-d6d8bcb3eebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:02.224096 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1569c-ae48-48f4-ad54-d6d8bcb3eebc admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:02.225824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1569c-ae48-48f4-ad54-d6d8bcb3eebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:02.226220 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1569c-ae48-48f4-ad54-d6d8bcb3eebc admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:02.227417 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1569c-ae48-48f4-ad54-d6d8bcb3eebc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:02.230194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1569c-ae48-48f4-ad54-d6d8bcb3eebc admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:02.243340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1028/2026] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:40:01 2022] POST /identity/v3/users => generated 285 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:40:02.245623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bff381-02ea-4cf9-a4b8-3075d9d5e289 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:02.257013 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 999/2027] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:40:02 2022] POST /identity/v3/users => generated 286 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:40:02.260695 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bff381-02ea-4cf9-a4b8-3075d9d5e289 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:02.261290 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1569c-ae48-48f4-ad54-d6d8bcb3eebc admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:02.266187 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ca822-0c1d-4457-954f-89f0b5e7059d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:02.267700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ca822-0c1d-4457-954f-89f0b5e7059d admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:02.268139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ca822-0c1d-4457-954f-89f0b5e7059d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:02.268576 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ca822-0c1d-4457-954f-89f0b5e7059d admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:02.269596 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ca822-0c1d-4457-954f-89f0b5e7059d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:02.271419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ca822-0c1d-4457-954f-89f0b5e7059d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:02.274522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1569c-ae48-48f4-ad54-d6d8bcb3eebc admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:02.279590 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b0453-82da-4590-b6d3-4b544544056d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:02.280263 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b0453-82da-4590-b6d3-4b544544056d admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:02.280605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b0453-82da-4590-b6d3-4b544544056d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:02.280871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b0453-82da-4590-b6d3-4b544544056d admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:02.281615 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b0453-82da-4590-b6d3-4b544544056d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:02.284679 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b0453-82da-4590-b6d3-4b544544056d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:02.285950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1029/2028] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:40:02.293142 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ca822-0c1d-4457-954f-89f0b5e7059d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:02.306325 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1000/2029] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:40:02.306498 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ca822-0c1d-4457-954f-89f0b5e7059d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:02.308693 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b0453-82da-4590-b6d3-4b544544056d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:02.312665 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ab7c7-cc1b-409a-a2d2-f7f42cf2f788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:02.313507 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ab7c7-cc1b-409a-a2d2-f7f42cf2f788 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:02.314144 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ab7c7-cc1b-409a-a2d2-f7f42cf2f788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:02.314563 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ab7c7-cc1b-409a-a2d2-f7f42cf2f788 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:02.315583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ab7c7-cc1b-409a-a2d2-f7f42cf2f788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:02.317598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ab7c7-cc1b-409a-a2d2-f7f42cf2f788 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:02.320349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b0453-82da-4590-b6d3-4b544544056d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:02.326610 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0b950-6c9f-497f-921d-8c0af4c2181d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:02.327368 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0b950-6c9f-497f-921d-8c0af4c2181d admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:02.327721 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0b950-6c9f-497f-921d-8c0af4c2181d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:02.328078 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0b950-6c9f-497f-921d-8c0af4c2181d admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:02.329500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0b950-6c9f-497f-921d-8c0af4c2181d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:02.331703 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0b950-6c9f-497f-921d-8c0af4c2181d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:02.335475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1030/2030] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:40:02.336493 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ab7c7-cc1b-409a-a2d2-f7f42cf2f788 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:02.347704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ab7c7-cc1b-409a-a2d2-f7f42cf2f788 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:02.350507 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1001/2031] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:40:02.354391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0b950-6c9f-497f-921d-8c0af4c2181d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:02.357521 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b4196-4b1f-4014-b96b-9e504d1534e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:02.358694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b4196-4b1f-4014-b96b-9e504d1534e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:02.358985 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b4196-4b1f-4014-b96b-9e504d1534e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:02.359264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b4196-4b1f-4014-b96b-9e504d1534e7 admin admin] PATH_INFO: `/v3/projects/22c099e43b334fd89a02610fa11195db/users/95b25aab99cf4c2ea7d983c831a1c260/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:02.365447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0b950-6c9f-497f-921d-8c0af4c2181d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:02.371199 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b6625-115e-42f7-bd36-32bd63a7b401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:02.372086 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b6625-115e-42f7-bd36-32bd63a7b401 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:02.372370 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b6625-115e-42f7-bd36-32bd63a7b401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:02.372769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b6625-115e-42f7-bd36-32bd63a7b401 admin admin] PATH_INFO: `/v3/projects/a0afdab4753c46329712f854eaa29f9e/users/29564cac6d2f461182e8eca43a26629d/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:02.376914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b4196-4b1f-4014-b96b-9e504d1534e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c099e43b334fd89a02610fa11195db, user_id=95b25aab99cf4c2ea7d983c831a1c260, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:02.379739 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b4196-4b1f-4014-b96b-9e504d1534e7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:02.392817 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b6625-115e-42f7-bd36-32bd63a7b401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0afdab4753c46329712f854eaa29f9e, user_id=29564cac6d2f461182e8eca43a26629d, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:02.395816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1031/2032] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:40:02 2022] PUT /identity/v3/projects/22c099e43b334fd89a02610fa11195db/users/95b25aab99cf4c2ea7d983c831a1c260/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:02.397185 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b6625-115e-42f7-bd36-32bd63a7b401 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:02.406841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c3fd9-c4e0-4bad-9e0e-0b65e6b45b62 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:02.407214 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c3fd9-c4e0-4bad-9e0e-0b65e6b45b62 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:02.407683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c3fd9-c4e0-4bad-9e0e-0b65e6b45b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:02.417333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1002/2033] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:40:02 2022] PUT /identity/v3/projects/a0afdab4753c46329712f854eaa29f9e/users/29564cac6d2f461182e8eca43a26629d/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:40:02.427993 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204b66f-08fc-45cf-86d6-acf1cef933ed None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:02.428289 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204b66f-08fc-45cf-86d6-acf1cef933ed None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:02.428576 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204b66f-08fc-45cf-86d6-acf1cef933ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:02.444576 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c53c3fd9-c4e0-4bad-9e0e-0b65e6b45b62 None None] MFA Rules not processed for user `95b25aab99cf4c2ea7d983c831a1c260`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:02.445922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c53c3fd9-c4e0-4bad-9e0e-0b65e6b45b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:02.458355 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b204b66f-08fc-45cf-86d6-acf1cef933ed None None] MFA Rules not processed for user `29564cac6d2f461182e8eca43a26629d`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:02.459621 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b204b66f-08fc-45cf-86d6-acf1cef933ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:02.474162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:02.522476 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1032/2034] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:40:02.528856 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1003/2035] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:40:02.534278 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c3fd9-c4e0-4bad-9e0e-0b65e6b45b62 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:02.535817 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c53c3fd9-c4e0-4bad-9e0e-0b65e6b45b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:02.539299 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204b66f-08fc-45cf-86d6-acf1cef933ed None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:02.540911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b204b66f-08fc-45cf-86d6-acf1cef933ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:02.600465 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c3fd9-c4e0-4bad-9e0e-0b65e6b45b62 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:02.604325 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9e8b2-8f8e-4569-b5e0-5ed4d2c7ae1e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14c582c1127142f8a4ebf64bb7b34516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:02.604979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9e8b2-8f8e-4569-b5e0-5ed4d2c7ae1e service glance] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:02.605279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9e8b2-8f8e-4569-b5e0-5ed4d2c7ae1e service glance] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:02.605556 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9e8b2-8f8e-4569-b5e0-5ed4d2c7ae1e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:02.614206 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9e8b2-8f8e-4569-b5e0-5ed4d2c7ae1e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:02.615642 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9e8b2-8f8e-4569-b5e0-5ed4d2c7ae1e service glance] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:02.621221 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204b66f-08fc-45cf-86d6-acf1cef933ed None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:02.624660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1033/2036] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:02.629311 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98118863-9a60-44b3-9e7c-3969f471e7aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:02.629966 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98118863-9a60-44b3-9e7c-3969f471e7aa service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:02.630289 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98118863-9a60-44b3-9e7c-3969f471e7aa service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:02.630568 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98118863-9a60-44b3-9e7c-3969f471e7aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:02.639057 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98118863-9a60-44b3-9e7c-3969f471e7aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:02.640653 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98118863-9a60-44b3-9e7c-3969f471e7aa service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:02.650527 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1004/2037] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:40:04.593164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9e8b2-8f8e-4569-b5e0-5ed4d2c7ae1e service glance] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:04.595459 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-22b9e8b2-8f8e-4569-b5e0-5ed4d2c7ae1e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:04.662508 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9e8b2-8f8e-4569-b5e0-5ed4d2c7ae1e service glance] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:04.667409 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b2e47-11b9-46cc-a65f-a9fc7d18eaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:04.668274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b2e47-11b9-46cc-a65f-a9fc7d18eaed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:04.668560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b2e47-11b9-46cc-a65f-a9fc7d18eaed admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:04.668841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b2e47-11b9-46cc-a65f-a9fc7d18eaed admin admin] PATH_INFO: `/v3/users/29f5de15c725415ca15d1e09e848d65d` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:04.670035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b2e47-11b9-46cc-a65f-a9fc7d18eaed admin admin] RBAC: Authorizing `identity:delete_user(user_id=29f5de15c725415ca15d1e09e848d65d)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:04.672012 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b2e47-11b9-46cc-a65f-a9fc7d18eaed admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:04.720753 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-226b2e47-11b9-46cc-a65f-a9fc7d18eaed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29f5de15c725415ca15d1e09e848d65d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:04.721583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-226b2e47-11b9-46cc-a65f-a9fc7d18eaed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29f5de15c725415ca15d1e09e848d65d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:04.731618 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-226b2e47-11b9-46cc-a65f-a9fc7d18eaed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29f5de15c725415ca15d1e09e848d65d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:04.739461 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-226b2e47-11b9-46cc-a65f-a9fc7d18eaed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29f5de15c725415ca15d1e09e848d65d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:04.747210 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:04.754516 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-226b2e47-11b9-46cc-a65f-a9fc7d18eaed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29f5de15c725415ca15d1e09e848d65d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:04.762659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1034/2038] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:40:04 2022] DELETE /identity/v3/users/29f5de15c725415ca15d1e09e848d65d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:04.767005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835bd03-840d-4332-82f4-d04b75a90722 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:04.767514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835bd03-840d-4332-82f4-d04b75a90722 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:04.767831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835bd03-840d-4332-82f4-d04b75a90722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:04.774874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:04.789856 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-6835bd03-840d-4332-82f4-d04b75a90722 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:04.791813 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6835bd03-840d-4332-82f4-d04b75a90722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:04.854415 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1005/2039] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:40:04.864147 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b2e47-11b9-46cc-a65f-a9fc7d18eaed admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:04.866741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-226b2e47-11b9-46cc-a65f-a9fc7d18eaed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:04.929700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b2e47-11b9-46cc-a65f-a9fc7d18eaed admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:04.933931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a876c39-5783-45c8-bb0f-5dd1324f639f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:04.934618 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a876c39-5783-45c8-bb0f-5dd1324f639f service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:04.934959 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a876c39-5783-45c8-bb0f-5dd1324f639f service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:04.935234 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a876c39-5783-45c8-bb0f-5dd1324f639f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:04.947688 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a876c39-5783-45c8-bb0f-5dd1324f639f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:04.949260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a876c39-5783-45c8-bb0f-5dd1324f639f service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:04.963255 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1035/2040] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:05.307927 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835bd03-840d-4332-82f4-d04b75a90722 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:05.309523 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6835bd03-840d-4332-82f4-d04b75a90722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:05.334786 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835bd03-840d-4332-82f4-d04b75a90722 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:05.342400 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b2830-f6d0-4009-826e-30fcf532416d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:05.343654 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b2830-f6d0-4009-826e-30fcf532416d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:05.344076 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b2830-f6d0-4009-826e-30fcf532416d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:05.345051 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b2830-f6d0-4009-826e-30fcf532416d admin admin] PATH_INFO: `/v3/projects/87e42a9db84343199f7c5b1ad02a9c33` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:05.346637 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b2830-f6d0-4009-826e-30fcf532416d admin admin] RBAC: Authorizing `identity:delete_project(project_id=87e42a9db84343199f7c5b1ad02a9c33)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:05.349145 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b2830-f6d0-4009-826e-30fcf532416d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:05.440693 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-048b2830-f6d0-4009-826e-30fcf532416d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87e42a9db84343199f7c5b1ad02a9c33', 'request_id': 'req-048b2830-f6d0-4009-826e-30fcf532416d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:05.451493 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-048b2830-f6d0-4009-826e-30fcf532416d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87e42a9db84343199f7c5b1ad02a9c33', 'request_id': 'req-048b2830-f6d0-4009-826e-30fcf532416d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:05.460187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-048b2830-f6d0-4009-826e-30fcf532416d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87e42a9db84343199f7c5b1ad02a9c33', 'request_id': 'req-048b2830-f6d0-4009-826e-30fcf532416d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:05.483850 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-048b2830-f6d0-4009-826e-30fcf532416d admin admin] The token cache is being invalidate because project 87e42a9db84343199f7c5b1ad02a9c33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:40:05.484046 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-048b2830-f6d0-4009-826e-30fcf532416d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:05.490514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-048b2830-f6d0-4009-826e-30fcf532416d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:05.492529 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1006/2041] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:40:05 2022] DELETE /identity/v3/projects/87e42a9db84343199f7c5b1ad02a9c33 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:05.497854 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a876c39-5783-45c8-bb0f-5dd1324f639f service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:05.510571 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a876c39-5783-45c8-bb0f-5dd1324f639f service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:05.605660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc204b-44e6-4e2f-a4cb-830759fe1dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:05.606715 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc204b-44e6-4e2f-a4cb-830759fe1dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:05.607003 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc204b-44e6-4e2f-a4cb-830759fe1dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:05.607352 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc204b-44e6-4e2f-a4cb-830759fe1dfc admin admin] PATH_INFO: `/v3/users/bcf4cc24eb434c7ab750142acd2dc692` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:05.608941 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc204b-44e6-4e2f-a4cb-830759fe1dfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcf4cc24eb434c7ab750142acd2dc692)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:05.612096 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc204b-44e6-4e2f-a4cb-830759fe1dfc admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:05.687970 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-41dc204b-44e6-4e2f-a4cb-830759fe1dfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcf4cc24eb434c7ab750142acd2dc692'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:05.689546 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-41dc204b-44e6-4e2f-a4cb-830759fe1dfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcf4cc24eb434c7ab750142acd2dc692'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:05.698703 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-41dc204b-44e6-4e2f-a4cb-830759fe1dfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcf4cc24eb434c7ab750142acd2dc692'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:05.707809 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-41dc204b-44e6-4e2f-a4cb-830759fe1dfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcf4cc24eb434c7ab750142acd2dc692'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:05.728551 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-41dc204b-44e6-4e2f-a4cb-830759fe1dfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcf4cc24eb434c7ab750142acd2dc692'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:05.737531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1036/2042] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:40:05 2022] DELETE /identity/v3/users/bcf4cc24eb434c7ab750142acd2dc692 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:06.088242 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b2830-f6d0-4009-826e-30fcf532416d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:06.089823 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-048b2830-f6d0-4009-826e-30fcf532416d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:06.114541 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b2830-f6d0-4009-826e-30fcf532416d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:06.178796 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cd450-6b3d-4e65-a407-e1784bb2ea60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:06.179579 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cd450-6b3d-4e65-a407-e1784bb2ea60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:06.179858 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cd450-6b3d-4e65-a407-e1784bb2ea60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:06.180139 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cd450-6b3d-4e65-a407-e1784bb2ea60 admin admin] PATH_INFO: `/v3/projects/d473ee72f0c24182b55a92bd537ec6e2` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:06.181323 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41cd450-6b3d-4e65-a407-e1784bb2ea60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d473ee72f0c24182b55a92bd537ec6e2)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:06.183277 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41cd450-6b3d-4e65-a407-e1784bb2ea60 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:06.222564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:06.239475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b41cd450-6b3d-4e65-a407-e1784bb2ea60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd473ee72f0c24182b55a92bd537ec6e2', 'request_id': 'req-b41cd450-6b3d-4e65-a407-e1784bb2ea60'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:06.245893 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b41cd450-6b3d-4e65-a407-e1784bb2ea60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd473ee72f0c24182b55a92bd537ec6e2', 'request_id': 'req-b41cd450-6b3d-4e65-a407-e1784bb2ea60'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:06.253025 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b41cd450-6b3d-4e65-a407-e1784bb2ea60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd473ee72f0c24182b55a92bd537ec6e2', 'request_id': 'req-b41cd450-6b3d-4e65-a407-e1784bb2ea60'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:06.266965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b41cd450-6b3d-4e65-a407-e1784bb2ea60 admin admin] The token cache is being invalidate because project d473ee72f0c24182b55a92bd537ec6e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:40:06.267258 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b41cd450-6b3d-4e65-a407-e1784bb2ea60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:06.267964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b41cd450-6b3d-4e65-a407-e1784bb2ea60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:06.269527 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1007/2043] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:40:06 2022] DELETE /identity/v3/projects/d473ee72f0c24182b55a92bd537ec6e2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:06.274648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e18b71-7bea-452f-9290-8488da47b687 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:06.274946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e18b71-7bea-452f-9290-8488da47b687 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:06.275230 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e18b71-7bea-452f-9290-8488da47b687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:06.298971 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-24e18b71-7bea-452f-9290-8488da47b687 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:06.300330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-24e18b71-7bea-452f-9290-8488da47b687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:06.305973 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:06.368051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1037/2044] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:06.379116 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ff901-be31-4f2f-8426-471754d7355c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:06.379407 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ff901-be31-4f2f-8426-471754d7355c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:06.379689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ff901-be31-4f2f-8426-471754d7355c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:06.405241 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f79ff901-be31-4f2f-8426-471754d7355c None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:06.406507 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f79ff901-be31-4f2f-8426-471754d7355c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:06.422098 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1008/2045] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:06.424906 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e18b71-7bea-452f-9290-8488da47b687 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:06.437614 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e18b71-7bea-452f-9290-8488da47b687 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:06.443488 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1762363-fa75-4d3e-b5db-03c92a78e440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:06.444163 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1762363-fa75-4d3e-b5db-03c92a78e440 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:06.444450 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1762363-fa75-4d3e-b5db-03c92a78e440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:06.444730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1762363-fa75-4d3e-b5db-03c92a78e440 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:06.445469 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1762363-fa75-4d3e-b5db-03c92a78e440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:40:06.445780 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1762363-fa75-4d3e-b5db-03c92a78e440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:06.447442 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1762363-fa75-4d3e-b5db-03c92a78e440 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:06.461821 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1038/2046] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:40:06.466611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ff901-be31-4f2f-8426-471754d7355c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:06.476086 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ff901-be31-4f2f-8426-471754d7355c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:06.480822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5a1bf-8070-48c7-8a49-32ba56b22c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:06.481487 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5a1bf-8070-48c7-8a49-32ba56b22c19 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:06.481772 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5a1bf-8070-48c7-8a49-32ba56b22c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:06.482053 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5a1bf-8070-48c7-8a49-32ba56b22c19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:06.482790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5a1bf-8070-48c7-8a49-32ba56b22c19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:06.484757 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5a1bf-8070-48c7-8a49-32ba56b22c19 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:06.527790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1009/2047] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:40:06 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:40:06.528902 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1762363-fa75-4d3e-b5db-03c92a78e440 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:06.542823 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5a1bf-8070-48c7-8a49-32ba56b22c19 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:06.542988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1762363-fa75-4d3e-b5db-03c92a78e440 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:06.544590 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-44a5a1bf-8070-48c7-8a49-32ba56b22c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:06.614048 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefdf8f-a327-44b4-97c1-c77a470765a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:06.614751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefdf8f-a327-44b4-97c1-c77a470765a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:06.615045 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefdf8f-a327-44b4-97c1-c77a470765a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:06.615332 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefdf8f-a327-44b4-97c1-c77a470765a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:06.616030 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefdf8f-a327-44b4-97c1-c77a470765a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:06.617986 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefdf8f-a327-44b4-97c1-c77a470765a6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:06.619911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5a1bf-8070-48c7-8a49-32ba56b22c19 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:06.624642 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28912f26-f541-4337-82b8-6d0f081d029c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:06.625519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28912f26-f541-4337-82b8-6d0f081d029c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:06.626442 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28912f26-f541-4337-82b8-6d0f081d029c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:06.626804 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28912f26-f541-4337-82b8-6d0f081d029c admin admin] PATH_INFO: `/v3/users/29564cac6d2f461182e8eca43a26629d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:06.628615 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28912f26-f541-4337-82b8-6d0f081d029c admin admin] RBAC: Authorizing `identity:delete_user(user_id=29564cac6d2f461182e8eca43a26629d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:06.630233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28912f26-f541-4337-82b8-6d0f081d029c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:06.654258 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1039/2048] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:40:06 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:40:06.655424 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefdf8f-a327-44b4-97c1-c77a470765a6 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:06.667714 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefdf8f-a327-44b4-97c1-c77a470765a6 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:06.673026 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fc01d-f300-4740-88a5-ea7d85da02cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:06.674024 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fc01d-f300-4740-88a5-ea7d85da02cf admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:06.674351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fc01d-f300-4740-88a5-ea7d85da02cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:06.674632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1fc01d-f300-4740-88a5-ea7d85da02cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:06.675368 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fc01d-f300-4740-88a5-ea7d85da02cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:06.677048 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1fc01d-f300-4740-88a5-ea7d85da02cf admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:06.692708 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1040/2049] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:06.694023 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fc01d-f300-4740-88a5-ea7d85da02cf admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:06.702524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-28912f26-f541-4337-82b8-6d0f081d029c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29564cac6d2f461182e8eca43a26629d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:06.705219 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1fc01d-f300-4740-88a5-ea7d85da02cf admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:06.709999 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57262b2-ae9d-4a18-8e41-3107d1ecd6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:06.710708 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57262b2-ae9d-4a18-8e41-3107d1ecd6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:06.710997 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57262b2-ae9d-4a18-8e41-3107d1ecd6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:06.711280 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57262b2-ae9d-4a18-8e41-3107d1ecd6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:06.711581 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-28912f26-f541-4337-82b8-6d0f081d029c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29564cac6d2f461182e8eca43a26629d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:06.712013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57262b2-ae9d-4a18-8e41-3107d1ecd6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:06.713650 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57262b2-ae9d-4a18-8e41-3107d1ecd6b1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:06.725398 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1041/2050] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:06.730415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57262b2-ae9d-4a18-8e41-3107d1ecd6b1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:06.731102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-28912f26-f541-4337-82b8-6d0f081d029c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29564cac6d2f461182e8eca43a26629d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:06.743924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57262b2-ae9d-4a18-8e41-3107d1ecd6b1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:06.747720 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-28912f26-f541-4337-82b8-6d0f081d029c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29564cac6d2f461182e8eca43a26629d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:06.749939 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-28912f26-f541-4337-82b8-6d0f081d029c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29564cac6d2f461182e8eca43a26629d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:06.751817 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6cf73c-a8c4-410a-9b5f-8b1b4ef45724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:06.753588 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cf73c-a8c4-410a-9b5f-8b1b4ef45724 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:06.754674 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cf73c-a8c4-410a-9b5f-8b1b4ef45724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:06.755277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6cf73c-a8c4-410a-9b5f-8b1b4ef45724 admin admin] PATH_INFO: `/v3/projects/d67d41badf684af098fe3d5497b23e8e/users/211fe17d284345c49a80cd0df86aef5e/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:06.761329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1010/2051] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:40:06 2022] DELETE /identity/v3/users/29564cac6d2f461182e8eca43a26629d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:06.770452 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c39db9-5637-4ca5-94f0-fadae2f15974 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:06.771673 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c39db9-5637-4ca5-94f0-fadae2f15974 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:06.772104 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c39db9-5637-4ca5-94f0-fadae2f15974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:06.778275 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cf73c-a8c4-410a-9b5f-8b1b4ef45724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d67d41badf684af098fe3d5497b23e8e, user_id=211fe17d284345c49a80cd0df86aef5e, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:06.782716 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6cf73c-a8c4-410a-9b5f-8b1b4ef45724 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:06.793133 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-61c39db9-5637-4ca5-94f0-fadae2f15974 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:06.794644 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-61c39db9-5637-4ca5-94f0-fadae2f15974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:06.799404 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1042/2052] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:40:06 2022] PUT /identity/v3/projects/d67d41badf684af098fe3d5497b23e8e/users/211fe17d284345c49a80cd0df86aef5e/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:06.802755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:06.814508 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b0f19-dd4f-429e-8b2f-601ffc255407 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:06.814840 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b0f19-dd4f-429e-8b2f-601ffc255407 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:06.815118 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b0f19-dd4f-429e-8b2f-601ffc255407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:06.852788 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-386b0f19-dd4f-429e-8b2f-601ffc255407 None None] MFA Rules not processed for user `211fe17d284345c49a80cd0df86aef5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:06.854007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-386b0f19-dd4f-429e-8b2f-601ffc255407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:06.886160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1011/2053] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:06.895779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:06.898205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c39db9-5637-4ca5-94f0-fadae2f15974 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:06.899936 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-61c39db9-5637-4ca5-94f0-fadae2f15974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:06.952498 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1043/2054] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:40:06.958248 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b0f19-dd4f-429e-8b2f-601ffc255407 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:06.960179 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-386b0f19-dd4f-429e-8b2f-601ffc255407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:06.975074 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b0f19-dd4f-429e-8b2f-601ffc255407 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:06.982217 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c39db9-5637-4ca5-94f0-fadae2f15974 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:06.987378 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897b343-ca70-44d8-97f5-097c3f04622a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:06.987889 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20fefe-3582-4989-b28b-f2909a7b9723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:06.988448 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897b343-ca70-44d8-97f5-097c3f04622a admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:06.988580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20fefe-3582-4989-b28b-f2909a7b9723 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:06.988740 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897b343-ca70-44d8-97f5-097c3f04622a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:06.988846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20fefe-3582-4989-b28b-f2909a7b9723 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:06.989024 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897b343-ca70-44d8-97f5-097c3f04622a admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:06.989144 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20fefe-3582-4989-b28b-f2909a7b9723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:06.989788 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897b343-ca70-44d8-97f5-097c3f04622a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:06.991938 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897b343-ca70-44d8-97f5-097c3f04622a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:06.999636 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20fefe-3582-4989-b28b-f2909a7b9723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:07.001936 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20fefe-3582-4989-b28b-f2909a7b9723 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:07.014669 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1012/2055] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:40:07.029885 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1044/2056] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:40:06 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:40:07.031191 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20fefe-3582-4989-b28b-f2909a7b9723 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:07.044797 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20fefe-3582-4989-b28b-f2909a7b9723 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:07.113147 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a2118-d5c3-4479-a3fd-9eae30f4b984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:07.113996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a2118-d5c3-4479-a3fd-9eae30f4b984 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:07.114413 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a2118-d5c3-4479-a3fd-9eae30f4b984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:07.114767 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a2118-d5c3-4479-a3fd-9eae30f4b984 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:07.115688 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a2118-d5c3-4479-a3fd-9eae30f4b984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:07.119361 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a2118-d5c3-4479-a3fd-9eae30f4b984 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:07.146966 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1013/2057] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:40:07 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:40:07.151631 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897b343-ca70-44d8-97f5-097c3f04622a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:07.165238 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897b343-ca70-44d8-97f5-097c3f04622a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:07.172231 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecf2a8-632c-4e9c-b553-26f4a1ffd5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:07.173604 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecf2a8-632c-4e9c-b553-26f4a1ffd5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:07.173901 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecf2a8-632c-4e9c-b553-26f4a1ffd5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:07.174206 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecf2a8-632c-4e9c-b553-26f4a1ffd5a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:07.174944 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecf2a8-632c-4e9c-b553-26f4a1ffd5a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:07.176579 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecf2a8-632c-4e9c-b553-26f4a1ffd5a4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:07.202271 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1045/2058] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:07.204379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a2118-d5c3-4479-a3fd-9eae30f4b984 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:07.215026 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a2118-d5c3-4479-a3fd-9eae30f4b984 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:07.220038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dea3c0-5040-4e49-9a53-7634bf56358b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:07.220748 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dea3c0-5040-4e49-9a53-7634bf56358b admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:07.221040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dea3c0-5040-4e49-9a53-7634bf56358b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:07.221320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dea3c0-5040-4e49-9a53-7634bf56358b admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:07.222057 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dea3c0-5040-4e49-9a53-7634bf56358b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:07.224050 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dea3c0-5040-4e49-9a53-7634bf56358b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:07.236880 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1014/2059] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:07.242457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecf2a8-632c-4e9c-b553-26f4a1ffd5a4 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:07.256469 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecf2a8-632c-4e9c-b553-26f4a1ffd5a4 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:07.261153 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b8ac7-e328-47d2-97d2-f77d3798fe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:07.262393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b8ac7-e328-47d2-97d2-f77d3798fe54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:07.262538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b8ac7-e328-47d2-97d2-f77d3798fe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:07.262733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b8ac7-e328-47d2-97d2-f77d3798fe54 admin admin] PATH_INFO: `/v3/projects/39ad2ba7ae6f4455916446cfeb34894a/users/2a1e817b08754280ba4ed5939543149e/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:07.277873 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b8ac7-e328-47d2-97d2-f77d3798fe54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ad2ba7ae6f4455916446cfeb34894a, user_id=2a1e817b08754280ba4ed5939543149e, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:07.280588 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69b8ac7-e328-47d2-97d2-f77d3798fe54 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:07.296044 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1046/2060] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:40:07 2022] PUT /identity/v3/projects/39ad2ba7ae6f4455916446cfeb34894a/users/2a1e817b08754280ba4ed5939543149e/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:07.310736 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded40948-56cf-49ad-81f9-75a0e42abe87 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:07.311033 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded40948-56cf-49ad-81f9-75a0e42abe87 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:07.311351 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded40948-56cf-49ad-81f9-75a0e42abe87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:07.339055 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b8ac7-e328-47d2-97d2-f77d3798fe54 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:07.340833 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e69b8ac7-e328-47d2-97d2-f77d3798fe54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:07.350901 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ded40948-56cf-49ad-81f9-75a0e42abe87 None None] MFA Rules not processed for user `2a1e817b08754280ba4ed5939543149e`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:07.352561 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ded40948-56cf-49ad-81f9-75a0e42abe87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:07.391998 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:07.435778 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b8ac7-e328-47d2-97d2-f77d3798fe54 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:07.441299 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332decf-298d-4cb8-82aa-b057b646ee9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:07.442195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332decf-298d-4cb8-82aa-b057b646ee9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:07.442480 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332decf-298d-4cb8-82aa-b057b646ee9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:07.442759 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332decf-298d-4cb8-82aa-b057b646ee9d admin admin] PATH_INFO: `/v3/projects/a0afdab4753c46329712f854eaa29f9e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:07.443962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332decf-298d-4cb8-82aa-b057b646ee9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0afdab4753c46329712f854eaa29f9e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:07.445868 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332decf-298d-4cb8-82aa-b057b646ee9d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:07.455964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1015/2061] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:07.470017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded40948-56cf-49ad-81f9-75a0e42abe87 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:07.487496 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded40948-56cf-49ad-81f9-75a0e42abe87 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:07.495835 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb07ae8-8545-417a-b3c2-5b15b4d56387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:07.496840 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb07ae8-8545-417a-b3c2-5b15b4d56387 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:07.497128 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb07ae8-8545-417a-b3c2-5b15b4d56387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:07.497462 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb07ae8-8545-417a-b3c2-5b15b4d56387 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:07.498222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb07ae8-8545-417a-b3c2-5b15b4d56387 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:07.500241 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb07ae8-8545-417a-b3c2-5b15b4d56387 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:07.515977 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6332decf-298d-4cb8-82aa-b057b646ee9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0afdab4753c46329712f854eaa29f9e', 'request_id': 'req-6332decf-298d-4cb8-82aa-b057b646ee9d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:07.523179 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6332decf-298d-4cb8-82aa-b057b646ee9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0afdab4753c46329712f854eaa29f9e', 'request_id': 'req-6332decf-298d-4cb8-82aa-b057b646ee9d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:07.530333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1016/2062] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:40:07 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:40:07.535396 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6332decf-298d-4cb8-82aa-b057b646ee9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0afdab4753c46329712f854eaa29f9e', 'request_id': 'req-6332decf-298d-4cb8-82aa-b057b646ee9d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:07.536354 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb07ae8-8545-417a-b3c2-5b15b4d56387 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:07.548291 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6332decf-298d-4cb8-82aa-b057b646ee9d admin admin] The token cache is being invalidate because project a0afdab4753c46329712f854eaa29f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:40:07.548578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6332decf-298d-4cb8-82aa-b057b646ee9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:07.549237 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6332decf-298d-4cb8-82aa-b057b646ee9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:07.550835 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1047/2063] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:40:07 2022] DELETE /identity/v3/projects/a0afdab4753c46329712f854eaa29f9e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:07.556375 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e576b-1e79-4ab2-b711-b8187696ac63 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:07.557083 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e576b-1e79-4ab2-b711-b8187696ac63 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:07.557372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e576b-1e79-4ab2-b711-b8187696ac63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:07.565935 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:07.579784 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a94e576b-1e79-4ab2-b711-b8187696ac63 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:07.581076 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a94e576b-1e79-4ab2-b711-b8187696ac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:07.600406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb07ae8-8545-417a-b3c2-5b15b4d56387 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:07.605033 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369a810-63c4-465a-8847-c55d3d918f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:07.605695 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369a810-63c4-465a-8847-c55d3d918f1f admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:07.605977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369a810-63c4-465a-8847-c55d3d918f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:07.606280 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369a810-63c4-465a-8847-c55d3d918f1f admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:07.606965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369a810-63c4-465a-8847-c55d3d918f1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:07.608875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369a810-63c4-465a-8847-c55d3d918f1f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:07.637496 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1017/2064] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:40:07 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:40:07.638879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369a810-63c4-465a-8847-c55d3d918f1f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:07.640569 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d369a810-63c4-465a-8847-c55d3d918f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:07.653634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1048/2065] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:07.654181 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369a810-63c4-465a-8847-c55d3d918f1f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:07.655425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff9023-c3a0-4e1e-8687-5f8017ab7fa8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:07.656105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff9023-c3a0-4e1e-8687-5f8017ab7fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:07.656416 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff9023-c3a0-4e1e-8687-5f8017ab7fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:07.658485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66977c12-2e6e-47da-ba3c-c136dc7d88b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:07.659151 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66977c12-2e6e-47da-ba3c-c136dc7d88b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:07.659461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66977c12-2e6e-47da-ba3c-c136dc7d88b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:07.659743 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66977c12-2e6e-47da-ba3c-c136dc7d88b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:07.660467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66977c12-2e6e-47da-ba3c-c136dc7d88b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:07.662101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66977c12-2e6e-47da-ba3c-c136dc7d88b3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:07.676447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1018/2066] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:40:07.676657 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-95ff9023-c3a0-4e1e-8687-5f8017ab7fa8 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:07.676893 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-95ff9023-c3a0-4e1e-8687-5f8017ab7fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:07.680119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66977c12-2e6e-47da-ba3c-c136dc7d88b3 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:07.690137 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1049/2067] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:07.691483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff9023-c3a0-4e1e-8687-5f8017ab7fa8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:07.691602 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66977c12-2e6e-47da-ba3c-c136dc7d88b3 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:07.696665 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134441e-39a0-4ee5-a5cf-5da535c1f098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:07.697555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134441e-39a0-4ee5-a5cf-5da535c1f098 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:07.697841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134441e-39a0-4ee5-a5cf-5da535c1f098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:07.698150 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134441e-39a0-4ee5-a5cf-5da535c1f098 admin admin] PATH_INFO: `/v3/projects/db316b664db241c191d2f9c5ac903023/users/bc1eeef9894a4a5abcba6e6383c25efd/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:07.700955 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff9023-c3a0-4e1e-8687-5f8017ab7fa8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:07.706539 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef3a56-362d-4aef-acf1-ad6229c508c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:07.707134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef3a56-362d-4aef-acf1-ad6229c508c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:07.707419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef3a56-362d-4aef-acf1-ad6229c508c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:07.707700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef3a56-362d-4aef-acf1-ad6229c508c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:07.708427 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef3a56-362d-4aef-acf1-ad6229c508c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:40:07.708743 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef3a56-362d-4aef-acf1-ad6229c508c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:07.710413 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef3a56-362d-4aef-acf1-ad6229c508c5 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:07.715336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134441e-39a0-4ee5-a5cf-5da535c1f098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db316b664db241c191d2f9c5ac903023, user_id=bc1eeef9894a4a5abcba6e6383c25efd, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:07.718020 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134441e-39a0-4ee5-a5cf-5da535c1f098 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:07.722296 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1050/2068] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 15:40:07.727048 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef3a56-362d-4aef-acf1-ad6229c508c5 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:07.731976 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1019/2069] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:40:07 2022] PUT /identity/v3/projects/db316b664db241c191d2f9c5ac903023/users/bc1eeef9894a4a5abcba6e6383c25efd/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:07.736911 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef3a56-362d-4aef-acf1-ad6229c508c5 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:07.737263 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134441e-39a0-4ee5-a5cf-5da535c1f098 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:07.801825 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d98d9-a14e-4a10-9425-bd9dc00fafe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:07.802551 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d98d9-a14e-4a10-9425-bd9dc00fafe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:07.802839 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d98d9-a14e-4a10-9425-bd9dc00fafe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:07.803117 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d98d9-a14e-4a10-9425-bd9dc00fafe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:07.803759 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:07.803887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d98d9-a14e-4a10-9425-bd9dc00fafe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:07.807577 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d98d9-a14e-4a10-9425-bd9dc00fafe2 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:07.820876 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134441e-39a0-4ee5-a5cf-5da535c1f098 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:07.827192 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867eb2d2-f235-4150-9262-07737f5343f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:07.828042 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867eb2d2-f235-4150-9262-07737f5343f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:07.828384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867eb2d2-f235-4150-9262-07737f5343f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:07.828694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867eb2d2-f235-4150-9262-07737f5343f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:07.830450 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867eb2d2-f235-4150-9262-07737f5343f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:07.832229 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867eb2d2-f235-4150-9262-07737f5343f1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:07.840614 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1051/2070] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:40:07 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:40:07.845648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1020/2071] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:40:07.846042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d98d9-a14e-4a10-9425-bd9dc00fafe2 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:07.849930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867eb2d2-f235-4150-9262-07737f5343f1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:07.870689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867eb2d2-f235-4150-9262-07737f5343f1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:07.941966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d98d9-a14e-4a10-9425-bd9dc00fafe2 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:07.949620 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087baeff-c9c1-4181-8744-f297c5312c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:07.950266 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087baeff-c9c1-4181-8744-f297c5312c57 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:07.950560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087baeff-c9c1-4181-8744-f297c5312c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:07.950837 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087baeff-c9c1-4181-8744-f297c5312c57 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:07.951583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087baeff-c9c1-4181-8744-f297c5312c57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:07.955289 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087baeff-c9c1-4181-8744-f297c5312c57 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:07.975344 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:07.988867 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1052/2072] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:40:07 2022] POST /identity/v3/users => generated 283 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:40:07.989624 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087baeff-c9c1-4181-8744-f297c5312c57 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:08.006220 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e697848-ecc7-40c1-8bdb-82fb846af549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:08.007140 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e697848-ecc7-40c1-8bdb-82fb846af549 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:08.007425 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e697848-ecc7-40c1-8bdb-82fb846af549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:08.007703 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e697848-ecc7-40c1-8bdb-82fb846af549 admin admin] PATH_INFO: `/v3/projects/db316b664db241c191d2f9c5ac903023/users/bc1eeef9894a4a5abcba6e6383c25efd/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:08.010365 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e697848-ecc7-40c1-8bdb-82fb846af549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db316b664db241c191d2f9c5ac903023, user_id=bc1eeef9894a4a5abcba6e6383c25efd, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:08.013245 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e697848-ecc7-40c1-8bdb-82fb846af549 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:08.024067 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087baeff-c9c1-4181-8744-f297c5312c57 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:08.033801 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1021/2073] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:40:07 2022] PUT /identity/v3/projects/db316b664db241c191d2f9c5ac903023/users/bc1eeef9894a4a5abcba6e6383c25efd/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:08.044806 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639c118-2968-468d-a679-2305ab3c8b64 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:08.045088 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639c118-2968-468d-a679-2305ab3c8b64 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:08.045373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639c118-2968-468d-a679-2305ab3c8b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:08.105072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d639c118-2968-468d-a679-2305ab3c8b64 None None] MFA Rules not processed for user `bc1eeef9894a4a5abcba6e6383c25efd`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:08.106525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d639c118-2968-468d-a679-2305ab3c8b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:08.108587 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b36b72-41f5-4d7e-a672-033bb2a965b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:08.109319 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b36b72-41f5-4d7e-a672-033bb2a965b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:08.110673 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b36b72-41f5-4d7e-a672-033bb2a965b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:08.110673 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b36b72-41f5-4d7e-a672-033bb2a965b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:08.112094 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b36b72-41f5-4d7e-a672-033bb2a965b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:08.113802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b36b72-41f5-4d7e-a672-033bb2a965b8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:08.128177 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1053/2074] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:08.131946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b36b72-41f5-4d7e-a672-033bb2a965b8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:08.143006 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b36b72-41f5-4d7e-a672-033bb2a965b8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:08.157759 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffb67e-fb0c-483a-8a63-7a708f9b6381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:08.158710 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffb67e-fb0c-483a-8a63-7a708f9b6381 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:08.159039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffb67e-fb0c-483a-8a63-7a708f9b6381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:08.159803 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffb67e-fb0c-483a-8a63-7a708f9b6381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:08.161013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fffb67e-fb0c-483a-8a63-7a708f9b6381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:08.162102 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fffb67e-fb0c-483a-8a63-7a708f9b6381 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:08.177992 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1054/2075] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:40:08.179280 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffb67e-fb0c-483a-8a63-7a708f9b6381 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:08.192590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffb67e-fb0c-483a-8a63-7a708f9b6381 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:08.215792 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa3ad2-acbd-4de1-8307-5fb3f4873430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:08.217050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa3ad2-acbd-4de1-8307-5fb3f4873430 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:08.217273 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa3ad2-acbd-4de1-8307-5fb3f4873430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:08.217558 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa3ad2-acbd-4de1-8307-5fb3f4873430 admin admin] PATH_INFO: `/v3/projects/8e7c26e6127c4dc6bcea8b3ca2ae3e59/users/06746a83495741a6b14028f82454f82f/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:08.251403 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa3ad2-acbd-4de1-8307-5fb3f4873430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7c26e6127c4dc6bcea8b3ca2ae3e59, user_id=06746a83495741a6b14028f82454f82f, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:08.256210 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa3ad2-acbd-4de1-8307-5fb3f4873430 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:08.288229 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1055/2076] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:40:08 2022] PUT /identity/v3/projects/8e7c26e6127c4dc6bcea8b3ca2ae3e59/users/06746a83495741a6b14028f82454f82f/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:08.299387 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6cae6-8660-4f8e-adc1-c3a6e128a595 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:08.307951 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1022/2077] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:40:08.308522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6cae6-8660-4f8e-adc1-c3a6e128a595 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:08.311271 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6cae6-8660-4f8e-adc1-c3a6e128a595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:08.315862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639c118-2968-468d-a679-2305ab3c8b64 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:08.317974 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d639c118-2968-468d-a679-2305ab3c8b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:08.343338 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d3b6cae6-8660-4f8e-adc1-c3a6e128a595 None None] MFA Rules not processed for user `06746a83495741a6b14028f82454f82f`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:08.345316 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d3b6cae6-8660-4f8e-adc1-c3a6e128a595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:08.390593 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639c118-2968-468d-a679-2305ab3c8b64 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:08.412817 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:08.434031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1056/2078] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:40:08.459121 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6cae6-8660-4f8e-adc1-c3a6e128a595 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:08.461005 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d3b6cae6-8660-4f8e-adc1-c3a6e128a595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:08.469216 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6732ac8-96a9-4f50-b2de-bbadb6798086 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:08.469956 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6732ac8-96a9-4f50-b2de-bbadb6798086 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:08.470378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6732ac8-96a9-4f50-b2de-bbadb6798086 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:08.470663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6732ac8-96a9-4f50-b2de-bbadb6798086 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:08.472463 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c6732ac8-96a9-4f50-b2de-bbadb6798086 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:08.520961 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6cae6-8660-4f8e-adc1-c3a6e128a595 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:08.525594 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4526077-b215-4e65-a458-87e9a06e8b1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:08.526401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4526077-b215-4e65-a458-87e9a06e8b1b service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:08.526688 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4526077-b215-4e65-a458-87e9a06e8b1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:08.526966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4526077-b215-4e65-a458-87e9a06e8b1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:08.532760 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:08.535723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6732ac8-96a9-4f50-b2de-bbadb6798086 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:08.537353 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4526077-b215-4e65-a458-87e9a06e8b1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:08.538100 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6732ac8-96a9-4f50-b2de-bbadb6798086 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:08.539206 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4526077-b215-4e65-a458-87e9a06e8b1b service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:08.551386 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1057/2079] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:08.554862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1023/2080] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:40:11.307134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4526077-b215-4e65-a458-87e9a06e8b1b service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:11.317110 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4526077-b215-4e65-a458-87e9a06e8b1b service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:11.320633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2902609-000d-4fdc-acf3-f3ce796d3eda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:11.321269 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2902609-000d-4fdc-acf3-f3ce796d3eda service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:11.321550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2902609-000d-4fdc-acf3-f3ce796d3eda service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:11.321827 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2902609-000d-4fdc-acf3-f3ce796d3eda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:11.323657 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e2902609-000d-4fdc-acf3-f3ce796d3eda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:11.393133 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2902609-000d-4fdc-acf3-f3ce796d3eda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:11.394765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2902609-000d-4fdc-acf3-f3ce796d3eda service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:11.410600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1058/2081] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:12.011964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6732ac8-96a9-4f50-b2de-bbadb6798086 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:12.021864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6732ac8-96a9-4f50-b2de-bbadb6798086 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:12.028425 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c7aeb-130c-4ed0-905b-d1d3173a149a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:12.029084 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c7aeb-130c-4ed0-905b-d1d3173a149a service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:12.029373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c7aeb-130c-4ed0-905b-d1d3173a149a service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:12.029650 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c7aeb-130c-4ed0-905b-d1d3173a149a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:12.101254 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c7aeb-130c-4ed0-905b-d1d3173a149a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:12.102733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c7aeb-130c-4ed0-905b-d1d3173a149a service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:12.114954 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1024/2082] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:17.176014 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2902609-000d-4fdc-acf3-f3ce796d3eda service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:17.251912 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2902609-000d-4fdc-acf3-f3ce796d3eda service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:17.256428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab27736-2478-400f-8ba1-6423306842e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:17.257294 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab27736-2478-400f-8ba1-6423306842e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:17.257580 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab27736-2478-400f-8ba1-6423306842e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:17.257859 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab27736-2478-400f-8ba1-6423306842e1 admin admin] PATH_INFO: `/v3/users/211fe17d284345c49a80cd0df86aef5e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:17.259143 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab27736-2478-400f-8ba1-6423306842e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=211fe17d284345c49a80cd0df86aef5e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:17.260990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab27736-2478-400f-8ba1-6423306842e1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:17.311171 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9ab27736-2478-400f-8ba1-6423306842e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '211fe17d284345c49a80cd0df86aef5e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:17.311900 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9ab27736-2478-400f-8ba1-6423306842e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '211fe17d284345c49a80cd0df86aef5e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:17.321092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9ab27736-2478-400f-8ba1-6423306842e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '211fe17d284345c49a80cd0df86aef5e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:17.329272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9ab27736-2478-400f-8ba1-6423306842e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '211fe17d284345c49a80cd0df86aef5e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:17.347261 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9ab27736-2478-400f-8ba1-6423306842e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '211fe17d284345c49a80cd0df86aef5e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:17.357518 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1059/2083] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:40:17 2022] DELETE /identity/v3/users/211fe17d284345c49a80cd0df86aef5e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:17.360457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa1aee-116e-4451-b080-28b1ef42ee65 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:17.360948 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa1aee-116e-4451-b080-28b1ef42ee65 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:17.361309 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa1aee-116e-4451-b080-28b1ef42ee65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:17.384747 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-59fa1aee-116e-4451-b080-28b1ef42ee65 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:17.386328 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-59fa1aee-116e-4451-b080-28b1ef42ee65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:17.479272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1025/2084] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:17.489947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab27736-2478-400f-8ba1-6423306842e1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:17.491610 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9ab27736-2478-400f-8ba1-6423306842e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:17.507371 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:17.559431 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab27736-2478-400f-8ba1-6423306842e1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:17.564893 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bd246-25c8-4057-88f2-e4029537e571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:17.565552 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bd246-25c8-4057-88f2-e4029537e571 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:17.565844 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bd246-25c8-4057-88f2-e4029537e571 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:17.566155 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bd246-25c8-4057-88f2-e4029537e571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:17.576888 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bd246-25c8-4057-88f2-e4029537e571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:17.578850 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bd246-25c8-4057-88f2-e4029537e571 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:17.590541 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1060/2085] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:40:17.885833 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa1aee-116e-4451-b080-28b1ef42ee65 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:17.887378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-59fa1aee-116e-4451-b080-28b1ef42ee65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:17.902412 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa1aee-116e-4451-b080-28b1ef42ee65 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:17.908287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072e940-fb76-4150-bc13-54c90e30da5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:17.910152 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072e940-fb76-4150-bc13-54c90e30da5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:17.910366 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072e940-fb76-4150-bc13-54c90e30da5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:17.911149 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072e940-fb76-4150-bc13-54c90e30da5a admin admin] PATH_INFO: `/v3/projects/d67d41badf684af098fe3d5497b23e8e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:17.912628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072e940-fb76-4150-bc13-54c90e30da5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d67d41badf684af098fe3d5497b23e8e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:17.915376 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072e940-fb76-4150-bc13-54c90e30da5a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:17.924555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:17.975826 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3072e940-fb76-4150-bc13-54c90e30da5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd67d41badf684af098fe3d5497b23e8e', 'request_id': 'req-3072e940-fb76-4150-bc13-54c90e30da5a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:17.982334 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3072e940-fb76-4150-bc13-54c90e30da5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd67d41badf684af098fe3d5497b23e8e', 'request_id': 'req-3072e940-fb76-4150-bc13-54c90e30da5a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:17.988055 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3072e940-fb76-4150-bc13-54c90e30da5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd67d41badf684af098fe3d5497b23e8e', 'request_id': 'req-3072e940-fb76-4150-bc13-54c90e30da5a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:18.000431 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3072e940-fb76-4150-bc13-54c90e30da5a admin admin] The token cache is being invalidate because project d67d41badf684af098fe3d5497b23e8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:40:18.000815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3072e940-fb76-4150-bc13-54c90e30da5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:18.001438 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-3072e940-fb76-4150-bc13-54c90e30da5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:18.003050 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1026/2086] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:40:17 2022] DELETE /identity/v3/projects/d67d41badf684af098fe3d5497b23e8e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:18.007199 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bd246-25c8-4057-88f2-e4029537e571 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:18.017761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bd246-25c8-4057-88f2-e4029537e571 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:18.075366 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3050e-b4df-45a9-81e4-19a89716b049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:18.076246 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3050e-b4df-45a9-81e4-19a89716b049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:18.076536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3050e-b4df-45a9-81e4-19a89716b049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:18.076820 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3050e-b4df-45a9-81e4-19a89716b049 admin admin] PATH_INFO: `/v3/users/2a1e817b08754280ba4ed5939543149e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:18.078090 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3050e-b4df-45a9-81e4-19a89716b049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1e817b08754280ba4ed5939543149e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:18.081008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3050e-b4df-45a9-81e4-19a89716b049 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:18.130665 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d0b3050e-b4df-45a9-81e4-19a89716b049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1e817b08754280ba4ed5939543149e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:18.131314 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d0b3050e-b4df-45a9-81e4-19a89716b049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1e817b08754280ba4ed5939543149e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:18.139536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d0b3050e-b4df-45a9-81e4-19a89716b049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1e817b08754280ba4ed5939543149e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:18.148234 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d0b3050e-b4df-45a9-81e4-19a89716b049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1e817b08754280ba4ed5939543149e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:18.162922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d0b3050e-b4df-45a9-81e4-19a89716b049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1e817b08754280ba4ed5939543149e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:18.171322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1061/2087] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:40:18 2022] DELETE /identity/v3/users/2a1e817b08754280ba4ed5939543149e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:40:18.467571 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072e940-fb76-4150-bc13-54c90e30da5a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:18.469962 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3072e940-fb76-4150-bc13-54c90e30da5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:18.483205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072e940-fb76-4150-bc13-54c90e30da5a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:18.539975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbddbb-84a0-4018-8700-af75e6d18433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:18.540834 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbddbb-84a0-4018-8700-af75e6d18433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:18.541115 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbddbb-84a0-4018-8700-af75e6d18433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:18.541388 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbddbb-84a0-4018-8700-af75e6d18433 admin admin] PATH_INFO: `/v3/projects/39ad2ba7ae6f4455916446cfeb34894a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:18.542601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbddbb-84a0-4018-8700-af75e6d18433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39ad2ba7ae6f4455916446cfeb34894a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:18.544611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbddbb-84a0-4018-8700-af75e6d18433 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:18.598519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-12cbddbb-84a0-4018-8700-af75e6d18433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39ad2ba7ae6f4455916446cfeb34894a', 'request_id': 'req-12cbddbb-84a0-4018-8700-af75e6d18433'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:18.605204 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-12cbddbb-84a0-4018-8700-af75e6d18433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39ad2ba7ae6f4455916446cfeb34894a', 'request_id': 'req-12cbddbb-84a0-4018-8700-af75e6d18433'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:18.611758 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-12cbddbb-84a0-4018-8700-af75e6d18433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39ad2ba7ae6f4455916446cfeb34894a', 'request_id': 'req-12cbddbb-84a0-4018-8700-af75e6d18433'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:18.626812 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-12cbddbb-84a0-4018-8700-af75e6d18433 admin admin] The token cache is being invalidate because project 39ad2ba7ae6f4455916446cfeb34894a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:40:18.627098 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-12cbddbb-84a0-4018-8700-af75e6d18433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:18.627869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-12cbddbb-84a0-4018-8700-af75e6d18433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:18.629738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1027/2088] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:40:18 2022] DELETE /identity/v3/projects/39ad2ba7ae6f4455916446cfeb34894a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:18.634507 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3050e-b4df-45a9-81e4-19a89716b049 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:18.635960 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d0b3050e-b4df-45a9-81e4-19a89716b049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:18.648908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3050e-b4df-45a9-81e4-19a89716b049 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:18.682237 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:18.714017 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1360f7-a202-4b5b-8cd7-2a7a8896a8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:18.714930 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1360f7-a202-4b5b-8cd7-2a7a8896a8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:18.715215 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1360f7-a202-4b5b-8cd7-2a7a8896a8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:18.715493 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1360f7-a202-4b5b-8cd7-2a7a8896a8b4 admin admin] PATH_INFO: `/v3/users/bc1eeef9894a4a5abcba6e6383c25efd` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:18.716697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1360f7-a202-4b5b-8cd7-2a7a8896a8b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc1eeef9894a4a5abcba6e6383c25efd)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:18.718688 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1360f7-a202-4b5b-8cd7-2a7a8896a8b4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:18.767104 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8b1360f7-a202-4b5b-8cd7-2a7a8896a8b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc1eeef9894a4a5abcba6e6383c25efd'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:18.767771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8b1360f7-a202-4b5b-8cd7-2a7a8896a8b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc1eeef9894a4a5abcba6e6383c25efd'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:18.774821 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8b1360f7-a202-4b5b-8cd7-2a7a8896a8b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc1eeef9894a4a5abcba6e6383c25efd'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:18.783397 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8b1360f7-a202-4b5b-8cd7-2a7a8896a8b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc1eeef9894a4a5abcba6e6383c25efd'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:18.795843 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8b1360f7-a202-4b5b-8cd7-2a7a8896a8b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc1eeef9894a4a5abcba6e6383c25efd'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:18.802662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1062/2089] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:40:18 2022] DELETE /identity/v3/users/bc1eeef9894a4a5abcba6e6383c25efd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:19.105720 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbddbb-84a0-4018-8700-af75e6d18433 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:19.107232 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-12cbddbb-84a0-4018-8700-af75e6d18433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:19.120806 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbddbb-84a0-4018-8700-af75e6d18433 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:19.146091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:19.181497 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8669d9-eabe-4c57-ad91-1890876f222d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:19.182317 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8669d9-eabe-4c57-ad91-1890876f222d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:19.182597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8669d9-eabe-4c57-ad91-1890876f222d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:19.182869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8669d9-eabe-4c57-ad91-1890876f222d admin admin] PATH_INFO: `/v3/projects/db316b664db241c191d2f9c5ac903023` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:19.184037 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8669d9-eabe-4c57-ad91-1890876f222d admin admin] RBAC: Authorizing `identity:delete_project(project_id=db316b664db241c191d2f9c5ac903023)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:19.186037 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8669d9-eabe-4c57-ad91-1890876f222d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:19.235467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-df8669d9-eabe-4c57-ad91-1890876f222d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db316b664db241c191d2f9c5ac903023', 'request_id': 'req-df8669d9-eabe-4c57-ad91-1890876f222d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:19.241736 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-df8669d9-eabe-4c57-ad91-1890876f222d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db316b664db241c191d2f9c5ac903023', 'request_id': 'req-df8669d9-eabe-4c57-ad91-1890876f222d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:19.248215 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-df8669d9-eabe-4c57-ad91-1890876f222d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db316b664db241c191d2f9c5ac903023', 'request_id': 'req-df8669d9-eabe-4c57-ad91-1890876f222d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:19.262061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-df8669d9-eabe-4c57-ad91-1890876f222d admin admin] The token cache is being invalidate because project db316b664db241c191d2f9c5ac903023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:40:19.262380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-df8669d9-eabe-4c57-ad91-1890876f222d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:19.262991 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-df8669d9-eabe-4c57-ad91-1890876f222d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:19.264528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1028/2090] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:40:19 2022] DELETE /identity/v3/projects/db316b664db241c191d2f9c5ac903023 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:19.270770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c9cec-4172-438e-80a5-4ccfb114bfe1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:19.271119 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c9cec-4172-438e-80a5-4ccfb114bfe1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:19.271441 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c9cec-4172-438e-80a5-4ccfb114bfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:19.291399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e90c9cec-4172-438e-80a5-4ccfb114bfe1 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:19.292670 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e90c9cec-4172-438e-80a5-4ccfb114bfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:19.355412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1063/2091] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:19.363994 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f479d-9ba0-483c-8a77-7069288a4bc3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:19.364283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f479d-9ba0-483c-8a77-7069288a4bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:19.364560 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f479d-9ba0-483c-8a77-7069288a4bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:19.383016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-0c7f479d-9ba0-483c-8a77-7069288a4bc3 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:19.384232 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0c7f479d-9ba0-483c-8a77-7069288a4bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:19.393643 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1029/2092] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:19.398320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c9cec-4172-438e-80a5-4ccfb114bfe1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:19.409792 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c9cec-4172-438e-80a5-4ccfb114bfe1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:19.414966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de390640-4a2b-4ade-869b-4493cdc01d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:19.415625 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de390640-4a2b-4ade-869b-4493cdc01d84 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:19.415911 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de390640-4a2b-4ade-869b-4493cdc01d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:19.416191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de390640-4a2b-4ade-869b-4493cdc01d84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:19.416971 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de390640-4a2b-4ade-869b-4493cdc01d84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:40:19.417290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de390640-4a2b-4ade-869b-4493cdc01d84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:19.419025 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de390640-4a2b-4ade-869b-4493cdc01d84 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:19.432392 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1064/2093] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:40:19.437026 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f479d-9ba0-483c-8a77-7069288a4bc3 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:19.446620 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f479d-9ba0-483c-8a77-7069288a4bc3 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:19.451600 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef11f95-1a9f-49e8-8582-3183a1bd1103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:19.452288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef11f95-1a9f-49e8-8582-3183a1bd1103 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:19.452575 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef11f95-1a9f-49e8-8582-3183a1bd1103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:19.452872 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef11f95-1a9f-49e8-8582-3183a1bd1103 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:19.454189 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef11f95-1a9f-49e8-8582-3183a1bd1103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:19.456118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef11f95-1a9f-49e8-8582-3183a1bd1103 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:19.484097 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1030/2094] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:40:19 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:40:19.488487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de390640-4a2b-4ade-869b-4493cdc01d84 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:19.499353 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de390640-4a2b-4ade-869b-4493cdc01d84 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:19.542206 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:19.562046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbdfcd-9565-4e77-aeb8-12a3bd071da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:19.562751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbdfcd-9565-4e77-aeb8-12a3bd071da0 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:19.563037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbdfcd-9565-4e77-aeb8-12a3bd071da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:19.563315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fbdfcd-9565-4e77-aeb8-12a3bd071da0 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:19.563994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fbdfcd-9565-4e77-aeb8-12a3bd071da0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:19.565907 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fbdfcd-9565-4e77-aeb8-12a3bd071da0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:19.585381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1065/2095] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:40:19 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:40:19.589689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef11f95-1a9f-49e8-8582-3183a1bd1103 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:19.600512 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef11f95-1a9f-49e8-8582-3183a1bd1103 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:19.605222 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ffeae-ab45-4cf9-84d6-3062349f6748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:19.605869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ffeae-ab45-4cf9-84d6-3062349f6748 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:19.606185 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ffeae-ab45-4cf9-84d6-3062349f6748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:19.606464 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ffeae-ab45-4cf9-84d6-3062349f6748 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:19.607187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ffeae-ab45-4cf9-84d6-3062349f6748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:19.608820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ffeae-ab45-4cf9-84d6-3062349f6748 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:19.619336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1031/2096] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:19.623353 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbdfcd-9565-4e77-aeb8-12a3bd071da0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:19.634125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fbdfcd-9565-4e77-aeb8-12a3bd071da0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:19.638780 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ad05f-fc50-4f86-8101-9288036c21ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:19.639433 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ad05f-fc50-4f86-8101-9288036c21ef admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:19.639752 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ad05f-fc50-4f86-8101-9288036c21ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:19.640032 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ad05f-fc50-4f86-8101-9288036c21ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:19.640790 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ad05f-fc50-4f86-8101-9288036c21ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:19.643007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ad05f-fc50-4f86-8101-9288036c21ef admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:19.653696 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1066/2097] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:40:19.658081 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ffeae-ab45-4cf9-84d6-3062349f6748 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:19.668419 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ffeae-ab45-4cf9-84d6-3062349f6748 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:19.673058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adeca1f-1255-42cf-a16a-eb5813365a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:19.673931 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adeca1f-1255-42cf-a16a-eb5813365a29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:19.674255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adeca1f-1255-42cf-a16a-eb5813365a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:19.674538 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adeca1f-1255-42cf-a16a-eb5813365a29 admin admin] PATH_INFO: `/v3/projects/2fdb667f3ad94690ae336b3638550622/users/f5c725cee2ba4c4b94d841b464315add/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:19.690430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adeca1f-1255-42cf-a16a-eb5813365a29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fdb667f3ad94690ae336b3638550622, user_id=f5c725cee2ba4c4b94d841b464315add, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:19.693126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adeca1f-1255-42cf-a16a-eb5813365a29 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:19.707177 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1032/2098] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:40:19 2022] PUT /identity/v3/projects/2fdb667f3ad94690ae336b3638550622/users/f5c725cee2ba4c4b94d841b464315add/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:19.775659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91d6fa-3687-4c60-b61e-b6c0b288b5ea None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:19.776086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91d6fa-3687-4c60-b61e-b6c0b288b5ea None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:19.776369 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91d6fa-3687-4c60-b61e-b6c0b288b5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:19.804814 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4b91d6fa-3687-4c60-b61e-b6c0b288b5ea None None] MFA Rules not processed for user `f5c725cee2ba4c4b94d841b464315add`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:19.806281 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4b91d6fa-3687-4c60-b61e-b6c0b288b5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:19.876058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1067/2099] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:19.887408 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adeca1f-1255-42cf-a16a-eb5813365a29 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:19.889114 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1adeca1f-1255-42cf-a16a-eb5813365a29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:19.948603 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adeca1f-1255-42cf-a16a-eb5813365a29 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:19.952395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715e565-f587-4346-9c35-2c2a7fa3165b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:19.953047 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e565-f587-4346-9c35-2c2a7fa3165b service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:19.953393 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e565-f587-4346-9c35-2c2a7fa3165b service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:19.954404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715e565-f587-4346-9c35-2c2a7fa3165b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:19.961155 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:19.963866 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715e565-f587-4346-9c35-2c2a7fa3165b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:19.965843 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715e565-f587-4346-9c35-2c2a7fa3165b service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:19.977741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1033/2100] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:20.003436 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91d6fa-3687-4c60-b61e-b6c0b288b5ea None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:20.071471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91d6fa-3687-4c60-b61e-b6c0b288b5ea None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:20.076032 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959ce86-0f57-43be-83b1-eacf2ba18318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:20.076906 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959ce86-0f57-43be-83b1-eacf2ba18318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:20.077190 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959ce86-0f57-43be-83b1-eacf2ba18318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:20.077469 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959ce86-0f57-43be-83b1-eacf2ba18318 admin admin] PATH_INFO: `/v3/users/f5c725cee2ba4c4b94d841b464315add` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:20.078730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959ce86-0f57-43be-83b1-eacf2ba18318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5c725cee2ba4c4b94d841b464315add)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:20.080660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959ce86-0f57-43be-83b1-eacf2ba18318 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:20.126395 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1959ce86-0f57-43be-83b1-eacf2ba18318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5c725cee2ba4c4b94d841b464315add'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:20.127066 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1959ce86-0f57-43be-83b1-eacf2ba18318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5c725cee2ba4c4b94d841b464315add'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:20.129173 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:20.136968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1959ce86-0f57-43be-83b1-eacf2ba18318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5c725cee2ba4c4b94d841b464315add'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:20.144248 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1959ce86-0f57-43be-83b1-eacf2ba18318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5c725cee2ba4c4b94d841b464315add'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:20.155841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1959ce86-0f57-43be-83b1-eacf2ba18318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5c725cee2ba4c4b94d841b464315add'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:20.161845 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1068/2101] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:40:20 2022] DELETE /identity/v3/users/f5c725cee2ba4c4b94d841b464315add => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:20.166769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829bb14-7c11-45d6-9871-34097fb1b300 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:20.167090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829bb14-7c11-45d6-9871-34097fb1b300 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:20.167359 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829bb14-7c11-45d6-9871-34097fb1b300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:20.184699 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-5829bb14-7c11-45d6-9871-34097fb1b300 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:20.185902 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5829bb14-7c11-45d6-9871-34097fb1b300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:20.244283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1034/2102] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:20.254834 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959ce86-0f57-43be-83b1-eacf2ba18318 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:20.256285 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1959ce86-0f57-43be-83b1-eacf2ba18318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:20.315950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959ce86-0f57-43be-83b1-eacf2ba18318 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:20.319687 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800d141-33e5-42b8-a62f-735ef52af138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:20.320336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800d141-33e5-42b8-a62f-735ef52af138 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:20.320631 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800d141-33e5-42b8-a62f-735ef52af138 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:20.320911 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800d141-33e5-42b8-a62f-735ef52af138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:20.330184 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800d141-33e5-42b8-a62f-735ef52af138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:20.331634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800d141-33e5-42b8-a62f-735ef52af138 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:20.341391 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1069/2103] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:20.612158 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829bb14-7c11-45d6-9871-34097fb1b300 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:20.613984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5829bb14-7c11-45d6-9871-34097fb1b300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:20.633038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829bb14-7c11-45d6-9871-34097fb1b300 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:20.637877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b487445-2f98-436d-9f8b-d4f66533ff64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:20.638831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b487445-2f98-436d-9f8b-d4f66533ff64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:20.639163 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b487445-2f98-436d-9f8b-d4f66533ff64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:20.639448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b487445-2f98-436d-9f8b-d4f66533ff64 admin admin] PATH_INFO: `/v3/projects/2fdb667f3ad94690ae336b3638550622` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:20.640669 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b487445-2f98-436d-9f8b-d4f66533ff64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fdb667f3ad94690ae336b3638550622)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:20.643504 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b487445-2f98-436d-9f8b-d4f66533ff64 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:20.695982 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1b487445-2f98-436d-9f8b-d4f66533ff64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fdb667f3ad94690ae336b3638550622', 'request_id': 'req-1b487445-2f98-436d-9f8b-d4f66533ff64'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:20.702287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1b487445-2f98-436d-9f8b-d4f66533ff64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fdb667f3ad94690ae336b3638550622', 'request_id': 'req-1b487445-2f98-436d-9f8b-d4f66533ff64'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:20.710179 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1b487445-2f98-436d-9f8b-d4f66533ff64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fdb667f3ad94690ae336b3638550622', 'request_id': 'req-1b487445-2f98-436d-9f8b-d4f66533ff64'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:20.723103 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1b487445-2f98-436d-9f8b-d4f66533ff64 admin admin] The token cache is being invalidate because project 2fdb667f3ad94690ae336b3638550622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:40:20.723394 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1b487445-2f98-436d-9f8b-d4f66533ff64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:20.724012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1b487445-2f98-436d-9f8b-d4f66533ff64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:20.725586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1035/2104] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:40:20 2022] DELETE /identity/v3/projects/2fdb667f3ad94690ae336b3638550622 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:25.970667 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e568fa9-a76d-4bcb-baa6-1bcfc07fb0b2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:25.971092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e568fa9-a76d-4bcb-baa6-1bcfc07fb0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:25.971227 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e568fa9-a76d-4bcb-baa6-1bcfc07fb0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:25.990160 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2e568fa9-a76d-4bcb-baa6-1bcfc07fb0b2 None None] MFA Rules not processed for user `8103402ac83c4b4191a3ec4d55038e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:25.992286 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2e568fa9-a76d-4bcb-baa6-1bcfc07fb0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:26.051848 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1070/2105] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jul 14 15:40:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:26.096094 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b487445-2f98-436d-9f8b-d4f66533ff64 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:26.097526 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1b487445-2f98-436d-9f8b-d4f66533ff64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:26.169163 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b487445-2f98-436d-9f8b-d4f66533ff64 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:26.174311 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23999a97-3fc8-487f-ba88-d1ae66c7652d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edbbc94ca71c42c0aac562c8c2ec83db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:26.174994 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23999a97-3fc8-487f-ba88-d1ae66c7652d service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:26.175277 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23999a97-3fc8-487f-ba88-d1ae66c7652d service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:26.175556 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23999a97-3fc8-487f-ba88-d1ae66c7652d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:26.184219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23999a97-3fc8-487f-ba88-d1ae66c7652d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:26.186049 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23999a97-3fc8-487f-ba88-d1ae66c7652d service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:26.194799 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1036/2106] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jul 14 15:40:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:40:27.733353 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e568fa9-a76d-4bcb-baa6-1bcfc07fb0b2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:27.736575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2e568fa9-a76d-4bcb-baa6-1bcfc07fb0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:27.839050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e568fa9-a76d-4bcb-baa6-1bcfc07fb0b2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:27.844798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93e418-9952-4799-a1cd-ca2157c0b576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:27.845682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93e418-9952-4799-a1cd-ca2157c0b576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:27.845961 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93e418-9952-4799-a1cd-ca2157c0b576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:27.846269 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93e418-9952-4799-a1cd-ca2157c0b576 admin admin] PATH_INFO: `/v3/users/06746a83495741a6b14028f82454f82f` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:27.847756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93e418-9952-4799-a1cd-ca2157c0b576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06746a83495741a6b14028f82454f82f)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:27.849738 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d93e418-9952-4799-a1cd-ca2157c0b576 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:27.882562 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:28.062233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4d93e418-9952-4799-a1cd-ca2157c0b576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06746a83495741a6b14028f82454f82f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:28.063338 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4d93e418-9952-4799-a1cd-ca2157c0b576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06746a83495741a6b14028f82454f82f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:28.071008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4d93e418-9952-4799-a1cd-ca2157c0b576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06746a83495741a6b14028f82454f82f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:28.080317 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4d93e418-9952-4799-a1cd-ca2157c0b576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06746a83495741a6b14028f82454f82f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:28.093374 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4d93e418-9952-4799-a1cd-ca2157c0b576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06746a83495741a6b14028f82454f82f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:28.104028 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1071/2107] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:40:27 2022] DELETE /identity/v3/users/06746a83495741a6b14028f82454f82f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:28.108467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8446501-40fc-4c76-a1ff-76f94d22da38 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:28.109029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8446501-40fc-4c76-a1ff-76f94d22da38 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:28.109029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8446501-40fc-4c76-a1ff-76f94d22da38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:28.136790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a8446501-40fc-4c76-a1ff-76f94d22da38 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:28.138518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a8446501-40fc-4c76-a1ff-76f94d22da38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:28.144075 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:28.221854 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1037/2108] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:28.231633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93e418-9952-4799-a1cd-ca2157c0b576 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:28.233233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4d93e418-9952-4799-a1cd-ca2157c0b576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:28.345025 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93e418-9952-4799-a1cd-ca2157c0b576 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:28.349416 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f1533-e319-43a7-af91-3101787242fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:28.350225 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f1533-e319-43a7-af91-3101787242fd service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:28.350588 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f1533-e319-43a7-af91-3101787242fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:28.350955 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f1533-e319-43a7-af91-3101787242fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:28.365899 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f1533-e319-43a7-af91-3101787242fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:28.368541 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f1533-e319-43a7-af91-3101787242fd service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:28.404947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1072/2109] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:28.713097 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8446501-40fc-4c76-a1ff-76f94d22da38 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:28.714885 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a8446501-40fc-4c76-a1ff-76f94d22da38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:28.731012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8446501-40fc-4c76-a1ff-76f94d22da38 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:28.738144 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7df15a4-9cdf-447f-8d21-1c43378e2be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:28.739353 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df15a4-9cdf-447f-8d21-1c43378e2be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:28.739888 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df15a4-9cdf-447f-8d21-1c43378e2be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:28.740151 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7df15a4-9cdf-447f-8d21-1c43378e2be9 admin admin] PATH_INFO: `/v3/projects/8e7c26e6127c4dc6bcea8b3ca2ae3e59` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:28.741773 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df15a4-9cdf-447f-8d21-1c43378e2be9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e7c26e6127c4dc6bcea8b3ca2ae3e59)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:28.744367 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7df15a4-9cdf-447f-8d21-1c43378e2be9 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:28.838537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c7df15a4-9cdf-447f-8d21-1c43378e2be9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e7c26e6127c4dc6bcea8b3ca2ae3e59', 'request_id': 'req-c7df15a4-9cdf-447f-8d21-1c43378e2be9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:28.847724 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c7df15a4-9cdf-447f-8d21-1c43378e2be9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e7c26e6127c4dc6bcea8b3ca2ae3e59', 'request_id': 'req-c7df15a4-9cdf-447f-8d21-1c43378e2be9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:28.856144 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c7df15a4-9cdf-447f-8d21-1c43378e2be9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e7c26e6127c4dc6bcea8b3ca2ae3e59', 'request_id': 'req-c7df15a4-9cdf-447f-8d21-1c43378e2be9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:28.879013 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c7df15a4-9cdf-447f-8d21-1c43378e2be9 admin admin] The token cache is being invalidate because project 8e7c26e6127c4dc6bcea8b3ca2ae3e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:40:28.879013 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c7df15a4-9cdf-447f-8d21-1c43378e2be9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:28.879682 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c7df15a4-9cdf-447f-8d21-1c43378e2be9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:28.882054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1038/2110] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:40:28 2022] DELETE /identity/v3/projects/8e7c26e6127c4dc6bcea8b3ca2ae3e59 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:28.889936 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992c831-bd56-41a0-80b7-9dc046973e95 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:28.890743 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992c831-bd56-41a0-80b7-9dc046973e95 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:28.890743 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992c831-bd56-41a0-80b7-9dc046973e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:28.913085 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7992c831-bd56-41a0-80b7-9dc046973e95 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:28.913963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7992c831-bd56-41a0-80b7-9dc046973e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:29.003550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1073/2111] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:29.013133 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b549a3a-710d-4b81-98c1-bb0f18cb8b1b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:29.013454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b549a3a-710d-4b81-98c1-bb0f18cb8b1b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:29.013739 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b549a3a-710d-4b81-98c1-bb0f18cb8b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:29.036341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-1b549a3a-710d-4b81-98c1-bb0f18cb8b1b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:29.037773 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1b549a3a-710d-4b81-98c1-bb0f18cb8b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:29.054196 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1039/2112] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:29.056549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992c831-bd56-41a0-80b7-9dc046973e95 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:29.071849 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992c831-bd56-41a0-80b7-9dc046973e95 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:29.077401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8a4aa-95f5-4800-b122-cd9638ad6257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:29.078100 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8a4aa-95f5-4800-b122-cd9638ad6257 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:29.078403 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8a4aa-95f5-4800-b122-cd9638ad6257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:29.078690 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8a4aa-95f5-4800-b122-cd9638ad6257 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:29.079435 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8a4aa-95f5-4800-b122-cd9638ad6257 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:40:29.079762 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8a4aa-95f5-4800-b122-cd9638ad6257 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:29.081456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8a4aa-95f5-4800-b122-cd9638ad6257 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:29.101464 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1074/2113] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:40:29.106219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b549a3a-710d-4b81-98c1-bb0f18cb8b1b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:29.117670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b549a3a-710d-4b81-98c1-bb0f18cb8b1b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:29.127373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c183ee6-4bb1-4f97-9780-4a7df7609a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:29.129049 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c183ee6-4bb1-4f97-9780-4a7df7609a4d admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:29.129462 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c183ee6-4bb1-4f97-9780-4a7df7609a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:29.129850 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c183ee6-4bb1-4f97-9780-4a7df7609a4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:29.130896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c183ee6-4bb1-4f97-9780-4a7df7609a4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:29.133893 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c183ee6-4bb1-4f97-9780-4a7df7609a4d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:29.206455 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1040/2114] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:40:29 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:40:29.211111 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8a4aa-95f5-4800-b122-cd9638ad6257 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:29.222297 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8a4aa-95f5-4800-b122-cd9638ad6257 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:29.245947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:29.299766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3701915-5337-4bc1-be61-1da82981a57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:29.300624 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3701915-5337-4bc1-be61-1da82981a57b admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:29.301028 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3701915-5337-4bc1-be61-1da82981a57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:29.301307 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3701915-5337-4bc1-be61-1da82981a57b admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:29.302168 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3701915-5337-4bc1-be61-1da82981a57b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:29.303967 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3701915-5337-4bc1-be61-1da82981a57b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:29.338128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1075/2115] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:40:29 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:40:29.341279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c183ee6-4bb1-4f97-9780-4a7df7609a4d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:29.364365 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c183ee6-4bb1-4f97-9780-4a7df7609a4d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:29.370342 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421b02d-1bb7-4ca4-974a-505832cd8de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:29.371032 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421b02d-1bb7-4ca4-974a-505832cd8de1 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:29.371319 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421b02d-1bb7-4ca4-974a-505832cd8de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:29.371791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421b02d-1bb7-4ca4-974a-505832cd8de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:29.372344 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421b02d-1bb7-4ca4-974a-505832cd8de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:29.373985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421b02d-1bb7-4ca4-974a-505832cd8de1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:29.391083 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1041/2116] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:29.392363 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3701915-5337-4bc1-be61-1da82981a57b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:29.404170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3701915-5337-4bc1-be61-1da82981a57b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:29.410176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2978c3-24b5-4f56-b8ed-0cd3a82a6adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:29.411005 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2978c3-24b5-4f56-b8ed-0cd3a82a6adf admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:29.411297 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2978c3-24b5-4f56-b8ed-0cd3a82a6adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:29.411578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2978c3-24b5-4f56-b8ed-0cd3a82a6adf admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:29.412317 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2978c3-24b5-4f56-b8ed-0cd3a82a6adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:29.413938 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2978c3-24b5-4f56-b8ed-0cd3a82a6adf admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:29.433435 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1076/2117] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:29.438444 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421b02d-1bb7-4ca4-974a-505832cd8de1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:29.458664 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421b02d-1bb7-4ca4-974a-505832cd8de1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:29.464166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c985fe-d688-435c-9ee5-d4dc88aea509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:29.465077 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c985fe-d688-435c-9ee5-d4dc88aea509 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:29.465363 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c985fe-d688-435c-9ee5-d4dc88aea509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:29.465643 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c985fe-d688-435c-9ee5-d4dc88aea509 admin admin] PATH_INFO: `/v3/projects/90994086646146a5ae4f06ce8f364283/users/312e13d561974ce5b84c003342b22bdb/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:29.485990 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c985fe-d688-435c-9ee5-d4dc88aea509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90994086646146a5ae4f06ce8f364283, user_id=312e13d561974ce5b84c003342b22bdb, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:29.489273 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c985fe-d688-435c-9ee5-d4dc88aea509 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:29.504326 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1042/2118] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:40:29 2022] PUT /identity/v3/projects/90994086646146a5ae4f06ce8f364283/users/312e13d561974ce5b84c003342b22bdb/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:40:29.516104 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a61f2-b204-4c43-8cd0-9609b17796f7 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:29.516315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a61f2-b204-4c43-8cd0-9609b17796f7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:29.516766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a61f2-b204-4c43-8cd0-9609b17796f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:29.557517 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-351a61f2-b204-4c43-8cd0-9609b17796f7 None None] MFA Rules not processed for user `312e13d561974ce5b84c003342b22bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:29.558830 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-351a61f2-b204-4c43-8cd0-9609b17796f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:29.641440 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1077/2119] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:29.645919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c985fe-d688-435c-9ee5-d4dc88aea509 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:29.694344 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:29.737605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c985fe-d688-435c-9ee5-d4dc88aea509 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:29.742877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83654e3b-8815-42e0-9670-e2acb8174012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:29.744048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83654e3b-8815-42e0-9670-e2acb8174012 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:29.744597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83654e3b-8815-42e0-9670-e2acb8174012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:29.744990 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83654e3b-8815-42e0-9670-e2acb8174012 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:29.746502 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83654e3b-8815-42e0-9670-e2acb8174012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:29.749879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83654e3b-8815-42e0-9670-e2acb8174012 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:29.790128 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1043/2120] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:40:29 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:40:29.794237 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a61f2-b204-4c43-8cd0-9609b17796f7 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:29.805911 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a61f2-b204-4c43-8cd0-9609b17796f7 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:29.876115 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14535833-f1c5-4392-a024-e3b130fed83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:29.876898 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14535833-f1c5-4392-a024-e3b130fed83f admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:29.877249 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14535833-f1c5-4392-a024-e3b130fed83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:29.877596 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14535833-f1c5-4392-a024-e3b130fed83f admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:29.878426 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14535833-f1c5-4392-a024-e3b130fed83f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:29.880459 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14535833-f1c5-4392-a024-e3b130fed83f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:29.911169 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83654e3b-8815-42e0-9670-e2acb8174012 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:29.912410 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1078/2121] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:40:29 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:40:29.926396 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83654e3b-8815-42e0-9670-e2acb8174012 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:29.932099 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73d277-d1d7-495a-9f12-1d6292e6aeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:29.934797 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73d277-d1d7-495a-9f12-1d6292e6aeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:29.935131 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73d277-d1d7-495a-9f12-1d6292e6aeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:29.935417 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73d277-d1d7-495a-9f12-1d6292e6aeb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:29.936213 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73d277-d1d7-495a-9f12-1d6292e6aeb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:29.937923 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73d277-d1d7-495a-9f12-1d6292e6aeb8 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:29.953699 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1044/2122] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:40:29.955376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14535833-f1c5-4392-a024-e3b130fed83f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:29.976284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14535833-f1c5-4392-a024-e3b130fed83f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:29.983030 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6376fb8-3828-4d19-9c6d-00d90705ab57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:29.983704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6376fb8-3828-4d19-9c6d-00d90705ab57 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:29.983986 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6376fb8-3828-4d19-9c6d-00d90705ab57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:29.984914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6376fb8-3828-4d19-9c6d-00d90705ab57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:29.985836 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6376fb8-3828-4d19-9c6d-00d90705ab57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:29.987532 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6376fb8-3828-4d19-9c6d-00d90705ab57 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:30.003633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1079/2123] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:30.005025 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73d277-d1d7-495a-9f12-1d6292e6aeb8 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:30.020113 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73d277-d1d7-495a-9f12-1d6292e6aeb8 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:30.029749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b11d82-c7bb-4ce9-98a2-5971488f56c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:30.030841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b11d82-c7bb-4ce9-98a2-5971488f56c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:30.031289 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b11d82-c7bb-4ce9-98a2-5971488f56c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:30.031655 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b11d82-c7bb-4ce9-98a2-5971488f56c1 admin admin] PATH_INFO: `/v3/projects/def89733b59043d999f8207fd618eafe/users/45f77bfa493f4f628f87f5938d686038/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:30.052956 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b11d82-c7bb-4ce9-98a2-5971488f56c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=def89733b59043d999f8207fd618eafe, user_id=45f77bfa493f4f628f87f5938d686038, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:30.055586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b11d82-c7bb-4ce9-98a2-5971488f56c1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:30.077819 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1045/2124] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:40:30 2022] PUT /identity/v3/projects/def89733b59043d999f8207fd618eafe/users/45f77bfa493f4f628f87f5938d686038/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:30.088801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdebab-3567-417c-b7f1-1dd4101e5f85 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:30.089122 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdebab-3567-417c-b7f1-1dd4101e5f85 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:30.089407 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdebab-3567-417c-b7f1-1dd4101e5f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:30.118861 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:30.131844 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-40cdebab-3567-417c-b7f1-1dd4101e5f85 None None] MFA Rules not processed for user `45f77bfa493f4f628f87f5938d686038`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:30.133171 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-40cdebab-3567-417c-b7f1-1dd4101e5f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:30.214118 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1080/2125] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:30.216951 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b11d82-c7bb-4ce9-98a2-5971488f56c1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:30.289944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b11d82-c7bb-4ce9-98a2-5971488f56c1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:30.296264 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169997db-383a-48cc-ad92-28f630023d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:30.297085 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169997db-383a-48cc-ad92-28f630023d70 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:30.297503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169997db-383a-48cc-ad92-28f630023d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:30.297784 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169997db-383a-48cc-ad92-28f630023d70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:30.298645 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169997db-383a-48cc-ad92-28f630023d70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:30.301234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169997db-383a-48cc-ad92-28f630023d70 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:30.334588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1046/2126] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:40:30 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:40:30.338381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdebab-3567-417c-b7f1-1dd4101e5f85 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:30.355086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdebab-3567-417c-b7f1-1dd4101e5f85 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:30.446475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714426ee-2a10-4105-be08-aeb89487f872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:30.447443 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714426ee-2a10-4105-be08-aeb89487f872 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:30.447936 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714426ee-2a10-4105-be08-aeb89487f872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:30.448304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714426ee-2a10-4105-be08-aeb89487f872 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:30.449206 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714426ee-2a10-4105-be08-aeb89487f872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:30.451368 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714426ee-2a10-4105-be08-aeb89487f872 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:30.481503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1081/2127] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:40:30 2022] POST /identity/v3/users => generated 300 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:40:30.481971 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169997db-383a-48cc-ad92-28f630023d70 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:30.497041 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169997db-383a-48cc-ad92-28f630023d70 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:30.502518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48fb27-10b9-47eb-bed6-1abbba41b786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:30.503205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48fb27-10b9-47eb-bed6-1abbba41b786 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:30.503495 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48fb27-10b9-47eb-bed6-1abbba41b786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:30.503795 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48fb27-10b9-47eb-bed6-1abbba41b786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:30.505104 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48fb27-10b9-47eb-bed6-1abbba41b786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:30.506861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48fb27-10b9-47eb-bed6-1abbba41b786 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:30.524309 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1047/2128] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:40:30.530615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714426ee-2a10-4105-be08-aeb89487f872 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:30.544819 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714426ee-2a10-4105-be08-aeb89487f872 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:30.551210 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff1490-830b-4557-9c4b-8ea4ebfd93c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:30.552116 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff1490-830b-4557-9c4b-8ea4ebfd93c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:30.552412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff1490-830b-4557-9c4b-8ea4ebfd93c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:30.552693 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff1490-830b-4557-9c4b-8ea4ebfd93c9 admin admin] PATH_INFO: `/v3/projects/d09d64848d7e4e829edcf2f31d9e987d/users/42a9ec8fa5f84ac3af59f42b395b4dd6/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:30.570878 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff1490-830b-4557-9c4b-8ea4ebfd93c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09d64848d7e4e829edcf2f31d9e987d, user_id=42a9ec8fa5f84ac3af59f42b395b4dd6, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:30.573919 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff1490-830b-4557-9c4b-8ea4ebfd93c9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:30.613441 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1082/2129] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:40:30 2022] PUT /identity/v3/projects/d09d64848d7e4e829edcf2f31d9e987d/users/42a9ec8fa5f84ac3af59f42b395b4dd6/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:30.617612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48fb27-10b9-47eb-bed6-1abbba41b786 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:30.632644 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48fb27-10b9-47eb-bed6-1abbba41b786 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:30.723786 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:30.737042 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19236ce-ea9e-4e61-afb0-badddd9e1232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:30.737878 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19236ce-ea9e-4e61-afb0-badddd9e1232 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:30.738304 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19236ce-ea9e-4e61-afb0-badddd9e1232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:30.738686 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19236ce-ea9e-4e61-afb0-badddd9e1232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:30.739739 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19236ce-ea9e-4e61-afb0-badddd9e1232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:30.741508 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19236ce-ea9e-4e61-afb0-badddd9e1232 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:30.758854 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1048/2130] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:30.760210 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff1490-830b-4557-9c4b-8ea4ebfd93c9 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:30.772844 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff1490-830b-4557-9c4b-8ea4ebfd93c9 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:30.779108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36977333-5904-4a61-b8a3-8a1b4edd4a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:30.780236 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36977333-5904-4a61-b8a3-8a1b4edd4a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:30.780699 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36977333-5904-4a61-b8a3-8a1b4edd4a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:30.780990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36977333-5904-4a61-b8a3-8a1b4edd4a5e admin admin] PATH_INFO: `/v3/projects/d09d64848d7e4e829edcf2f31d9e987d/users/42a9ec8fa5f84ac3af59f42b395b4dd6/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:30.783735 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36977333-5904-4a61-b8a3-8a1b4edd4a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09d64848d7e4e829edcf2f31d9e987d, user_id=42a9ec8fa5f84ac3af59f42b395b4dd6, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:30.786570 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36977333-5904-4a61-b8a3-8a1b4edd4a5e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:30.801663 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1083/2131] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:40:30 2022] PUT /identity/v3/projects/d09d64848d7e4e829edcf2f31d9e987d/users/42a9ec8fa5f84ac3af59f42b395b4dd6/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:30.814916 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3dd5a-9fae-4ee9-84b7-462f9f158ada None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:30.815242 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3dd5a-9fae-4ee9-84b7-462f9f158ada None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:30.815613 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3dd5a-9fae-4ee9-84b7-462f9f158ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:30.850725 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-90c3dd5a-9fae-4ee9-84b7-462f9f158ada None None] MFA Rules not processed for user `42a9ec8fa5f84ac3af59f42b395b4dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:30.851920 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-90c3dd5a-9fae-4ee9-84b7-462f9f158ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:30.944274 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1049/2132] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:30.958251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36977333-5904-4a61-b8a3-8a1b4edd4a5e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:30.960364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-36977333-5904-4a61-b8a3-8a1b4edd4a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:31.045592 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36977333-5904-4a61-b8a3-8a1b4edd4a5e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:31.050138 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481d880-2686-4a65-8b28-53ba80888350 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:31.050830 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481d880-2686-4a65-8b28-53ba80888350 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:31.051768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481d880-2686-4a65-8b28-53ba80888350 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:31.052062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481d880-2686-4a65-8b28-53ba80888350 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:31.059874 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:31.063435 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481d880-2686-4a65-8b28-53ba80888350 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:31.066819 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481d880-2686-4a65-8b28-53ba80888350 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:31.082621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1084/2133] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:31.862191 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3dd5a-9fae-4ee9-84b7-462f9f158ada None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:31.863753 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-90c3dd5a-9fae-4ee9-84b7-462f9f158ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:31.889105 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3dd5a-9fae-4ee9-84b7-462f9f158ada None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:31.894942 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21ffb3-12e3-421d-a52a-965ebb4b3c35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:31.895686 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21ffb3-12e3-421d-a52a-965ebb4b3c35 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:31.896202 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21ffb3-12e3-421d-a52a-965ebb4b3c35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:31.896899 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21ffb3-12e3-421d-a52a-965ebb4b3c35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:31.996763 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21ffb3-12e3-421d-a52a-965ebb4b3c35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:31.998417 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21ffb3-12e3-421d-a52a-965ebb4b3c35 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:32.011093 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1050/2134] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:37.553558 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481d880-2686-4a65-8b28-53ba80888350 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:37.569131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481d880-2686-4a65-8b28-53ba80888350 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:37.573740 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f861d13-bef1-48a3-af10-47f90e5aa5b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:37.574512 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f861d13-bef1-48a3-af10-47f90e5aa5b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:37.574899 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f861d13-bef1-48a3-af10-47f90e5aa5b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:37.575248 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f861d13-bef1-48a3-af10-47f90e5aa5b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:37.647683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f861d13-bef1-48a3-af10-47f90e5aa5b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:37.649778 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f861d13-bef1-48a3-af10-47f90e5aa5b5 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:37.661613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1085/2135] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:40.452572 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21ffb3-12e3-421d-a52a-965ebb4b3c35 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:40.534158 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21ffb3-12e3-421d-a52a-965ebb4b3c35 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:40.539233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6cb2d-5b8a-4ad8-bac1-da1c03b86990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:40.540142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6cb2d-5b8a-4ad8-bac1-da1c03b86990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:40.540416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6cb2d-5b8a-4ad8-bac1-da1c03b86990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:40.540688 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6cb2d-5b8a-4ad8-bac1-da1c03b86990 admin admin] PATH_INFO: `/v3/users/312e13d561974ce5b84c003342b22bdb` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:40.541891 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6cb2d-5b8a-4ad8-bac1-da1c03b86990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=312e13d561974ce5b84c003342b22bdb)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:40.543870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6cb2d-5b8a-4ad8-bac1-da1c03b86990 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:40.559804 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:40.611762 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-93f6cb2d-5b8a-4ad8-bac1-da1c03b86990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '312e13d561974ce5b84c003342b22bdb'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:40.630839 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-93f6cb2d-5b8a-4ad8-bac1-da1c03b86990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '312e13d561974ce5b84c003342b22bdb'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:40.649858 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-93f6cb2d-5b8a-4ad8-bac1-da1c03b86990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '312e13d561974ce5b84c003342b22bdb'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:40.660125 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-93f6cb2d-5b8a-4ad8-bac1-da1c03b86990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '312e13d561974ce5b84c003342b22bdb'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:40.661040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-93f6cb2d-5b8a-4ad8-bac1-da1c03b86990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '312e13d561974ce5b84c003342b22bdb'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:40.669622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1051/2136] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:40:40 2022] DELETE /identity/v3/users/312e13d561974ce5b84c003342b22bdb => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:40.674562 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d141ac-7c2d-444a-a8c3-e970511f13f8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:40.675106 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d141ac-7c2d-444a-a8c3-e970511f13f8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:40.675106 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d141ac-7c2d-444a-a8c3-e970511f13f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:40.697830 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-55d141ac-7c2d-444a-a8c3-e970511f13f8 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:40.700417 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-55d141ac-7c2d-444a-a8c3-e970511f13f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:40.799308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1086/2137] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:40.810011 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6cb2d-5b8a-4ad8-bac1-da1c03b86990 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:40.812413 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-93f6cb2d-5b8a-4ad8-bac1-da1c03b86990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:40.907887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6cb2d-5b8a-4ad8-bac1-da1c03b86990 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:40.912089 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69448717-690b-47b3-aa12-eb8e59df7921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:40.913070 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69448717-690b-47b3-aa12-eb8e59df7921 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:40.913571 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69448717-690b-47b3-aa12-eb8e59df7921 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:40.914507 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69448717-690b-47b3-aa12-eb8e59df7921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:40.932381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69448717-690b-47b3-aa12-eb8e59df7921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:40.935061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69448717-690b-47b3-aa12-eb8e59df7921 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:40.950122 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1052/2138] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:41.479411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d141ac-7c2d-444a-a8c3-e970511f13f8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:41.484886 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-55d141ac-7c2d-444a-a8c3-e970511f13f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:41.509653 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d141ac-7c2d-444a-a8c3-e970511f13f8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:41.517960 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d83db-dc8f-4c8c-90c4-b4c6c1fb0863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:41.518964 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d83db-dc8f-4c8c-90c4-b4c6c1fb0863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:41.519252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d83db-dc8f-4c8c-90c4-b4c6c1fb0863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:41.519533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d83db-dc8f-4c8c-90c4-b4c6c1fb0863 admin admin] PATH_INFO: `/v3/projects/90994086646146a5ae4f06ce8f364283` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:41.523642 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d83db-dc8f-4c8c-90c4-b4c6c1fb0863 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90994086646146a5ae4f06ce8f364283)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:41.526548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d83db-dc8f-4c8c-90c4-b4c6c1fb0863 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:41.609286 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-742d83db-dc8f-4c8c-90c4-b4c6c1fb0863 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90994086646146a5ae4f06ce8f364283', 'request_id': 'req-742d83db-dc8f-4c8c-90c4-b4c6c1fb0863'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:41.617491 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-742d83db-dc8f-4c8c-90c4-b4c6c1fb0863 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90994086646146a5ae4f06ce8f364283', 'request_id': 'req-742d83db-dc8f-4c8c-90c4-b4c6c1fb0863'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:41.628908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-742d83db-dc8f-4c8c-90c4-b4c6c1fb0863 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90994086646146a5ae4f06ce8f364283', 'request_id': 'req-742d83db-dc8f-4c8c-90c4-b4c6c1fb0863'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:41.644522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-742d83db-dc8f-4c8c-90c4-b4c6c1fb0863 admin admin] The token cache is being invalidate because project 90994086646146a5ae4f06ce8f364283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:40:41.644876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-742d83db-dc8f-4c8c-90c4-b4c6c1fb0863 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:41.645598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-742d83db-dc8f-4c8c-90c4-b4c6c1fb0863 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:41.647573 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1087/2139] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:40:41 2022] DELETE /identity/v3/projects/90994086646146a5ae4f06ce8f364283 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:41.652150 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69448717-690b-47b3-aa12-eb8e59df7921 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:41.664284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69448717-690b-47b3-aa12-eb8e59df7921 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:41.736212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0830e-90b6-4000-806d-9b17d14a8085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:41.737906 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0830e-90b6-4000-806d-9b17d14a8085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:41.738359 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0830e-90b6-4000-806d-9b17d14a8085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:41.738647 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0830e-90b6-4000-806d-9b17d14a8085 admin admin] PATH_INFO: `/v3/users/45f77bfa493f4f628f87f5938d686038` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:41.740240 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0830e-90b6-4000-806d-9b17d14a8085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45f77bfa493f4f628f87f5938d686038)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:41.742264 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0830e-90b6-4000-806d-9b17d14a8085 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:41.794003 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:41.810302 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-64f0830e-90b6-4000-806d-9b17d14a8085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45f77bfa493f4f628f87f5938d686038'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:41.820625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-64f0830e-90b6-4000-806d-9b17d14a8085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45f77bfa493f4f628f87f5938d686038'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:41.836072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-64f0830e-90b6-4000-806d-9b17d14a8085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45f77bfa493f4f628f87f5938d686038'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:41.845283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-64f0830e-90b6-4000-806d-9b17d14a8085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45f77bfa493f4f628f87f5938d686038'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:41.846025 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-64f0830e-90b6-4000-806d-9b17d14a8085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45f77bfa493f4f628f87f5938d686038'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:41.852899 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1053/2140] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:40:41 2022] DELETE /identity/v3/users/45f77bfa493f4f628f87f5938d686038 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:42.255356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d83db-dc8f-4c8c-90c4-b4c6c1fb0863 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:42.257549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-742d83db-dc8f-4c8c-90c4-b4c6c1fb0863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:42.280411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d83db-dc8f-4c8c-90c4-b4c6c1fb0863 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:42.305838 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:42.380878 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a6c29-cf36-40b9-84eb-3e24792f84a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:42.382043 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a6c29-cf36-40b9-84eb-3e24792f84a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:42.382649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a6c29-cf36-40b9-84eb-3e24792f84a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:42.383282 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a6c29-cf36-40b9-84eb-3e24792f84a0 admin admin] PATH_INFO: `/v3/projects/def89733b59043d999f8207fd618eafe` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:42.385161 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a6c29-cf36-40b9-84eb-3e24792f84a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=def89733b59043d999f8207fd618eafe)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:42.387242 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a6c29-cf36-40b9-84eb-3e24792f84a0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:42.468107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ef2a6c29-cf36-40b9-84eb-3e24792f84a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def89733b59043d999f8207fd618eafe', 'request_id': 'req-ef2a6c29-cf36-40b9-84eb-3e24792f84a0'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:42.475633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ef2a6c29-cf36-40b9-84eb-3e24792f84a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def89733b59043d999f8207fd618eafe', 'request_id': 'req-ef2a6c29-cf36-40b9-84eb-3e24792f84a0'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:42.486196 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ef2a6c29-cf36-40b9-84eb-3e24792f84a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def89733b59043d999f8207fd618eafe', 'request_id': 'req-ef2a6c29-cf36-40b9-84eb-3e24792f84a0'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:42.501000 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ef2a6c29-cf36-40b9-84eb-3e24792f84a0 admin admin] The token cache is being invalidate because project def89733b59043d999f8207fd618eafe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:40:42.501202 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ef2a6c29-cf36-40b9-84eb-3e24792f84a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:42.501924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ef2a6c29-cf36-40b9-84eb-3e24792f84a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:42.506396 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1088/2141] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:40:42 2022] DELETE /identity/v3/projects/def89733b59043d999f8207fd618eafe => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:42.507749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0830e-90b6-4000-806d-9b17d14a8085 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:42.509354 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-64f0830e-90b6-4000-806d-9b17d14a8085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:42.544178 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0830e-90b6-4000-806d-9b17d14a8085 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:42.620581 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151af00-156c-44ec-ad72-1f7710ddba5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:42.621527 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151af00-156c-44ec-ad72-1f7710ddba5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:42.621815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151af00-156c-44ec-ad72-1f7710ddba5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:42.622190 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151af00-156c-44ec-ad72-1f7710ddba5e admin admin] PATH_INFO: `/v3/users/42a9ec8fa5f84ac3af59f42b395b4dd6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:42.623473 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151af00-156c-44ec-ad72-1f7710ddba5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=42a9ec8fa5f84ac3af59f42b395b4dd6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:42.626244 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151af00-156c-44ec-ad72-1f7710ddba5e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:42.685861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a151af00-156c-44ec-ad72-1f7710ddba5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42a9ec8fa5f84ac3af59f42b395b4dd6'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:42.695521 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a151af00-156c-44ec-ad72-1f7710ddba5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42a9ec8fa5f84ac3af59f42b395b4dd6'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:42.712550 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a151af00-156c-44ec-ad72-1f7710ddba5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42a9ec8fa5f84ac3af59f42b395b4dd6'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:42.723485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a151af00-156c-44ec-ad72-1f7710ddba5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42a9ec8fa5f84ac3af59f42b395b4dd6'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:42.725261 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a151af00-156c-44ec-ad72-1f7710ddba5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42a9ec8fa5f84ac3af59f42b395b4dd6'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:42.735535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1054/2142] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:40:42 2022] DELETE /identity/v3/users/42a9ec8fa5f84ac3af59f42b395b4dd6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:43.104783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a6c29-cf36-40b9-84eb-3e24792f84a0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:43.106439 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ef2a6c29-cf36-40b9-84eb-3e24792f84a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:43.144467 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a6c29-cf36-40b9-84eb-3e24792f84a0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:43.242174 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1524932-0428-4eb6-8936-4b53137ac8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:43.242174 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1524932-0428-4eb6-8936-4b53137ac8f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:43.242174 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1524932-0428-4eb6-8936-4b53137ac8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:43.242174 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1524932-0428-4eb6-8936-4b53137ac8f1 admin admin] PATH_INFO: `/v3/projects/d09d64848d7e4e829edcf2f31d9e987d` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:43.242700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1524932-0428-4eb6-8936-4b53137ac8f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d09d64848d7e4e829edcf2f31d9e987d)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:43.255273 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1524932-0428-4eb6-8936-4b53137ac8f1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:43.357521 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a1524932-0428-4eb6-8936-4b53137ac8f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd09d64848d7e4e829edcf2f31d9e987d', 'request_id': 'req-a1524932-0428-4eb6-8936-4b53137ac8f1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:43.364200 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:43.371831 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a1524932-0428-4eb6-8936-4b53137ac8f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd09d64848d7e4e829edcf2f31d9e987d', 'request_id': 'req-a1524932-0428-4eb6-8936-4b53137ac8f1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:43.424155 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a1524932-0428-4eb6-8936-4b53137ac8f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd09d64848d7e4e829edcf2f31d9e987d', 'request_id': 'req-a1524932-0428-4eb6-8936-4b53137ac8f1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:43.452356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a1524932-0428-4eb6-8936-4b53137ac8f1 admin admin] The token cache is being invalidate because project d09d64848d7e4e829edcf2f31d9e987d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:40:43.453239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a1524932-0428-4eb6-8936-4b53137ac8f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:43.453974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a1524932-0428-4eb6-8936-4b53137ac8f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:43.455613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1089/2143] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:40:43 2022] DELETE /identity/v3/projects/d09d64848d7e4e829edcf2f31d9e987d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:43.461626 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fbc7b-e20f-4316-8c66-e976c0bce8ad None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:43.461917 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fbc7b-e20f-4316-8c66-e976c0bce8ad None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:43.462236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fbc7b-e20f-4316-8c66-e976c0bce8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:43.485687 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-849fbc7b-e20f-4316-8c66-e976c0bce8ad None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:43.486963 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-849fbc7b-e20f-4316-8c66-e976c0bce8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:43.528961 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:43.569643 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1055/2144] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:43.578213 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c97c4f-b396-4481-b979-67147625424a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:43.578520 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c97c4f-b396-4481-b979-67147625424a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:43.578870 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c97c4f-b396-4481-b979-67147625424a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:43.600279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-89c97c4f-b396-4481-b979-67147625424a None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:43.601600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-89c97c4f-b396-4481-b979-67147625424a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:43.610108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1090/2145] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:43.614379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fbc7b-e20f-4316-8c66-e976c0bce8ad None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:43.625228 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fbc7b-e20f-4316-8c66-e976c0bce8ad None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:43.629780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c53304-82e0-4a10-875b-87cc1f8f796e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:43.630490 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c53304-82e0-4a10-875b-87cc1f8f796e admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:43.630909 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c53304-82e0-4a10-875b-87cc1f8f796e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:43.631195 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c53304-82e0-4a10-875b-87cc1f8f796e admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:43.631941 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c53304-82e0-4a10-875b-87cc1f8f796e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:40:43.632236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c53304-82e0-4a10-875b-87cc1f8f796e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:43.633846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c53304-82e0-4a10-875b-87cc1f8f796e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:43.649480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1056/2146] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:40:43.653802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c97c4f-b396-4481-b979-67147625424a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:43.668962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c97c4f-b396-4481-b979-67147625424a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:43.674644 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c1a63-78c1-4cd8-8684-117a62b242f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:43.675791 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c1a63-78c1-4cd8-8684-117a62b242f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:43.675791 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c1a63-78c1-4cd8-8684-117a62b242f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:43.676007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c1a63-78c1-4cd8-8684-117a62b242f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:43.676968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c1a63-78c1-4cd8-8684-117a62b242f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:43.678942 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c1a63-78c1-4cd8-8684-117a62b242f5 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:43.705741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1091/2147] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:40:43 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:40:43.709300 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c53304-82e0-4a10-875b-87cc1f8f796e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:43.719875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c53304-82e0-4a10-875b-87cc1f8f796e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:43.778586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac362f5-589c-4bd6-9921-31b2403f53d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:43.779257 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac362f5-589c-4bd6-9921-31b2403f53d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:43.779543 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac362f5-589c-4bd6-9921-31b2403f53d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:43.779822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac362f5-589c-4bd6-9921-31b2403f53d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:43.780521 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac362f5-589c-4bd6-9921-31b2403f53d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:43.783101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac362f5-589c-4bd6-9921-31b2403f53d8 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:43.805058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1057/2148] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:40:43 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:40:43.809301 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c1a63-78c1-4cd8-8684-117a62b242f5 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:43.819487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c1a63-78c1-4cd8-8684-117a62b242f5 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:43.824182 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efef029-6dcc-458f-9df7-5ae9b4ca5da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:43.824831 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efef029-6dcc-458f-9df7-5ae9b4ca5da7 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:43.825115 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efef029-6dcc-458f-9df7-5ae9b4ca5da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:43.825392 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efef029-6dcc-458f-9df7-5ae9b4ca5da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:43.826153 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efef029-6dcc-458f-9df7-5ae9b4ca5da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:43.827840 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efef029-6dcc-458f-9df7-5ae9b4ca5da7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:43.838579 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1092/2149] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:43.842533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac362f5-589c-4bd6-9921-31b2403f53d8 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:43.854000 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac362f5-589c-4bd6-9921-31b2403f53d8 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:43.859380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2321e9d-db83-41b8-a7b8-d96bb25961d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:43.860055 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2321e9d-db83-41b8-a7b8-d96bb25961d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:43.860341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2321e9d-db83-41b8-a7b8-d96bb25961d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:43.860611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2321e9d-db83-41b8-a7b8-d96bb25961d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:43.861367 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2321e9d-db83-41b8-a7b8-d96bb25961d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:43.863500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2321e9d-db83-41b8-a7b8-d96bb25961d9 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:43.875223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1058/2150] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:43.879239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efef029-6dcc-458f-9df7-5ae9b4ca5da7 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:43.889374 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efef029-6dcc-458f-9df7-5ae9b4ca5da7 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:43.894398 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d07c9-a8d2-48a9-97b6-ef67e5c818d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:43.895273 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d07c9-a8d2-48a9-97b6-ef67e5c818d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:43.895640 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d07c9-a8d2-48a9-97b6-ef67e5c818d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:43.895922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d07c9-a8d2-48a9-97b6-ef67e5c818d7 admin admin] PATH_INFO: `/v3/projects/517fdf9213ca4313b8a880d6927447c4/users/68fefa1a2abb48a5b030579ac38f4f9d/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:43.911226 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d07c9-a8d2-48a9-97b6-ef67e5c818d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=517fdf9213ca4313b8a880d6927447c4, user_id=68fefa1a2abb48a5b030579ac38f4f9d, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:43.914185 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d07c9-a8d2-48a9-97b6-ef67e5c818d7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:43.928330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1093/2151] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:40:43 2022] PUT /identity/v3/projects/517fdf9213ca4313b8a880d6927447c4/users/68fefa1a2abb48a5b030579ac38f4f9d/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:43.940331 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c78b8a-0edb-4bda-93ca-6f4455c0517e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:43.940625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c78b8a-0edb-4bda-93ca-6f4455c0517e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:43.940906 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c78b8a-0edb-4bda-93ca-6f4455c0517e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:43.971764 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e6c78b8a-0edb-4bda-93ca-6f4455c0517e None None] MFA Rules not processed for user `68fefa1a2abb48a5b030579ac38f4f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:43.972988 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e6c78b8a-0edb-4bda-93ca-6f4455c0517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:44.036135 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1059/2152] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:44.041144 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d07c9-a8d2-48a9-97b6-ef67e5c818d7 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:44.102706 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d07c9-a8d2-48a9-97b6-ef67e5c818d7 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:44.107300 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19262cbc-eb4a-4984-8645-0cfe40e53dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:44.108028 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19262cbc-eb4a-4984-8645-0cfe40e53dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:44.108318 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19262cbc-eb4a-4984-8645-0cfe40e53dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:44.108602 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19262cbc-eb4a-4984-8645-0cfe40e53dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:44.109667 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19262cbc-eb4a-4984-8645-0cfe40e53dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:44.111618 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19262cbc-eb4a-4984-8645-0cfe40e53dd1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:44.137513 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1094/2153] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:40:44 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:40:44.142504 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c78b8a-0edb-4bda-93ca-6f4455c0517e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:44.153120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c78b8a-0edb-4bda-93ca-6f4455c0517e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:44.179420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:44.211880 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1d906-ab3d-41bd-bc17-9b7714ce6274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:44.212544 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1d906-ab3d-41bd-bc17-9b7714ce6274 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:44.212828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1d906-ab3d-41bd-bc17-9b7714ce6274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:44.213101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1d906-ab3d-41bd-bc17-9b7714ce6274 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:44.213777 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1d906-ab3d-41bd-bc17-9b7714ce6274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:44.215754 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1d906-ab3d-41bd-bc17-9b7714ce6274 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:44.236036 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1060/2154] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:40:44 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:40:44.240114 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19262cbc-eb4a-4984-8645-0cfe40e53dd1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:44.250406 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19262cbc-eb4a-4984-8645-0cfe40e53dd1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:44.255416 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b50057-9300-46d7-82db-9051edd5b252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:44.256072 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b50057-9300-46d7-82db-9051edd5b252 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:44.256356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b50057-9300-46d7-82db-9051edd5b252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:44.256634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b50057-9300-46d7-82db-9051edd5b252 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:44.257356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b50057-9300-46d7-82db-9051edd5b252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:44.259011 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b50057-9300-46d7-82db-9051edd5b252 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:44.270820 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1095/2155] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:44.275009 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1d906-ab3d-41bd-bc17-9b7714ce6274 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:44.285774 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1d906-ab3d-41bd-bc17-9b7714ce6274 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:44.291421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af6f25-5f1e-4015-8b4c-8c3593a20e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:44.292289 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af6f25-5f1e-4015-8b4c-8c3593a20e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:44.292571 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af6f25-5f1e-4015-8b4c-8c3593a20e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:44.292847 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af6f25-5f1e-4015-8b4c-8c3593a20e24 admin admin] PATH_INFO: `/v3/projects/627849210cbf4cf9b382f1f949013d20/users/160ad4e5af8f40aaaaa1c24546da8140/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:44.307721 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af6f25-5f1e-4015-8b4c-8c3593a20e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=627849210cbf4cf9b382f1f949013d20, user_id=160ad4e5af8f40aaaaa1c24546da8140, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:44.310412 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af6f25-5f1e-4015-8b4c-8c3593a20e24 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:44.323510 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1061/2156] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:40:44 2022] PUT /identity/v3/projects/627849210cbf4cf9b382f1f949013d20/users/160ad4e5af8f40aaaaa1c24546da8140/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:44.328031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b50057-9300-46d7-82db-9051edd5b252 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:44.338858 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b50057-9300-46d7-82db-9051edd5b252 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:44.385787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:44.400717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce328861-6fb3-4e7c-b57d-4674a24702f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:44.401392 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce328861-6fb3-4e7c-b57d-4674a24702f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:44.401688 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce328861-6fb3-4e7c-b57d-4674a24702f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:44.401971 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce328861-6fb3-4e7c-b57d-4674a24702f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:44.402732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce328861-6fb3-4e7c-b57d-4674a24702f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:44.404340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce328861-6fb3-4e7c-b57d-4674a24702f0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:44.415629 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1096/2157] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:44.419211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af6f25-5f1e-4015-8b4c-8c3593a20e24 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:44.429699 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af6f25-5f1e-4015-8b4c-8c3593a20e24 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:44.434590 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261be2b-e717-4549-9b21-6883660ed254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:44.435516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261be2b-e717-4549-9b21-6883660ed254 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:44.435804 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261be2b-e717-4549-9b21-6883660ed254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:44.436083 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261be2b-e717-4549-9b21-6883660ed254 admin admin] PATH_INFO: `/v3/projects/627849210cbf4cf9b382f1f949013d20/users/160ad4e5af8f40aaaaa1c24546da8140/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:44.438751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261be2b-e717-4549-9b21-6883660ed254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=627849210cbf4cf9b382f1f949013d20, user_id=160ad4e5af8f40aaaaa1c24546da8140, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:44.441408 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261be2b-e717-4549-9b21-6883660ed254 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:44.451952 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1062/2158] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:40:44 2022] PUT /identity/v3/projects/627849210cbf4cf9b382f1f949013d20/users/160ad4e5af8f40aaaaa1c24546da8140/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:44.463788 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ae6cc-d9d9-4832-8642-8370c2b5ca8d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:44.464085 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ae6cc-d9d9-4832-8642-8370c2b5ca8d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:44.464370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ae6cc-d9d9-4832-8642-8370c2b5ca8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:44.490269 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-bf7ae6cc-d9d9-4832-8642-8370c2b5ca8d None None] MFA Rules not processed for user `160ad4e5af8f40aaaaa1c24546da8140`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:44.491490 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-bf7ae6cc-d9d9-4832-8642-8370c2b5ca8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:44.568594 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1097/2159] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:44.580095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261be2b-e717-4549-9b21-6883660ed254 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:44.581878 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5261be2b-e717-4549-9b21-6883660ed254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:44.639266 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261be2b-e717-4549-9b21-6883660ed254 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:44.643423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac45ea-7998-4b69-a77e-24b3dda04b8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:44.644063 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac45ea-7998-4b69-a77e-24b3dda04b8e service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:44.644345 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac45ea-7998-4b69-a77e-24b3dda04b8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:44.644619 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac45ea-7998-4b69-a77e-24b3dda04b8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:44.653528 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac45ea-7998-4b69-a77e-24b3dda04b8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:44.654994 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac45ea-7998-4b69-a77e-24b3dda04b8e service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:44.664881 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1063/2160] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:45.240557 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ae6cc-d9d9-4832-8642-8370c2b5ca8d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:45.309834 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ae6cc-d9d9-4832-8642-8370c2b5ca8d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:45.315199 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429059c-66d0-4081-8109-52fa8b26e5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:45.316093 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429059c-66d0-4081-8109-52fa8b26e5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:45.316382 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429059c-66d0-4081-8109-52fa8b26e5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:45.316661 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429059c-66d0-4081-8109-52fa8b26e5e3 admin admin] PATH_INFO: `/v3/users/68fefa1a2abb48a5b030579ac38f4f9d` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:45.317891 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429059c-66d0-4081-8109-52fa8b26e5e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68fefa1a2abb48a5b030579ac38f4f9d)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:45.319908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429059c-66d0-4081-8109-52fa8b26e5e3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:45.366905 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5429059c-66d0-4081-8109-52fa8b26e5e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68fefa1a2abb48a5b030579ac38f4f9d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:45.367556 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5429059c-66d0-4081-8109-52fa8b26e5e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68fefa1a2abb48a5b030579ac38f4f9d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:45.374641 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5429059c-66d0-4081-8109-52fa8b26e5e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68fefa1a2abb48a5b030579ac38f4f9d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:45.382888 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5429059c-66d0-4081-8109-52fa8b26e5e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68fefa1a2abb48a5b030579ac38f4f9d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:45.392046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:45.399749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5429059c-66d0-4081-8109-52fa8b26e5e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68fefa1a2abb48a5b030579ac38f4f9d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:45.407436 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1098/2161] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:40:45 2022] DELETE /identity/v3/users/68fefa1a2abb48a5b030579ac38f4f9d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:45.412518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3b8d6-85e0-4faa-85a3-6f31b8f0832d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:45.413207 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3b8d6-85e0-4faa-85a3-6f31b8f0832d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:45.413207 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3b8d6-85e0-4faa-85a3-6f31b8f0832d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:45.432338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-52b3b8d6-85e0-4faa-85a3-6f31b8f0832d None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:45.433558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-52b3b8d6-85e0-4faa-85a3-6f31b8f0832d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:45.492841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1064/2162] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:45.503032 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429059c-66d0-4081-8109-52fa8b26e5e3 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:45.504461 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5429059c-66d0-4081-8109-52fa8b26e5e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:45.563203 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429059c-66d0-4081-8109-52fa8b26e5e3 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:45.566811 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fdc8b-8692-4f50-98f4-ce8104934618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:45.567460 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fdc8b-8692-4f50-98f4-ce8104934618 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:45.567745 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fdc8b-8692-4f50-98f4-ce8104934618 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:45.568021 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fdc8b-8692-4f50-98f4-ce8104934618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:45.577165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fdc8b-8692-4f50-98f4-ce8104934618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:45.579293 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fdc8b-8692-4f50-98f4-ce8104934618 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:45.588987 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1099/2163] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:45.872849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3b8d6-85e0-4faa-85a3-6f31b8f0832d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:45.874864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-52b3b8d6-85e0-4faa-85a3-6f31b8f0832d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:45.888535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3b8d6-85e0-4faa-85a3-6f31b8f0832d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:45.894297 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e74d72-ce71-4402-a5f7-3359da4579fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:45.895180 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e74d72-ce71-4402-a5f7-3359da4579fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:45.895468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e74d72-ce71-4402-a5f7-3359da4579fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:45.896457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e74d72-ce71-4402-a5f7-3359da4579fe admin admin] PATH_INFO: `/v3/projects/517fdf9213ca4313b8a880d6927447c4` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:45.898138 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e74d72-ce71-4402-a5f7-3359da4579fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=517fdf9213ca4313b8a880d6927447c4)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:45.899985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e74d72-ce71-4402-a5f7-3359da4579fe admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:45.922395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:45.949938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-99e74d72-ce71-4402-a5f7-3359da4579fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '517fdf9213ca4313b8a880d6927447c4', 'request_id': 'req-99e74d72-ce71-4402-a5f7-3359da4579fe'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:45.956876 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-99e74d72-ce71-4402-a5f7-3359da4579fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '517fdf9213ca4313b8a880d6927447c4', 'request_id': 'req-99e74d72-ce71-4402-a5f7-3359da4579fe'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:45.962452 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-99e74d72-ce71-4402-a5f7-3359da4579fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '517fdf9213ca4313b8a880d6927447c4', 'request_id': 'req-99e74d72-ce71-4402-a5f7-3359da4579fe'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:45.974694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-99e74d72-ce71-4402-a5f7-3359da4579fe admin admin] The token cache is being invalidate because project 517fdf9213ca4313b8a880d6927447c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:40:45.974849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-99e74d72-ce71-4402-a5f7-3359da4579fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:45.975391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-99e74d72-ce71-4402-a5f7-3359da4579fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:45.976918 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1065/2164] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:40:45 2022] DELETE /identity/v3/projects/517fdf9213ca4313b8a880d6927447c4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:45.980975 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fdc8b-8692-4f50-98f4-ce8104934618 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:45.990824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fdc8b-8692-4f50-98f4-ce8104934618 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:46.049092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48f421-dcb0-4035-997f-37dbc220cec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:46.049951 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48f421-dcb0-4035-997f-37dbc220cec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:46.050279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48f421-dcb0-4035-997f-37dbc220cec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:46.050552 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48f421-dcb0-4035-997f-37dbc220cec9 admin admin] PATH_INFO: `/v3/users/160ad4e5af8f40aaaaa1c24546da8140` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:46.051716 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48f421-dcb0-4035-997f-37dbc220cec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=160ad4e5af8f40aaaaa1c24546da8140)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:46.053715 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48f421-dcb0-4035-997f-37dbc220cec9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:46.100731 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3a48f421-dcb0-4035-997f-37dbc220cec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '160ad4e5af8f40aaaaa1c24546da8140'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:46.101392 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3a48f421-dcb0-4035-997f-37dbc220cec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '160ad4e5af8f40aaaaa1c24546da8140'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:46.108588 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3a48f421-dcb0-4035-997f-37dbc220cec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '160ad4e5af8f40aaaaa1c24546da8140'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:46.116985 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3a48f421-dcb0-4035-997f-37dbc220cec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '160ad4e5af8f40aaaaa1c24546da8140'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:46.129541 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3a48f421-dcb0-4035-997f-37dbc220cec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '160ad4e5af8f40aaaaa1c24546da8140'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:46.135540 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1100/2165] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:40:45 2022] DELETE /identity/v3/users/160ad4e5af8f40aaaaa1c24546da8140 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:46.544903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e74d72-ce71-4402-a5f7-3359da4579fe admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:46.548505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-99e74d72-ce71-4402-a5f7-3359da4579fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:46.567512 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e74d72-ce71-4402-a5f7-3359da4579fe admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:46.657347 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6be00-37e7-40cd-a2f8-39a1430317d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:46.658428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6be00-37e7-40cd-a2f8-39a1430317d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:46.658709 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6be00-37e7-40cd-a2f8-39a1430317d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:46.659002 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6be00-37e7-40cd-a2f8-39a1430317d9 admin admin] PATH_INFO: `/v3/projects/627849210cbf4cf9b382f1f949013d20` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:46.660253 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6be00-37e7-40cd-a2f8-39a1430317d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=627849210cbf4cf9b382f1f949013d20)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:46.662248 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6be00-37e7-40cd-a2f8-39a1430317d9 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:46.766993 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-62a6be00-37e7-40cd-a2f8-39a1430317d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '627849210cbf4cf9b382f1f949013d20', 'request_id': 'req-62a6be00-37e7-40cd-a2f8-39a1430317d9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:46.780577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-62a6be00-37e7-40cd-a2f8-39a1430317d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '627849210cbf4cf9b382f1f949013d20', 'request_id': 'req-62a6be00-37e7-40cd-a2f8-39a1430317d9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:46.787874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-62a6be00-37e7-40cd-a2f8-39a1430317d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '627849210cbf4cf9b382f1f949013d20', 'request_id': 'req-62a6be00-37e7-40cd-a2f8-39a1430317d9'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:46.804684 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-62a6be00-37e7-40cd-a2f8-39a1430317d9 admin admin] The token cache is being invalidate because project 627849210cbf4cf9b382f1f949013d20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:40:46.804998 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-62a6be00-37e7-40cd-a2f8-39a1430317d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:46.805821 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-62a6be00-37e7-40cd-a2f8-39a1430317d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:46.807552 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1066/2166] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:40:46 2022] DELETE /identity/v3/projects/627849210cbf4cf9b382f1f949013d20 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:46.812461 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0900e2-86bc-4c4a-ba9a-08050f5578ea None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:46.813231 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0900e2-86bc-4c4a-ba9a-08050f5578ea None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:46.813231 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0900e2-86bc-4c4a-ba9a-08050f5578ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:46.833952 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-af0900e2-86bc-4c4a-ba9a-08050f5578ea None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:46.835406 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-af0900e2-86bc-4c4a-ba9a-08050f5578ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:46.841267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:46.911162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1101/2167] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:46.919975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d2169-c948-45d5-8c85-6c4170d6dd9b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:46.920280 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d2169-c948-45d5-8c85-6c4170d6dd9b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:46.920555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d2169-c948-45d5-8c85-6c4170d6dd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:46.945193 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-bf3d2169-c948-45d5-8c85-6c4170d6dd9b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:46.947080 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bf3d2169-c948-45d5-8c85-6c4170d6dd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:46.966615 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1067/2168] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:46.972968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0900e2-86bc-4c4a-ba9a-08050f5578ea None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:46.984290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0900e2-86bc-4c4a-ba9a-08050f5578ea None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:46.989610 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0752c6-ec1c-4314-b798-1a08d823692f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:46.990409 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0752c6-ec1c-4314-b798-1a08d823692f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:46.990764 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0752c6-ec1c-4314-b798-1a08d823692f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:46.991216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0752c6-ec1c-4314-b798-1a08d823692f admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:46.992207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0752c6-ec1c-4314-b798-1a08d823692f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:40:46.992709 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0752c6-ec1c-4314-b798-1a08d823692f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:46.994542 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0752c6-ec1c-4314-b798-1a08d823692f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:47.008992 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1102/2169] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:40:47.013262 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d2169-c948-45d5-8c85-6c4170d6dd9b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:47.029872 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d2169-c948-45d5-8c85-6c4170d6dd9b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:47.036595 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d024b-deec-461a-8e5c-589a60bb9a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:47.037269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d024b-deec-461a-8e5c-589a60bb9a89 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:47.037560 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d024b-deec-461a-8e5c-589a60bb9a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:47.037843 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d024b-deec-461a-8e5c-589a60bb9a89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:47.038591 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d024b-deec-461a-8e5c-589a60bb9a89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:47.041120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d024b-deec-461a-8e5c-589a60bb9a89 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:47.073624 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1068/2170] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:40:47 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:40:47.078577 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0752c6-ec1c-4314-b798-1a08d823692f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:47.089091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0752c6-ec1c-4314-b798-1a08d823692f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:47.154433 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370df446-fedc-4a0c-8672-c6283a497100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:47.155109 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370df446-fedc-4a0c-8672-c6283a497100 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:47.155391 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370df446-fedc-4a0c-8672-c6283a497100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:47.156339 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370df446-fedc-4a0c-8672-c6283a497100 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:47.157203 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370df446-fedc-4a0c-8672-c6283a497100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:47.159182 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370df446-fedc-4a0c-8672-c6283a497100 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:47.181614 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1103/2171] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:40:47 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:40:47.185669 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d024b-deec-461a-8e5c-589a60bb9a89 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:47.196712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d024b-deec-461a-8e5c-589a60bb9a89 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:47.201400 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5ac96-32d3-4982-88ff-c5c4087672ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:47.202060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5ac96-32d3-4982-88ff-c5c4087672ed admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:47.202393 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5ac96-32d3-4982-88ff-c5c4087672ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:47.203577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5ac96-32d3-4982-88ff-c5c4087672ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:47.204317 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5ac96-32d3-4982-88ff-c5c4087672ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:47.205932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5ac96-32d3-4982-88ff-c5c4087672ed admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:47.208164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:47.221465 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1069/2172] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:47.222836 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370df446-fedc-4a0c-8672-c6283a497100 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:47.233142 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370df446-fedc-4a0c-8672-c6283a497100 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:47.239726 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e7e27-d6d9-4ab5-9e4d-b6a6a0bb17bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:47.240593 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e7e27-d6d9-4ab5-9e4d-b6a6a0bb17bd admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:47.240876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e7e27-d6d9-4ab5-9e4d-b6a6a0bb17bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:47.241208 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e7e27-d6d9-4ab5-9e4d-b6a6a0bb17bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:47.242549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e7e27-d6d9-4ab5-9e4d-b6a6a0bb17bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:47.244160 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e7e27-d6d9-4ab5-9e4d-b6a6a0bb17bd admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:47.255427 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1104/2173] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:47.259488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5ac96-32d3-4982-88ff-c5c4087672ed admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:47.270673 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5ac96-32d3-4982-88ff-c5c4087672ed admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:47.275745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fc5c0-ec60-4c07-a02d-58e410cb9431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:47.276630 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fc5c0-ec60-4c07-a02d-58e410cb9431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:47.276945 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fc5c0-ec60-4c07-a02d-58e410cb9431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:47.277225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fc5c0-ec60-4c07-a02d-58e410cb9431 admin admin] PATH_INFO: `/v3/projects/f47e40b4c6c84622b324fb8b947ac6c7/users/7969e3787b1c4c94bed6871c5a78e2b3/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:47.294673 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fc5c0-ec60-4c07-a02d-58e410cb9431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f47e40b4c6c84622b324fb8b947ac6c7, user_id=7969e3787b1c4c94bed6871c5a78e2b3, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:47.298117 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fc5c0-ec60-4c07-a02d-58e410cb9431 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:47.313689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1070/2174] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:40:47 2022] PUT /identity/v3/projects/f47e40b4c6c84622b324fb8b947ac6c7/users/7969e3787b1c4c94bed6871c5a78e2b3/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:47.325810 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526a5a5-5d26-4bee-a611-5018c25895eb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:47.326137 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526a5a5-5d26-4bee-a611-5018c25895eb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:47.326425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526a5a5-5d26-4bee-a611-5018c25895eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:47.356481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2526a5a5-5d26-4bee-a611-5018c25895eb None None] MFA Rules not processed for user `7969e3787b1c4c94bed6871c5a78e2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:47.358032 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2526a5a5-5d26-4bee-a611-5018c25895eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:47.425839 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1105/2175] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:47.437482 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fc5c0-ec60-4c07-a02d-58e410cb9431 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:47.439410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6a1fc5c0-ec60-4c07-a02d-58e410cb9431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:47.497196 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fc5c0-ec60-4c07-a02d-58e410cb9431 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:47.501558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c1bcb-6a5f-4f42-bd2d-1b6d7318399a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:47.502289 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c1bcb-6a5f-4f42-bd2d-1b6d7318399a service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:47.502575 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c1bcb-6a5f-4f42-bd2d-1b6d7318399a service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:47.502863 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c1bcb-6a5f-4f42-bd2d-1b6d7318399a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:47.511750 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c1bcb-6a5f-4f42-bd2d-1b6d7318399a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:47.513176 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9c1bcb-6a5f-4f42-bd2d-1b6d7318399a service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:47.523102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1071/2176] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:47.746428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526a5a5-5d26-4bee-a611-5018c25895eb None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:47.748207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2526a5a5-5d26-4bee-a611-5018c25895eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:47.761541 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:47.869896 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526a5a5-5d26-4bee-a611-5018c25895eb None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:47.875542 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d00561-82a3-4c2f-9a42-5c7ec61cb9e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:47.876206 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d00561-82a3-4c2f-9a42-5c7ec61cb9e5 service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:47.876489 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d00561-82a3-4c2f-9a42-5c7ec61cb9e5 service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:47.876760 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d00561-82a3-4c2f-9a42-5c7ec61cb9e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:47.878645 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-65d00561-82a3-4c2f-9a42-5c7ec61cb9e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:47.891115 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d00561-82a3-4c2f-9a42-5c7ec61cb9e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:47.892557 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d00561-82a3-4c2f-9a42-5c7ec61cb9e5 service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:47.903001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1106/2177] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:48.927714 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d281-fd08-4516-bf72-26dc840c19e3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:48.928213 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d281-fd08-4516-bf72-26dc840c19e3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:48.928316 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d281-fd08-4516-bf72-26dc840c19e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:48.951527 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c9a1d281-fd08-4516-bf72-26dc840c19e3 None None] MFA Rules not processed for user `8103402ac83c4b4191a3ec4d55038e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:48.952885 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c9a1d281-fd08-4516-bf72-26dc840c19e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:49.026376 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1072/2178] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jul 14 15:40:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:49.042610 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d00561-82a3-4c2f-9a42-5c7ec61cb9e5 service placement] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:49.046151 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-65d00561-82a3-4c2f-9a42-5c7ec61cb9e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:49.131113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d00561-82a3-4c2f-9a42-5c7ec61cb9e5 service placement] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:49.136593 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1cc0d-07e0-48af-9ac7-5439cac69409 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edbbc94ca71c42c0aac562c8c2ec83db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:49.137401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1cc0d-07e0-48af-9ac7-5439cac69409 service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:49.137764 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1cc0d-07e0-48af-9ac7-5439cac69409 service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:49.138152 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1cc0d-07e0-48af-9ac7-5439cac69409 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:49.148742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1cc0d-07e0-48af-9ac7-5439cac69409 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:49.150567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1cc0d-07e0-48af-9ac7-5439cac69409 service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:49.160395 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1107/2179] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jul 14 15:40:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:40:49.891610 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f842db-7601-40b0-b64d-cce948b3c0bc None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:49.891939 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f842db-7601-40b0-b64d-cce948b3c0bc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:49.892226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f842db-7601-40b0-b64d-cce948b3c0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:49.911508 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-38f842db-7601-40b0-b64d-cce948b3c0bc None None] MFA Rules not processed for user `c7527df3bd954e939aa9dc63d7664e30`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:49.912647 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-38f842db-7601-40b0-b64d-cce948b3c0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:49.973729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1073/2180] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:51.196539 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1cc0d-07e0-48af-9ac7-5439cac69409 service swift] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:51.198035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2ec1cc0d-07e0-48af-9ac7-5439cac69409 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:51.270619 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1cc0d-07e0-48af-9ac7-5439cac69409 service swift] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:51.275512 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71966e-a7ab-4aad-b061-51bfa16220d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:51.276380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71966e-a7ab-4aad-b061-51bfa16220d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:51.276664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71966e-a7ab-4aad-b061-51bfa16220d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:51.276940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71966e-a7ab-4aad-b061-51bfa16220d7 admin admin] PATH_INFO: `/v3/users/ea35144aa9164de3a94173a64650fd50` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:51.278223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71966e-a7ab-4aad-b061-51bfa16220d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea35144aa9164de3a94173a64650fd50)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:51.280234 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71966e-a7ab-4aad-b061-51bfa16220d7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:51.312474 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:51.339638 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cd71966e-a7ab-4aad-b061-51bfa16220d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea35144aa9164de3a94173a64650fd50'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:51.340298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cd71966e-a7ab-4aad-b061-51bfa16220d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea35144aa9164de3a94173a64650fd50'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:51.348373 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cd71966e-a7ab-4aad-b061-51bfa16220d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea35144aa9164de3a94173a64650fd50'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:51.355782 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cd71966e-a7ab-4aad-b061-51bfa16220d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea35144aa9164de3a94173a64650fd50'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:51.368976 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cd71966e-a7ab-4aad-b061-51bfa16220d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea35144aa9164de3a94173a64650fd50'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:51.375352 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1108/2181] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:40:51 2022] DELETE /identity/v3/users/ea35144aa9164de3a94173a64650fd50 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:51.552123 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f842db-7601-40b0-b64d-cce948b3c0bc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:51.563598 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f842db-7601-40b0-b64d-cce948b3c0bc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:51.589792 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:51.623285 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc9f2a-1edf-4354-9d25-c77d89609415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:51.624323 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc9f2a-1edf-4354-9d25-c77d89609415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:51.624581 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc9f2a-1edf-4354-9d25-c77d89609415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:51.625040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc9f2a-1edf-4354-9d25-c77d89609415 admin admin] PATH_INFO: `/v3/projects/a7b0366910d7445d98c67365c5ca6ccb` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:51.626273 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc9f2a-1edf-4354-9d25-c77d89609415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7b0366910d7445d98c67365c5ca6ccb)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:51.628230 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc9f2a-1edf-4354-9d25-c77d89609415 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:51.675367 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-63fc9f2a-1edf-4354-9d25-c77d89609415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7b0366910d7445d98c67365c5ca6ccb', 'request_id': 'req-63fc9f2a-1edf-4354-9d25-c77d89609415'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:51.681908 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-63fc9f2a-1edf-4354-9d25-c77d89609415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7b0366910d7445d98c67365c5ca6ccb', 'request_id': 'req-63fc9f2a-1edf-4354-9d25-c77d89609415'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:51.687492 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-63fc9f2a-1edf-4354-9d25-c77d89609415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7b0366910d7445d98c67365c5ca6ccb', 'request_id': 'req-63fc9f2a-1edf-4354-9d25-c77d89609415'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:51.700394 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-63fc9f2a-1edf-4354-9d25-c77d89609415 admin admin] The token cache is being invalidate because project a7b0366910d7445d98c67365c5ca6ccb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:40:51.700685 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-63fc9f2a-1edf-4354-9d25-c77d89609415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:51.701306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-63fc9f2a-1edf-4354-9d25-c77d89609415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:51.703695 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1074/2182] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:40:51 2022] DELETE /identity/v3/projects/a7b0366910d7445d98c67365c5ca6ccb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:51.708558 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdd9df-1635-422d-9181-696278d196fc None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:51.708856 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdd9df-1635-422d-9181-696278d196fc None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:51.709137 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdd9df-1635-422d-9181-696278d196fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:51.728625 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-59cdd9df-1635-422d-9181-696278d196fc None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:51.729752 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-59cdd9df-1635-422d-9181-696278d196fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:51.798441 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1109/2183] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:51.805978 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5daf85-a4be-43ec-99a5-de5bf70e521b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:51.806353 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5daf85-a4be-43ec-99a5-de5bf70e521b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:51.806641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5daf85-a4be-43ec-99a5-de5bf70e521b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:51.824915 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-bd5daf85-a4be-43ec-99a5-de5bf70e521b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:51.826176 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bd5daf85-a4be-43ec-99a5-de5bf70e521b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:51.834967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1075/2184] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:51.839170 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cdd9df-1635-422d-9181-696278d196fc None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:51.849578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cdd9df-1635-422d-9181-696278d196fc None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:51.854113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e423f2c-949d-4701-97fb-5173e85135d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:51.854757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e423f2c-949d-4701-97fb-5173e85135d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:51.855037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e423f2c-949d-4701-97fb-5173e85135d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:51.855309 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e423f2c-949d-4701-97fb-5173e85135d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:51.856021 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e423f2c-949d-4701-97fb-5173e85135d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:40:51.856324 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e423f2c-949d-4701-97fb-5173e85135d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:51.857934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e423f2c-949d-4701-97fb-5173e85135d3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:51.871631 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1110/2185] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:40:51.876495 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5daf85-a4be-43ec-99a5-de5bf70e521b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:51.887267 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5daf85-a4be-43ec-99a5-de5bf70e521b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:51.892707 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d62c4c-f5c4-41f4-b40f-aa1a79e538e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:51.893362 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d62c4c-f5c4-41f4-b40f-aa1a79e538e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:51.893643 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d62c4c-f5c4-41f4-b40f-aa1a79e538e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:51.893917 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d62c4c-f5c4-41f4-b40f-aa1a79e538e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:51.894663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d62c4c-f5c4-41f4-b40f-aa1a79e538e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:51.896558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d62c4c-f5c4-41f4-b40f-aa1a79e538e9 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:51.924507 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1076/2186] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:40:51 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:40:51.928711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e423f2c-949d-4701-97fb-5173e85135d3 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:51.939566 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e423f2c-949d-4701-97fb-5173e85135d3 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:52.001653 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc045b-d9ab-4509-965a-5f88e29f7275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:52.002354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc045b-d9ab-4509-965a-5f88e29f7275 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:52.002646 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc045b-d9ab-4509-965a-5f88e29f7275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:52.002916 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc045b-d9ab-4509-965a-5f88e29f7275 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:52.003626 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc045b-d9ab-4509-965a-5f88e29f7275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:52.005531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc045b-d9ab-4509-965a-5f88e29f7275 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:52.025654 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1111/2187] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:40:51 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:40:52.029828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d62c4c-f5c4-41f4-b40f-aa1a79e538e9 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:52.041113 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d62c4c-f5c4-41f4-b40f-aa1a79e538e9 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:52.045708 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fe849-0c52-480b-9ff4-2378ef39f870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:52.046438 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fe849-0c52-480b-9ff4-2378ef39f870 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:52.046750 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fe849-0c52-480b-9ff4-2378ef39f870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:52.047024 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fe849-0c52-480b-9ff4-2378ef39f870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:52.047858 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96fe849-0c52-480b-9ff4-2378ef39f870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:52.049560 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96fe849-0c52-480b-9ff4-2378ef39f870 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:52.060207 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1077/2188] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:52.064908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc045b-d9ab-4509-965a-5f88e29f7275 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:52.075058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc045b-d9ab-4509-965a-5f88e29f7275 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:52.080653 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef455a-7c97-49fc-9dc5-81c5d3ac9efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:52.081337 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef455a-7c97-49fc-9dc5-81c5d3ac9efa admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:52.081624 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef455a-7c97-49fc-9dc5-81c5d3ac9efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:52.081908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef455a-7c97-49fc-9dc5-81c5d3ac9efa admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:52.082898 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef455a-7c97-49fc-9dc5-81c5d3ac9efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:52.084308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef455a-7c97-49fc-9dc5-81c5d3ac9efa admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:52.095118 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1112/2189] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:52.099332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fe849-0c52-480b-9ff4-2378ef39f870 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:52.110099 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fe849-0c52-480b-9ff4-2378ef39f870 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:52.114999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e957b-5b7f-419e-9448-2b078f64fca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:52.115914 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e957b-5b7f-419e-9448-2b078f64fca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:52.116200 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e957b-5b7f-419e-9448-2b078f64fca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:52.116480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e957b-5b7f-419e-9448-2b078f64fca2 admin admin] PATH_INFO: `/v3/projects/95e9d5494fe84dc3a36b7352535bccf7/users/221d83c6dbb845fda216ea043b301c54/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:52.131647 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e957b-5b7f-419e-9448-2b078f64fca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e9d5494fe84dc3a36b7352535bccf7, user_id=221d83c6dbb845fda216ea043b301c54, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:52.134425 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e957b-5b7f-419e-9448-2b078f64fca2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:52.148359 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1078/2190] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:40:52 2022] PUT /identity/v3/projects/95e9d5494fe84dc3a36b7352535bccf7/users/221d83c6dbb845fda216ea043b301c54/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:52.153384 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea756d0c-ea46-494b-be0c-ebe33c5ac66d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:52.153682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea756d0c-ea46-494b-be0c-ebe33c5ac66d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:52.153969 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea756d0c-ea46-494b-be0c-ebe33c5ac66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:52.172171 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ea756d0c-ea46-494b-be0c-ebe33c5ac66d None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:52.173382 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ea756d0c-ea46-494b-be0c-ebe33c5ac66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:52.178493 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:52.235853 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1113/2191] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:52.245473 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e957b-5b7f-419e-9448-2b078f64fca2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:52.247254 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1a4e957b-5b7f-419e-9448-2b078f64fca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:52.307237 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e957b-5b7f-419e-9448-2b078f64fca2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:52.310921 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a0b26-0a6a-4e51-882b-ea89e2410559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:52.311559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a0b26-0a6a-4e51-882b-ea89e2410559 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:52.312635 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a0b26-0a6a-4e51-882b-ea89e2410559 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:52.313013 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a0b26-0a6a-4e51-882b-ea89e2410559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:52.321228 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:52.323763 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a0b26-0a6a-4e51-882b-ea89e2410559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:52.325710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a0b26-0a6a-4e51-882b-ea89e2410559 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:52.337905 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1079/2192] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:52.985341 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd57dd5-994f-4bed-9b86-8c5ac040116a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:52.985892 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd57dd5-994f-4bed-9b86-8c5ac040116a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:52.986406 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd57dd5-994f-4bed-9b86-8c5ac040116a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:53.013552 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6fd57dd5-994f-4bed-9b86-8c5ac040116a None None] MFA Rules not processed for user `221d83c6dbb845fda216ea043b301c54`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:53.015291 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6fd57dd5-994f-4bed-9b86-8c5ac040116a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:53.090602 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1114/2193] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:53.103816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a0b26-0a6a-4e51-882b-ea89e2410559 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:53.105418 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7b0a0b26-0a6a-4e51-882b-ea89e2410559 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:53.166717 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a0b26-0a6a-4e51-882b-ea89e2410559 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:53.170567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e38cb-83c3-429c-873c-550b4001cee4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:53.171284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e38cb-83c3-429c-873c-550b4001cee4 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:53.171566 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e38cb-83c3-429c-873c-550b4001cee4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:53.171843 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e38cb-83c3-429c-873c-550b4001cee4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:53.180988 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e38cb-83c3-429c-873c-550b4001cee4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:53.182495 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e38cb-83c3-429c-873c-550b4001cee4 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:53.191904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1080/2194] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:55.611506 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadec2b-97b9-4ed9-a3b1-381e1b0ebf27 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:55.611939 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadec2b-97b9-4ed9-a3b1-381e1b0ebf27 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:55.612018 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadec2b-97b9-4ed9-a3b1-381e1b0ebf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:55.636530 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-beadec2b-97b9-4ed9-a3b1-381e1b0ebf27 None None] MFA Rules not processed for user `221d83c6dbb845fda216ea043b301c54`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:55.637964 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-beadec2b-97b9-4ed9-a3b1-381e1b0ebf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:55.649710 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1115/2195] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:40:57.696311 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e38cb-83c3-429c-873c-550b4001cee4 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:57.698355 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c01e38cb-83c3-429c-873c-550b4001cee4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:57.718549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e38cb-83c3-429c-873c-550b4001cee4 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:57.723179 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41efe0-28e6-4dae-9b25-691b70383b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:57.724051 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41efe0-28e6-4dae-9b25-691b70383b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:57.724339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41efe0-28e6-4dae-9b25-691b70383b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:57.724616 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41efe0-28e6-4dae-9b25-691b70383b17 admin admin] PATH_INFO: `/v3/users/95b25aab99cf4c2ea7d983c831a1c260` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:57.725817 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e41efe0-28e6-4dae-9b25-691b70383b17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95b25aab99cf4c2ea7d983c831a1c260)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:57.727783 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e41efe0-28e6-4dae-9b25-691b70383b17 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:57.790867 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8e41efe0-28e6-4dae-9b25-691b70383b17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95b25aab99cf4c2ea7d983c831a1c260'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:57.798288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8e41efe0-28e6-4dae-9b25-691b70383b17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95b25aab99cf4c2ea7d983c831a1c260'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:57.812114 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8e41efe0-28e6-4dae-9b25-691b70383b17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95b25aab99cf4c2ea7d983c831a1c260'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:57.822186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8e41efe0-28e6-4dae-9b25-691b70383b17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95b25aab99cf4c2ea7d983c831a1c260'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:57.822904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-8e41efe0-28e6-4dae-9b25-691b70383b17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95b25aab99cf4c2ea7d983c831a1c260'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:57.830635 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1081/2196] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:40:57 2022] DELETE /identity/v3/users/95b25aab99cf4c2ea7d983c831a1c260 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:57.835031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ef5be-b568-42b6-93bd-230e1d44f79f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:57.835538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ef5be-b568-42b6-93bd-230e1d44f79f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:57.835651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ef5be-b568-42b6-93bd-230e1d44f79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:57.854337 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-238ef5be-b568-42b6-93bd-230e1d44f79f None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:57.855666 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-238ef5be-b568-42b6-93bd-230e1d44f79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:57.920540 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1116/2197] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:57.930979 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41efe0-28e6-4dae-9b25-691b70383b17 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:57.932434 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8e41efe0-28e6-4dae-9b25-691b70383b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:57.999317 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41efe0-28e6-4dae-9b25-691b70383b17 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:58.003393 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35201a22-34c9-4050-b678-e3d91f68bab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:58.004043 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35201a22-34c9-4050-b678-e3d91f68bab4 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:58.004330 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35201a22-34c9-4050-b678-e3d91f68bab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:58.004611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35201a22-34c9-4050-b678-e3d91f68bab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:58.017614 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35201a22-34c9-4050-b678-e3d91f68bab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:58.019191 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35201a22-34c9-4050-b678-e3d91f68bab4 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:58.029773 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1082/2198] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:58.289399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ef5be-b568-42b6-93bd-230e1d44f79f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:58.291344 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-238ef5be-b568-42b6-93bd-230e1d44f79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:58.306625 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ef5be-b568-42b6-93bd-230e1d44f79f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:58.314371 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c995de-5fce-4b21-afca-492b600e7adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:58.317091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c995de-5fce-4b21-afca-492b600e7adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:58.317646 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c995de-5fce-4b21-afca-492b600e7adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:58.318159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c995de-5fce-4b21-afca-492b600e7adc admin admin] PATH_INFO: `/v3/users/7969e3787b1c4c94bed6871c5a78e2b3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:58.320388 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c995de-5fce-4b21-afca-492b600e7adc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7969e3787b1c4c94bed6871c5a78e2b3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:58.324214 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c995de-5fce-4b21-afca-492b600e7adc admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:58.333754 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35201a22-34c9-4050-b678-e3d91f68bab4 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:58.335383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-35201a22-34c9-4050-b678-e3d91f68bab4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:58.351377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35201a22-34c9-4050-b678-e3d91f68bab4 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:58.359409 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa452a-4f67-4644-87da-71c030cb5a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:58.360489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa452a-4f67-4644-87da-71c030cb5a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:58.360853 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa452a-4f67-4644-87da-71c030cb5a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:58.361317 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa452a-4f67-4644-87da-71c030cb5a1a admin admin] PATH_INFO: `/v3/projects/22c099e43b334fd89a02610fa11195db` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:58.362752 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa452a-4f67-4644-87da-71c030cb5a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c099e43b334fd89a02610fa11195db)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:58.364775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa452a-4f67-4644-87da-71c030cb5a1a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:58.368886 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:58.374759 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:58.384754 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a1c995de-5fce-4b21-afca-492b600e7adc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7969e3787b1c4c94bed6871c5a78e2b3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:58.385840 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a1c995de-5fce-4b21-afca-492b600e7adc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7969e3787b1c4c94bed6871c5a78e2b3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:58.395207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a1c995de-5fce-4b21-afca-492b600e7adc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7969e3787b1c4c94bed6871c5a78e2b3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:58.406607 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a1c995de-5fce-4b21-afca-492b600e7adc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7969e3787b1c4c94bed6871c5a78e2b3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:58.422097 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a1c995de-5fce-4b21-afca-492b600e7adc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7969e3787b1c4c94bed6871c5a78e2b3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:58.429291 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1117/2199] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:40:58 2022] DELETE /identity/v3/users/7969e3787b1c4c94bed6871c5a78e2b3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:40:58.433680 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bb6d6-ca6a-4a37-8e3c-6e480238df0a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:58.433983 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bb6d6-ca6a-4a37-8e3c-6e480238df0a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:58.434365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bb6d6-ca6a-4a37-8e3c-6e480238df0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:58.435624 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4ffa452a-4f67-4644-87da-71c030cb5a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c099e43b334fd89a02610fa11195db', 'request_id': 'req-4ffa452a-4f67-4644-87da-71c030cb5a1a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:58.442327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4ffa452a-4f67-4644-87da-71c030cb5a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c099e43b334fd89a02610fa11195db', 'request_id': 'req-4ffa452a-4f67-4644-87da-71c030cb5a1a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:58.447939 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4ffa452a-4f67-4644-87da-71c030cb5a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c099e43b334fd89a02610fa11195db', 'request_id': 'req-4ffa452a-4f67-4644-87da-71c030cb5a1a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:58.454101 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-773bb6d6-ca6a-4a37-8e3c-6e480238df0a None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:58.455414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-773bb6d6-ca6a-4a37-8e3c-6e480238df0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:58.462895 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4ffa452a-4f67-4644-87da-71c030cb5a1a admin admin] The token cache is being invalidate because project 22c099e43b334fd89a02610fa11195db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:40:58.463210 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4ffa452a-4f67-4644-87da-71c030cb5a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:58.463847 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4ffa452a-4f67-4644-87da-71c030cb5a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:58.465409 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1083/2200] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:40:58 2022] DELETE /identity/v3/projects/22c099e43b334fd89a02610fa11195db => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:40:58.471076 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d1993-9b65-42da-985e-7a5b16d6ee9e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:58.471366 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d1993-9b65-42da-985e-7a5b16d6ee9e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:58.471645 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d1993-9b65-42da-985e-7a5b16d6ee9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:58.489795 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-122d1993-9b65-42da-985e-7a5b16d6ee9e None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:58.491059 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-122d1993-9b65-42da-985e-7a5b16d6ee9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:58.518422 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1118/2201] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:40:58.527877 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bb6d6-ca6a-4a37-8e3c-6e480238df0a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:58.529250 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-773bb6d6-ca6a-4a37-8e3c-6e480238df0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:58.553138 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1084/2202] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:40:58.563095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3931266-3644-4fbf-920c-9fba02d83d51 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:58.563095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3931266-3644-4fbf-920c-9fba02d83d51 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:58.563509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3931266-3644-4fbf-920c-9fba02d83d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:58.584785 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e3931266-3644-4fbf-920c-9fba02d83d51 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:58.586008 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e3931266-3644-4fbf-920c-9fba02d83d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:58.595061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1085/2203] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:40:58.598528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bb6d6-ca6a-4a37-8e3c-6e480238df0a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:58.599329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3931266-3644-4fbf-920c-9fba02d83d51 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:58.602670 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad11d7-2ad6-4c74-9687-5d82f595b8c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:58.603711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad11d7-2ad6-4c74-9687-5d82f595b8c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:58.604164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad11d7-2ad6-4c74-9687-5d82f595b8c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:58.605336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad11d7-2ad6-4c74-9687-5d82f595b8c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:58.609218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3931266-3644-4fbf-920c-9fba02d83d51 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:58.614699 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd45499-a713-42fe-83ce-0d3fb4724a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:58.615345 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd45499-a713-42fe-83ce-0d3fb4724a14 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:58.615629 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd45499-a713-42fe-83ce-0d3fb4724a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:58.615905 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd45499-a713-42fe-83ce-0d3fb4724a14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:58.616624 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd45499-a713-42fe-83ce-0d3fb4724a14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:40:58.616813 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad11d7-2ad6-4c74-9687-5d82f595b8c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:58.616927 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd45499-a713-42fe-83ce-0d3fb4724a14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:58.618301 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad11d7-2ad6-4c74-9687-5d82f595b8c5 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:58.618548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd45499-a713-42fe-83ce-0d3fb4724a14 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:58.630136 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1119/2204] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:58.634113 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1086/2205] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:40:58.635596 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad11d7-2ad6-4c74-9687-5d82f595b8c5 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:58.645987 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad11d7-2ad6-4c74-9687-5d82f595b8c5 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:58.650798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c5dd1-1abf-415a-9934-ac9f60531234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:58.651474 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c5dd1-1abf-415a-9934-ac9f60531234 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:58.651750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c5dd1-1abf-415a-9934-ac9f60531234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:58.652035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c5dd1-1abf-415a-9934-ac9f60531234 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:58.652739 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c5dd1-1abf-415a-9934-ac9f60531234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:58.654721 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c5dd1-1abf-415a-9934-ac9f60531234 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:58.691019 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1120/2206] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:40:58 2022] POST /identity/v3/projects => generated 399 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:40:58.695402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd45499-a713-42fe-83ce-0d3fb4724a14 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:58.710607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd45499-a713-42fe-83ce-0d3fb4724a14 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:58.806736 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97340bf5-9f60-427a-b39a-bb12a8f54072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:58.807428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97340bf5-9f60-427a-b39a-bb12a8f54072 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:58.807721 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97340bf5-9f60-427a-b39a-bb12a8f54072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:58.807998 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97340bf5-9f60-427a-b39a-bb12a8f54072 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:58.808707 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97340bf5-9f60-427a-b39a-bb12a8f54072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:58.810787 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97340bf5-9f60-427a-b39a-bb12a8f54072 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:58.834692 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1087/2207] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:40:58 2022] POST /identity/v3/users => generated 300 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:40:58.839134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c5dd1-1abf-415a-9934-ac9f60531234 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:58.873932 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c5dd1-1abf-415a-9934-ac9f60531234 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:58.882197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf31db2-9634-4612-b454-9b11c9e299ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:58.882875 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf31db2-9634-4612-b454-9b11c9e299ef admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:58.883160 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf31db2-9634-4612-b454-9b11c9e299ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:58.883439 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf31db2-9634-4612-b454-9b11c9e299ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:58.884168 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf31db2-9634-4612-b454-9b11c9e299ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:58.885776 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf31db2-9634-4612-b454-9b11c9e299ef admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:58.898110 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1121/2208] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:40:58.901955 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97340bf5-9f60-427a-b39a-bb12a8f54072 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:58.912901 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97340bf5-9f60-427a-b39a-bb12a8f54072 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:58.918124 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0339108-6f40-43d0-a74e-01fdf668d220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:58.918949 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0339108-6f40-43d0-a74e-01fdf668d220 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:58.919323 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0339108-6f40-43d0-a74e-01fdf668d220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:58.919663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0339108-6f40-43d0-a74e-01fdf668d220 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:58.920486 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0339108-6f40-43d0-a74e-01fdf668d220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:58.922850 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0339108-6f40-43d0-a74e-01fdf668d220 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:58.924496 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:58.938428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1088/2209] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:58.940193 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf31db2-9634-4612-b454-9b11c9e299ef admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:58.951404 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf31db2-9634-4612-b454-9b11c9e299ef admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:58.957279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad04133-64a8-492d-9e7b-61292a534a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:58.958364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad04133-64a8-492d-9e7b-61292a534a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:58.959134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad04133-64a8-492d-9e7b-61292a534a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:58.959134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad04133-64a8-492d-9e7b-61292a534a31 admin admin] PATH_INFO: `/v3/projects/8c32fb0a49e5499096ddea935690eab1/users/9ad2a2576c904e1b862abc67003a94d1/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:58.975006 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad04133-64a8-492d-9e7b-61292a534a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c32fb0a49e5499096ddea935690eab1, user_id=9ad2a2576c904e1b862abc67003a94d1, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:58.977693 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad04133-64a8-492d-9e7b-61292a534a31 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:58.979966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:58.994758 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0339108-6f40-43d0-a74e-01fdf668d220 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:58.995438 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1122/2210] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:40:58 2022] PUT /identity/v3/projects/8c32fb0a49e5499096ddea935690eab1/users/9ad2a2576c904e1b862abc67003a94d1/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:40:58.997031 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f0339108-6f40-43d0-a74e-01fdf668d220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:59.005914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada8cd0-4ff0-4af1-88b9-7d3aa2a84061 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:59.006322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada8cd0-4ff0-4af1-88b9-7d3aa2a84061 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:59.006607 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada8cd0-4ff0-4af1-88b9-7d3aa2a84061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:59.016670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0339108-6f40-43d0-a74e-01fdf668d220 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:59.038220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-bada8cd0-4ff0-4af1-88b9-7d3aa2a84061 None None] MFA Rules not processed for user `9ad2a2576c904e1b862abc67003a94d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:59.039811 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-bada8cd0-4ff0-4af1-88b9-7d3aa2a84061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:59.080319 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679eae8-2032-4130-a5ac-879bc1ad776b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:59.081318 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679eae8-2032-4130-a5ac-879bc1ad776b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:59.081615 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679eae8-2032-4130-a5ac-879bc1ad776b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:59.081896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679eae8-2032-4130-a5ac-879bc1ad776b admin admin] PATH_INFO: `/v3/projects/f47e40b4c6c84622b324fb8b947ac6c7` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:59.083501 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679eae8-2032-4130-a5ac-879bc1ad776b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f47e40b4c6c84622b324fb8b947ac6c7)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:59.085429 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679eae8-2032-4130-a5ac-879bc1ad776b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:59.108171 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1123/2211] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:40:59.120963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada8cd0-4ff0-4af1-88b9-7d3aa2a84061 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:59.122391 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-bada8cd0-4ff0-4af1-88b9-7d3aa2a84061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:59.135126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0679eae8-2032-4130-a5ac-879bc1ad776b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f47e40b4c6c84622b324fb8b947ac6c7', 'request_id': 'req-0679eae8-2032-4130-a5ac-879bc1ad776b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:59.142289 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0679eae8-2032-4130-a5ac-879bc1ad776b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f47e40b4c6c84622b324fb8b947ac6c7', 'request_id': 'req-0679eae8-2032-4130-a5ac-879bc1ad776b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:59.148068 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0679eae8-2032-4130-a5ac-879bc1ad776b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f47e40b4c6c84622b324fb8b947ac6c7', 'request_id': 'req-0679eae8-2032-4130-a5ac-879bc1ad776b'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:59.161766 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0679eae8-2032-4130-a5ac-879bc1ad776b admin admin] The token cache is being invalidate because project f47e40b4c6c84622b324fb8b947ac6c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:40:59.162050 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0679eae8-2032-4130-a5ac-879bc1ad776b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:59.162707 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0679eae8-2032-4130-a5ac-879bc1ad776b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:40:59.164584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1089/2212] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:40:58 2022] DELETE /identity/v3/projects/f47e40b4c6c84622b324fb8b947ac6c7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:40:59.169435 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faf527-86e5-472e-8929-800d78095d75 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:59.169721 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faf527-86e5-472e-8929-800d78095d75 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:59.169997 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faf527-86e5-472e-8929-800d78095d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:59.186453 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada8cd0-4ff0-4af1-88b9-7d3aa2a84061 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:59.188047 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f8faf527-86e5-472e-8929-800d78095d75 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:59.189250 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f8faf527-86e5-472e-8929-800d78095d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:59.237405 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fb592-5063-495c-b74d-66270ef4be93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:59.238055 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fb592-5063-495c-b74d-66270ef4be93 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:59.238374 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fb592-5063-495c-b74d-66270ef4be93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:59.238748 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1fb592-5063-495c-b74d-66270ef4be93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:59.240704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7f1fb592-5063-495c-b74d-66270ef4be93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:59.250302 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1090/2213] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:40:59.258034 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47f120-987b-423d-b5a3-77637264b2a7 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:59.258358 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47f120-987b-423d-b5a3-77637264b2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:59.258635 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47f120-987b-423d-b5a3-77637264b2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:59.277914 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-5f47f120-987b-423d-b5a3-77637264b2a7 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:59.279161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5f47f120-987b-423d-b5a3-77637264b2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:59.292790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1091/2214] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:40:59.297016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47f120-987b-423d-b5a3-77637264b2a7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:59.302094 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:59.305967 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fb592-5063-495c-b74d-66270ef4be93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:59.306940 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47f120-987b-423d-b5a3-77637264b2a7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:59.308189 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1fb592-5063-495c-b74d-66270ef4be93 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:59.312244 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866317a-165c-4d16-83d2-242fe3ce48ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:59.313359 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866317a-165c-4d16-83d2-242fe3ce48ea admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:59.313654 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866317a-165c-4d16-83d2-242fe3ce48ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:59.313938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866317a-165c-4d16-83d2-242fe3ce48ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:59.314719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866317a-165c-4d16-83d2-242fe3ce48ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:40:59.315034 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866317a-165c-4d16-83d2-242fe3ce48ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:59.316677 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866317a-165c-4d16-83d2-242fe3ce48ea admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:59.318871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1124/2215] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:40:59.329750 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1092/2216] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:40:59.334425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fb592-5063-495c-b74d-66270ef4be93 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:59.347393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1fb592-5063-495c-b74d-66270ef4be93 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:59.352106 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ad635-9985-41f8-a4fc-e932702f30ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:59.352809 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ad635-9985-41f8-a4fc-e932702f30ab admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:59.353099 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ad635-9985-41f8-a4fc-e932702f30ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:59.353379 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ad635-9985-41f8-a4fc-e932702f30ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:59.354235 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ad635-9985-41f8-a4fc-e932702f30ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:59.356151 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ad635-9985-41f8-a4fc-e932702f30ab admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:59.387543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1125/2217] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:40:59 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:40:59.389013 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866317a-165c-4d16-83d2-242fe3ce48ea admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:59.404625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866317a-165c-4d16-83d2-242fe3ce48ea admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:59.408745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:59.477966 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de7ba4-d133-4711-b788-08be3d2517d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:59.478716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de7ba4-d133-4711-b788-08be3d2517d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:59.479004 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de7ba4-d133-4711-b788-08be3d2517d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:59.479279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de7ba4-d133-4711-b788-08be3d2517d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:59.480192 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de7ba4-d133-4711-b788-08be3d2517d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:59.482058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de7ba4-d133-4711-b788-08be3d2517d5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:59.502885 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1093/2218] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:40:59 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:40:59.507046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ad635-9985-41f8-a4fc-e932702f30ab admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:59.519075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ad635-9985-41f8-a4fc-e932702f30ab admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:59.525024 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f17ab-5afd-4ce2-9823-e509cf2aad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:59.525690 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f17ab-5afd-4ce2-9823-e509cf2aad8b admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:59.525977 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f17ab-5afd-4ce2-9823-e509cf2aad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:59.526305 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f17ab-5afd-4ce2-9823-e509cf2aad8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:59.527041 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f17ab-5afd-4ce2-9823-e509cf2aad8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:59.528717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f17ab-5afd-4ce2-9823-e509cf2aad8b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:59.543271 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1126/2219] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:59.544227 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de7ba4-d133-4711-b788-08be3d2517d5 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:59.554709 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de7ba4-d133-4711-b788-08be3d2517d5 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:59.559493 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e071012-7cb8-4c8c-b8ad-8a32df560e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:59.560154 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e071012-7cb8-4c8c-b8ad-8a32df560e64 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:59.560442 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e071012-7cb8-4c8c-b8ad-8a32df560e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:59.560719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e071012-7cb8-4c8c-b8ad-8a32df560e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:59.561995 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e071012-7cb8-4c8c-b8ad-8a32df560e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:59.563631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e071012-7cb8-4c8c-b8ad-8a32df560e64 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:59.573828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1094/2220] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:40:59.579062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f17ab-5afd-4ce2-9823-e509cf2aad8b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:59.589147 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f17ab-5afd-4ce2-9823-e509cf2aad8b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:59.594171 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea907c-6551-4934-ad35-f496b4edf9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:59.595066 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea907c-6551-4934-ad35-f496b4edf9d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:59.595352 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea907c-6551-4934-ad35-f496b4edf9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:59.595631 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea907c-6551-4934-ad35-f496b4edf9d1 admin admin] PATH_INFO: `/v3/projects/e986cd6ef4c640909a5bcff6de3a89de/users/fd422dac444b4d5e9f0ab55502df912a/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:59.612056 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea907c-6551-4934-ad35-f496b4edf9d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e986cd6ef4c640909a5bcff6de3a89de, user_id=fd422dac444b4d5e9f0ab55502df912a, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:59.614804 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea907c-6551-4934-ad35-f496b4edf9d1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:59.629643 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1127/2221] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:40:59 2022] PUT /identity/v3/projects/e986cd6ef4c640909a5bcff6de3a89de/users/fd422dac444b4d5e9f0ab55502df912a/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 15:40:59.640775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064ac99-8300-4362-9c0b-b0840d16ce62 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:59.641064 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064ac99-8300-4362-9c0b-b0840d16ce62 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:59.641349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064ac99-8300-4362-9c0b-b0840d16ce62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:59.668939 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3064ac99-8300-4362-9c0b-b0840d16ce62 None None] MFA Rules not processed for user `fd422dac444b4d5e9f0ab55502df912a`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:40:59.670191 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3064ac99-8300-4362-9c0b-b0840d16ce62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:59.748550 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1095/2222] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:40:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:40:59.761931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea907c-6551-4934-ad35-f496b4edf9d1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:40:59.764026 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6aea907c-6551-4934-ad35-f496b4edf9d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:40:59.839615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea907c-6551-4934-ad35-f496b4edf9d1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:40:59.843562 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcede8ff-1e71-43c0-806e-a1d49739c283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:40:59.844205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcede8ff-1e71-43c0-806e-a1d49739c283 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:40:59.844493 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcede8ff-1e71-43c0-806e-a1d49739c283 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:40:59.844777 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcede8ff-1e71-43c0-806e-a1d49739c283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:40:59.853537 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcede8ff-1e71-43c0-806e-a1d49739c283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:40:59.855051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcede8ff-1e71-43c0-806e-a1d49739c283 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:40:59.864831 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1128/2223] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:40:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:41:07.722985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064ac99-8300-4362-9c0b-b0840d16ce62 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:07.785332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064ac99-8300-4362-9c0b-b0840d16ce62 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:07.790046 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81771bb-f8c6-4b81-bd5e-3aa6c2b596d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:07.790938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81771bb-f8c6-4b81-bd5e-3aa6c2b596d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:07.791219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81771bb-f8c6-4b81-bd5e-3aa6c2b596d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:07.791494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81771bb-f8c6-4b81-bd5e-3aa6c2b596d2 admin admin] PATH_INFO: `/v3/users/fd422dac444b4d5e9f0ab55502df912a` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:07.792686 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81771bb-f8c6-4b81-bd5e-3aa6c2b596d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd422dac444b4d5e9f0ab55502df912a)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:07.794637 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81771bb-f8c6-4b81-bd5e-3aa6c2b596d2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:07.810496 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:07.840305 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f81771bb-f8c6-4b81-bd5e-3aa6c2b596d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd422dac444b4d5e9f0ab55502df912a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:07.847864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f81771bb-f8c6-4b81-bd5e-3aa6c2b596d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd422dac444b4d5e9f0ab55502df912a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:07.860328 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f81771bb-f8c6-4b81-bd5e-3aa6c2b596d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd422dac444b4d5e9f0ab55502df912a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:07.867584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f81771bb-f8c6-4b81-bd5e-3aa6c2b596d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd422dac444b4d5e9f0ab55502df912a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:07.868332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-f81771bb-f8c6-4b81-bd5e-3aa6c2b596d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd422dac444b4d5e9f0ab55502df912a'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:07.874616 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1096/2224] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:41:07 2022] DELETE /identity/v3/users/fd422dac444b4d5e9f0ab55502df912a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:41:07.879093 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37561ce-392a-4b2b-94fc-157f416a2a86 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:07.879583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37561ce-392a-4b2b-94fc-157f416a2a86 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:07.879695 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37561ce-392a-4b2b-94fc-157f416a2a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:07.898432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c37561ce-392a-4b2b-94fc-157f416a2a86 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:07.899648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c37561ce-392a-4b2b-94fc-157f416a2a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:07.964619 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1129/2225] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:07.975318 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81771bb-f8c6-4b81-bd5e-3aa6c2b596d2 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:07.976784 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f81771bb-f8c6-4b81-bd5e-3aa6c2b596d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:08.035037 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81771bb-f8c6-4b81-bd5e-3aa6c2b596d2 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:08.039205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8de63-9020-4996-ae25-c3f860d02b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:08.039773 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8de63-9020-4996-ae25-c3f860d02b47 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:08.040061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8de63-9020-4996-ae25-c3f860d02b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:08.040342 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8de63-9020-4996-ae25-c3f860d02b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:08.050533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8de63-9020-4996-ae25-c3f860d02b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:08.051980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8de63-9020-4996-ae25-c3f860d02b47 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:08.062375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1097/2226] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:41:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:41:08.435082 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37561ce-392a-4b2b-94fc-157f416a2a86 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:08.437262 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c37561ce-392a-4b2b-94fc-157f416a2a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:08.449769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37561ce-392a-4b2b-94fc-157f416a2a86 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:08.455083 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c03a6c-b416-4ec1-86a5-8b2e13cc8718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:08.455947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c03a6c-b416-4ec1-86a5-8b2e13cc8718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:08.456283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c03a6c-b416-4ec1-86a5-8b2e13cc8718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:08.456493 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c03a6c-b416-4ec1-86a5-8b2e13cc8718 admin admin] PATH_INFO: `/v3/projects/e986cd6ef4c640909a5bcff6de3a89de` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:08.458300 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c03a6c-b416-4ec1-86a5-8b2e13cc8718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e986cd6ef4c640909a5bcff6de3a89de)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:08.461785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c03a6c-b416-4ec1-86a5-8b2e13cc8718 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:08.525373 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:08.539016 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-89c03a6c-b416-4ec1-86a5-8b2e13cc8718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e986cd6ef4c640909a5bcff6de3a89de', 'request_id': 'req-89c03a6c-b416-4ec1-86a5-8b2e13cc8718'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:08.544830 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-89c03a6c-b416-4ec1-86a5-8b2e13cc8718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e986cd6ef4c640909a5bcff6de3a89de', 'request_id': 'req-89c03a6c-b416-4ec1-86a5-8b2e13cc8718'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:08.555038 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-89c03a6c-b416-4ec1-86a5-8b2e13cc8718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e986cd6ef4c640909a5bcff6de3a89de', 'request_id': 'req-89c03a6c-b416-4ec1-86a5-8b2e13cc8718'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:08.568513 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-89c03a6c-b416-4ec1-86a5-8b2e13cc8718 admin admin] The token cache is being invalidate because project e986cd6ef4c640909a5bcff6de3a89de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:41:08.568827 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-89c03a6c-b416-4ec1-86a5-8b2e13cc8718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:08.569678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-89c03a6c-b416-4ec1-86a5-8b2e13cc8718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:08.580560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1130/2227] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:41:08 2022] DELETE /identity/v3/projects/e986cd6ef4c640909a5bcff6de3a89de => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:41:08.580676 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc115d4-fe1f-43d1-b22e-0bf22d5d45bb None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:08.580676 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc115d4-fe1f-43d1-b22e-0bf22d5d45bb None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:08.580676 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc115d4-fe1f-43d1-b22e-0bf22d5d45bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:08.595284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8fc115d4-fe1f-43d1-b22e-0bf22d5d45bb None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:08.596501 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8fc115d4-fe1f-43d1-b22e-0bf22d5d45bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:08.656108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1098/2228] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:08.664921 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4581cc7-f3c2-420d-8b9a-47d3dc1f7311 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:08.665227 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4581cc7-f3c2-420d-8b9a-47d3dc1f7311 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:08.665545 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4581cc7-f3c2-420d-8b9a-47d3dc1f7311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:08.684440 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c4581cc7-f3c2-420d-8b9a-47d3dc1f7311 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:08.685662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c4581cc7-f3c2-420d-8b9a-47d3dc1f7311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:08.694310 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1131/2229] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:08.698962 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc115d4-fe1f-43d1-b22e-0bf22d5d45bb None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:08.709598 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc115d4-fe1f-43d1-b22e-0bf22d5d45bb None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:08.714478 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e818b-be79-4f91-a244-4efe0f1f6832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:08.715158 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e818b-be79-4f91-a244-4efe0f1f6832 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:08.715479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e818b-be79-4f91-a244-4efe0f1f6832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:08.715767 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e818b-be79-4f91-a244-4efe0f1f6832 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:08.716570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e818b-be79-4f91-a244-4efe0f1f6832 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:41:08.716882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e818b-be79-4f91-a244-4efe0f1f6832 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:08.718722 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e818b-be79-4f91-a244-4efe0f1f6832 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:08.731023 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1099/2230] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:41:08.736227 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4581cc7-f3c2-420d-8b9a-47d3dc1f7311 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:08.745738 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4581cc7-f3c2-420d-8b9a-47d3dc1f7311 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:08.752091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c917062-7315-406a-91a9-300fe8da1e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:08.752750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c917062-7315-406a-91a9-300fe8da1e5b admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:08.753034 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c917062-7315-406a-91a9-300fe8da1e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:08.753313 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c917062-7315-406a-91a9-300fe8da1e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:08.754018 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c917062-7315-406a-91a9-300fe8da1e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:08.755979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c917062-7315-406a-91a9-300fe8da1e5b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:08.784802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1132/2231] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:41:08 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:41:08.786246 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e818b-be79-4f91-a244-4efe0f1f6832 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:08.797133 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e818b-be79-4f91-a244-4efe0f1f6832 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:08.819777 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:08.857588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60107104-2301-412a-9d30-2f442b1cc4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:08.859302 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60107104-2301-412a-9d30-2f442b1cc4eb admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:08.859597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60107104-2301-412a-9d30-2f442b1cc4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:08.859992 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60107104-2301-412a-9d30-2f442b1cc4eb admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:08.860764 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60107104-2301-412a-9d30-2f442b1cc4eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:08.862745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60107104-2301-412a-9d30-2f442b1cc4eb admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:08.883457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1100/2232] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:41:08 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:41:08.887693 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c917062-7315-406a-91a9-300fe8da1e5b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:08.898624 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c917062-7315-406a-91a9-300fe8da1e5b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:08.903310 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865f448-8342-411b-bca2-38332d35239c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:08.903961 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865f448-8342-411b-bca2-38332d35239c admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:08.904248 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865f448-8342-411b-bca2-38332d35239c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:08.904574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865f448-8342-411b-bca2-38332d35239c admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:08.905721 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865f448-8342-411b-bca2-38332d35239c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:08.907389 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865f448-8342-411b-bca2-38332d35239c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:08.918117 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1133/2233] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:41:08.922796 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60107104-2301-412a-9d30-2f442b1cc4eb admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:08.933392 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60107104-2301-412a-9d30-2f442b1cc4eb admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:08.938872 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce139e-d1ee-4865-9f33-66174f2385e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:08.939537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce139e-d1ee-4865-9f33-66174f2385e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:08.939823 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce139e-d1ee-4865-9f33-66174f2385e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:08.940102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce139e-d1ee-4865-9f33-66174f2385e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:08.940834 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce139e-d1ee-4865-9f33-66174f2385e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:08.942493 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce139e-d1ee-4865-9f33-66174f2385e6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:08.953980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1101/2234] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:41:08.957954 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865f448-8342-411b-bca2-38332d35239c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:08.968133 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865f448-8342-411b-bca2-38332d35239c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:08.973070 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef4f14-c526-4532-a7cc-3dfce48519e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:08.973954 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef4f14-c526-4532-a7cc-3dfce48519e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:08.974267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef4f14-c526-4532-a7cc-3dfce48519e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:08.974545 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef4f14-c526-4532-a7cc-3dfce48519e6 admin admin] PATH_INFO: `/v3/projects/5c783c879df64ef0a107892bf115410f/users/25584e48ee7443029f01b55bc3708e52/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:08.990214 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef4f14-c526-4532-a7cc-3dfce48519e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c783c879df64ef0a107892bf115410f, user_id=25584e48ee7443029f01b55bc3708e52, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:08.992935 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef4f14-c526-4532-a7cc-3dfce48519e6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:09.006232 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1134/2235] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:41:08 2022] PUT /identity/v3/projects/5c783c879df64ef0a107892bf115410f/users/25584e48ee7443029f01b55bc3708e52/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:41:09.016746 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c9a91-2703-4c2a-bec5-b893460ff701 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:09.017067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c9a91-2703-4c2a-bec5-b893460ff701 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:09.017351 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c9a91-2703-4c2a-bec5-b893460ff701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:09.043495 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9e0c9a91-2703-4c2a-bec5-b893460ff701 None None] MFA Rules not processed for user `25584e48ee7443029f01b55bc3708e52`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:09.044727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9e0c9a91-2703-4c2a-bec5-b893460ff701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:09.112069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1102/2236] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:41:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:09.122988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef4f14-c526-4532-a7cc-3dfce48519e6 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:09.124865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ebef4f14-c526-4532-a7cc-3dfce48519e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:09.182686 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef4f14-c526-4532-a7cc-3dfce48519e6 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:09.186574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6d96c-3633-435b-86de-b7789cd6380b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:09.187363 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6d96c-3633-435b-86de-b7789cd6380b service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:09.187647 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6d96c-3633-435b-86de-b7789cd6380b service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:09.187921 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6d96c-3633-435b-86de-b7789cd6380b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:09.196351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6d96c-3633-435b-86de-b7789cd6380b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:09.197784 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6d96c-3633-435b-86de-b7789cd6380b service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:09.206642 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1135/2237] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:41:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:41:09.616013 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c9a91-2703-4c2a-bec5-b893460ff701 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:09.617620 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9e0c9a91-2703-4c2a-bec5-b893460ff701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:09.690146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c9a91-2703-4c2a-bec5-b893460ff701 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:09.694723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b931c-dad3-4822-a01b-c12c335f8cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:09.695601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b931c-dad3-4822-a01b-c12c335f8cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:09.695882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b931c-dad3-4822-a01b-c12c335f8cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:09.696271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b931c-dad3-4822-a01b-c12c335f8cab admin admin] PATH_INFO: `/v3/users/9ad2a2576c904e1b862abc67003a94d1` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:09.697399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b931c-dad3-4822-a01b-c12c335f8cab admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ad2a2576c904e1b862abc67003a94d1)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:09.699387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b931c-dad3-4822-a01b-c12c335f8cab admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:09.738837 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:09.751786 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b96b931c-dad3-4822-a01b-c12c335f8cab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ad2a2576c904e1b862abc67003a94d1'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:09.759474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b96b931c-dad3-4822-a01b-c12c335f8cab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ad2a2576c904e1b862abc67003a94d1'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:09.772770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b96b931c-dad3-4822-a01b-c12c335f8cab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ad2a2576c904e1b862abc67003a94d1'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:09.781142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b96b931c-dad3-4822-a01b-c12c335f8cab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ad2a2576c904e1b862abc67003a94d1'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:09.781803 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b96b931c-dad3-4822-a01b-c12c335f8cab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ad2a2576c904e1b862abc67003a94d1'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:09.791078 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1103/2238] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:41:09 2022] DELETE /identity/v3/users/9ad2a2576c904e1b862abc67003a94d1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:41:09.795881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b6a6c-dd66-4564-a738-6f219760c021 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:09.796404 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b6a6c-dd66-4564-a738-6f219760c021 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:09.797077 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b6a6c-dd66-4564-a738-6f219760c021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:09.816010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-486b6a6c-dd66-4564-a738-6f219760c021 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:09.817261 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-486b6a6c-dd66-4564-a738-6f219760c021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:09.890894 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1136/2239] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:09.905960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b931c-dad3-4822-a01b-c12c335f8cab admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:09.907700 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b96b931c-dad3-4822-a01b-c12c335f8cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:09.987627 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b931c-dad3-4822-a01b-c12c335f8cab admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:09.991509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf775889-1ec5-4ac6-87ca-bd88765391a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:09.992320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf775889-1ec5-4ac6-87ca-bd88765391a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:09.992604 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf775889-1ec5-4ac6-87ca-bd88765391a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:09.992909 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf775889-1ec5-4ac6-87ca-bd88765391a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:10.003533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf775889-1ec5-4ac6-87ca-bd88765391a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:10.005023 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf775889-1ec5-4ac6-87ca-bd88765391a0 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:10.015926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1104/2240] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:41:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:41:10.329271 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b6a6c-dd66-4564-a738-6f219760c021 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:10.331065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-486b6a6c-dd66-4564-a738-6f219760c021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:10.346430 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:10.354476 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b6a6c-dd66-4564-a738-6f219760c021 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:10.360397 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc620455-5262-44f9-8a20-b4b08c58a980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:10.361338 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc620455-5262-44f9-8a20-b4b08c58a980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:10.361697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc620455-5262-44f9-8a20-b4b08c58a980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:10.361985 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc620455-5262-44f9-8a20-b4b08c58a980 admin admin] PATH_INFO: `/v3/projects/8c32fb0a49e5499096ddea935690eab1` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:10.363220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc620455-5262-44f9-8a20-b4b08c58a980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c32fb0a49e5499096ddea935690eab1)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:10.365296 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc620455-5262-44f9-8a20-b4b08c58a980 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:10.416028 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dc620455-5262-44f9-8a20-b4b08c58a980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c32fb0a49e5499096ddea935690eab1', 'request_id': 'req-dc620455-5262-44f9-8a20-b4b08c58a980'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:10.423092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dc620455-5262-44f9-8a20-b4b08c58a980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c32fb0a49e5499096ddea935690eab1', 'request_id': 'req-dc620455-5262-44f9-8a20-b4b08c58a980'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:10.431584 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dc620455-5262-44f9-8a20-b4b08c58a980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c32fb0a49e5499096ddea935690eab1', 'request_id': 'req-dc620455-5262-44f9-8a20-b4b08c58a980'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:10.443873 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dc620455-5262-44f9-8a20-b4b08c58a980 admin admin] The token cache is being invalidate because project 8c32fb0a49e5499096ddea935690eab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:41:10.444166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dc620455-5262-44f9-8a20-b4b08c58a980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:10.444808 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dc620455-5262-44f9-8a20-b4b08c58a980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:10.446405 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1137/2241] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:41:10 2022] DELETE /identity/v3/projects/8c32fb0a49e5499096ddea935690eab1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:41:10.451663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd50e56-7712-44ff-ad50-846fd5c24443 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:10.452063 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd50e56-7712-44ff-ad50-846fd5c24443 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:10.452349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd50e56-7712-44ff-ad50-846fd5c24443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:10.469767 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-cfd50e56-7712-44ff-ad50-846fd5c24443 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:10.471016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cfd50e56-7712-44ff-ad50-846fd5c24443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:10.533494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1105/2242] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:10.542403 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e77e2-9a4e-420d-a5a5-652916be60ff None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:10.542642 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e77e2-9a4e-420d-a5a5-652916be60ff None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:10.542919 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e77e2-9a4e-420d-a5a5-652916be60ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:10.564502 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7b2e77e2-9a4e-420d-a5a5-652916be60ff None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:10.565739 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7b2e77e2-9a4e-420d-a5a5-652916be60ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:10.574123 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1138/2243] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:10.578828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd50e56-7712-44ff-ad50-846fd5c24443 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:10.589345 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd50e56-7712-44ff-ad50-846fd5c24443 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:10.607535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d17c0-cd26-45a9-aa35-18ef8f0d34af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:10.608902 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d17c0-cd26-45a9-aa35-18ef8f0d34af admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:10.609200 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d17c0-cd26-45a9-aa35-18ef8f0d34af admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:10.609874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d17c0-cd26-45a9-aa35-18ef8f0d34af admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:10.610822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d17c0-cd26-45a9-aa35-18ef8f0d34af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:41:10.611326 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d17c0-cd26-45a9-aa35-18ef8f0d34af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:10.615425 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d17c0-cd26-45a9-aa35-18ef8f0d34af admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:10.639119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1106/2244] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:41:10.644100 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e77e2-9a4e-420d-a5a5-652916be60ff None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:10.662890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e77e2-9a4e-420d-a5a5-652916be60ff None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:10.669648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13159d-e941-4af8-860d-4ab29597e498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:10.671216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13159d-e941-4af8-860d-4ab29597e498 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:10.671506 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13159d-e941-4af8-860d-4ab29597e498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:10.671785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13159d-e941-4af8-860d-4ab29597e498 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:10.672824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13159d-e941-4af8-860d-4ab29597e498 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:10.674864 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13159d-e941-4af8-860d-4ab29597e498 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:10.705689 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1139/2245] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:41:10 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:41:10.710403 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d17c0-cd26-45a9-aa35-18ef8f0d34af admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:10.725096 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d17c0-cd26-45a9-aa35-18ef8f0d34af admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:10.774423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:10.797358 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247cafb-e676-4127-95a7-b14ef6bca497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:10.798047 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247cafb-e676-4127-95a7-b14ef6bca497 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:10.798369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247cafb-e676-4127-95a7-b14ef6bca497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:10.798651 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247cafb-e676-4127-95a7-b14ef6bca497 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:10.799373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247cafb-e676-4127-95a7-b14ef6bca497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:10.801480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247cafb-e676-4127-95a7-b14ef6bca497 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:10.835617 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1107/2246] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:41:10 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:41:10.839835 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13159d-e941-4af8-860d-4ab29597e498 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:10.858954 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13159d-e941-4af8-860d-4ab29597e498 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:10.866831 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c6932-aab9-42f7-b369-6f1d1c0830db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:10.867792 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c6932-aab9-42f7-b369-6f1d1c0830db admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:10.868444 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c6932-aab9-42f7-b369-6f1d1c0830db admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:10.868880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c6932-aab9-42f7-b369-6f1d1c0830db admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:10.869785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c6932-aab9-42f7-b369-6f1d1c0830db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:10.871850 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c6932-aab9-42f7-b369-6f1d1c0830db admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:10.890016 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1140/2247] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:41:10.894266 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247cafb-e676-4127-95a7-b14ef6bca497 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:10.906488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247cafb-e676-4127-95a7-b14ef6bca497 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:10.911560 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b851fcb-b1dc-4807-9f45-797e34cb86fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:10.912244 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b851fcb-b1dc-4807-9f45-797e34cb86fa admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:10.912526 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b851fcb-b1dc-4807-9f45-797e34cb86fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:10.912820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b851fcb-b1dc-4807-9f45-797e34cb86fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:10.914870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b851fcb-b1dc-4807-9f45-797e34cb86fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:10.916521 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b851fcb-b1dc-4807-9f45-797e34cb86fa admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:10.932596 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1108/2248] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:41:10.937563 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c6932-aab9-42f7-b369-6f1d1c0830db admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:10.949259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c6932-aab9-42f7-b369-6f1d1c0830db admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:10.956587 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555942f-5839-4ac3-81bf-9f81183ff16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:10.957897 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555942f-5839-4ac3-81bf-9f81183ff16a admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:10.958424 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555942f-5839-4ac3-81bf-9f81183ff16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:10.958811 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555942f-5839-4ac3-81bf-9f81183ff16a admin admin] PATH_INFO: `/v3/projects/2174489f71234ee6a072e17f0c59a640/users/2f4c087814e748e892c6a3314e72582c/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:10.995054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555942f-5839-4ac3-81bf-9f81183ff16a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2174489f71234ee6a072e17f0c59a640, user_id=2f4c087814e748e892c6a3314e72582c, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:10.998260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555942f-5839-4ac3-81bf-9f81183ff16a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:11.026402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1141/2249] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:41:10 2022] PUT /identity/v3/projects/2174489f71234ee6a072e17f0c59a640/users/2f4c087814e748e892c6a3314e72582c/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:41:11.029084 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef17642-de13-4a04-a46a-c842d4ef20d0 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:11.029386 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef17642-de13-4a04-a46a-c842d4ef20d0 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:11.029674 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef17642-de13-4a04-a46a-c842d4ef20d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:11.059993 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9ef17642-de13-4a04-a46a-c842d4ef20d0 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:11.061926 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9ef17642-de13-4a04-a46a-c842d4ef20d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:11.136756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1109/2250] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:11.147147 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555942f-5839-4ac3-81bf-9f81183ff16a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:11.149140 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b555942f-5839-4ac3-81bf-9f81183ff16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:11.212147 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555942f-5839-4ac3-81bf-9f81183ff16a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:11.215829 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc127cd-3fc6-4e2d-b209-9832f03b5bc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:11.216477 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc127cd-3fc6-4e2d-b209-9832f03b5bc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:11.216766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc127cd-3fc6-4e2d-b209-9832f03b5bc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:11.217044 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc127cd-3fc6-4e2d-b209-9832f03b5bc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:11.226558 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc127cd-3fc6-4e2d-b209-9832f03b5bc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:11.227997 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc127cd-3fc6-4e2d-b209-9832f03b5bc5 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:11.238136 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1142/2251] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:41:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:41:17.532633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71cbd9-db10-4b61-9657-4b8d643f2a80 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:17.533151 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71cbd9-db10-4b61-9657-4b8d643f2a80 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:17.533379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71cbd9-db10-4b61-9657-4b8d643f2a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:17.567241 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-0c71cbd9-db10-4b61-9657-4b8d643f2a80 None None] MFA Rules not processed for user `2f4c087814e748e892c6a3314e72582c`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:17.568999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0c71cbd9-db10-4b61-9657-4b8d643f2a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:17.651099 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1110/2252] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:41:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:17.656970 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc127cd-3fc6-4e2d-b209-9832f03b5bc5 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:17.667742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc127cd-3fc6-4e2d-b209-9832f03b5bc5 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:17.673476 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f26d0-3799-4acf-a810-9fa1a39a4556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:17.674210 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f26d0-3799-4acf-a810-9fa1a39a4556 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:17.674540 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f26d0-3799-4acf-a810-9fa1a39a4556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:17.674832 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f26d0-3799-4acf-a810-9fa1a39a4556 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:17.675639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f26d0-3799-4acf-a810-9fa1a39a4556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:17.677877 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f26d0-3799-4acf-a810-9fa1a39a4556 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:17.713299 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1143/2253] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:41:17 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:41:17.714492 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71cbd9-db10-4b61-9657-4b8d643f2a80 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:17.726857 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71cbd9-db10-4b61-9657-4b8d643f2a80 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:17.796658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:17.808636 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e6631-7c83-494e-8bd1-8a2fbfca3acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:17.809441 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6631-7c83-494e-8bd1-8a2fbfca3acb admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:17.809848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6631-7c83-494e-8bd1-8a2fbfca3acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:17.810183 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6631-7c83-494e-8bd1-8a2fbfca3acb admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:17.811138 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e6631-7c83-494e-8bd1-8a2fbfca3acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:17.813212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e6631-7c83-494e-8bd1-8a2fbfca3acb admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:17.853648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1111/2254] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:41:17 2022] POST /identity/v3/users => generated 295 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:41:17.854868 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f26d0-3799-4acf-a810-9fa1a39a4556 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:17.860766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:17.870717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f26d0-3799-4acf-a810-9fa1a39a4556 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:17.881796 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57799c48-82e0-47e7-bcbe-220c9d7ed928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:17.882779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57799c48-82e0-47e7-bcbe-220c9d7ed928 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:17.884070 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57799c48-82e0-47e7-bcbe-220c9d7ed928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:17.884686 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57799c48-82e0-47e7-bcbe-220c9d7ed928 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:17.886474 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57799c48-82e0-47e7-bcbe-220c9d7ed928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:17.888694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57799c48-82e0-47e7-bcbe-220c9d7ed928 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:17.910128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1144/2255] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:41:17.911969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e6631-7c83-494e-8bd1-8a2fbfca3acb admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:17.923339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e6631-7c83-494e-8bd1-8a2fbfca3acb admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:17.929597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86536510-8c02-4f69-b89c-6cb3413a931a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:17.930809 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86536510-8c02-4f69-b89c-6cb3413a931a admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:17.931185 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86536510-8c02-4f69-b89c-6cb3413a931a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:17.931547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86536510-8c02-4f69-b89c-6cb3413a931a admin admin] PATH_INFO: `/v3/projects/a58561b46fef4f96be183d346f28bcf9/users/828b58f859204e2e8aa40913853ec2bd/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:17.949901 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86536510-8c02-4f69-b89c-6cb3413a931a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58561b46fef4f96be183d346f28bcf9, user_id=828b58f859204e2e8aa40913853ec2bd, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:17.952881 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86536510-8c02-4f69-b89c-6cb3413a931a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:17.971810 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1112/2256] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:41:17 2022] PUT /identity/v3/projects/a58561b46fef4f96be183d346f28bcf9/users/828b58f859204e2e8aa40913853ec2bd/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:41:17.976898 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57799c48-82e0-47e7-bcbe-220c9d7ed928 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:17.988153 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57799c48-82e0-47e7-bcbe-220c9d7ed928 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:18.054307 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f5d26-53be-498f-b6ef-16a7d85a08b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:18.055101 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f5d26-53be-498f-b6ef-16a7d85a08b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:18.055429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f5d26-53be-498f-b6ef-16a7d85a08b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:18.055717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f5d26-53be-498f-b6ef-16a7d85a08b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:18.056477 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f5d26-53be-498f-b6ef-16a7d85a08b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:18.058132 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f5d26-53be-498f-b6ef-16a7d85a08b9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:18.071126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1145/2257] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:41:18.074852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86536510-8c02-4f69-b89c-6cb3413a931a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:18.088164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86536510-8c02-4f69-b89c-6cb3413a931a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:18.094033 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48551fbb-a099-42a9-960f-b96d96d85912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:18.095108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48551fbb-a099-42a9-960f-b96d96d85912 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:18.095479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48551fbb-a099-42a9-960f-b96d96d85912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:18.095906 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48551fbb-a099-42a9-960f-b96d96d85912 admin admin] PATH_INFO: `/v3/projects/a58561b46fef4f96be183d346f28bcf9/users/828b58f859204e2e8aa40913853ec2bd/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:18.098682 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48551fbb-a099-42a9-960f-b96d96d85912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58561b46fef4f96be183d346f28bcf9, user_id=828b58f859204e2e8aa40913853ec2bd, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:18.101776 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48551fbb-a099-42a9-960f-b96d96d85912 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:18.122440 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1113/2258] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:41:18 2022] PUT /identity/v3/projects/a58561b46fef4f96be183d346f28bcf9/users/828b58f859204e2e8aa40913853ec2bd/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:41:20.899306 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f5d26-53be-498f-b6ef-16a7d85a08b9 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:20.901152 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-249f5d26-53be-498f-b6ef-16a7d85a08b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:20.917816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f5d26-53be-498f-b6ef-16a7d85a08b9 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:21.029085 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca93ae8-1bbe-4057-a900-dfc549d7ee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:21.030779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca93ae8-1bbe-4057-a900-dfc549d7ee12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:21.031277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca93ae8-1bbe-4057-a900-dfc549d7ee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:21.031779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca93ae8-1bbe-4057-a900-dfc549d7ee12 admin admin] PATH_INFO: `/v3/users/25584e48ee7443029f01b55bc3708e52` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:21.033911 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca93ae8-1bbe-4057-a900-dfc549d7ee12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25584e48ee7443029f01b55bc3708e52)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:21.037214 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca93ae8-1bbe-4057-a900-dfc549d7ee12 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:21.128672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1ca93ae8-1bbe-4057-a900-dfc549d7ee12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25584e48ee7443029f01b55bc3708e52'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:21.129513 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1ca93ae8-1bbe-4057-a900-dfc549d7ee12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25584e48ee7443029f01b55bc3708e52'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:21.156178 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1ca93ae8-1bbe-4057-a900-dfc549d7ee12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25584e48ee7443029f01b55bc3708e52'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:21.178686 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1ca93ae8-1bbe-4057-a900-dfc549d7ee12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25584e48ee7443029f01b55bc3708e52'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:21.199327 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1ca93ae8-1bbe-4057-a900-dfc549d7ee12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25584e48ee7443029f01b55bc3708e52'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:21.211761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1146/2259] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:41:20 2022] DELETE /identity/v3/users/25584e48ee7443029f01b55bc3708e52 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:41:21.216152 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf760f-1c21-40e0-ae93-939b2af18151 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:21.216674 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf760f-1c21-40e0-ae93-939b2af18151 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:21.216784 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf760f-1c21-40e0-ae93-939b2af18151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:21.237305 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8dbf760f-1c21-40e0-ae93-939b2af18151 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:21.238573 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8dbf760f-1c21-40e0-ae93-939b2af18151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:21.335531 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1114/2260] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:21.355254 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca93ae8-1bbe-4057-a900-dfc549d7ee12 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:21.356953 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1ca93ae8-1bbe-4057-a900-dfc549d7ee12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:21.370510 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:21.452059 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca93ae8-1bbe-4057-a900-dfc549d7ee12 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:21.458624 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a26bf1-ef22-4c26-8570-f1e981485f73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:21.459739 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a26bf1-ef22-4c26-8570-f1e981485f73 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:21.460029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a26bf1-ef22-4c26-8570-f1e981485f73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:21.461370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a26bf1-ef22-4c26-8570-f1e981485f73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:21.478780 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a26bf1-ef22-4c26-8570-f1e981485f73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:21.481823 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a26bf1-ef22-4c26-8570-f1e981485f73 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:21.499838 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1147/2261] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:41:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:41:22.017972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf760f-1c21-40e0-ae93-939b2af18151 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:22.019523 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8dbf760f-1c21-40e0-ae93-939b2af18151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:22.038008 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf760f-1c21-40e0-ae93-939b2af18151 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:22.059011 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2b71c-003e-4f61-b934-9552eda4a8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:22.064910 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2b71c-003e-4f61-b934-9552eda4a8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:22.065258 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2b71c-003e-4f61-b934-9552eda4a8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:22.065492 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2b71c-003e-4f61-b934-9552eda4a8fe admin admin] PATH_INFO: `/v3/projects/5c783c879df64ef0a107892bf115410f` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:22.067053 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2b71c-003e-4f61-b934-9552eda4a8fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c783c879df64ef0a107892bf115410f)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:22.068939 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2b71c-003e-4f61-b934-9552eda4a8fe admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:22.170962 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a8f2b71c-003e-4f61-b934-9552eda4a8fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c783c879df64ef0a107892bf115410f', 'request_id': 'req-a8f2b71c-003e-4f61-b934-9552eda4a8fe'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:22.186331 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a8f2b71c-003e-4f61-b934-9552eda4a8fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c783c879df64ef0a107892bf115410f', 'request_id': 'req-a8f2b71c-003e-4f61-b934-9552eda4a8fe'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:22.194758 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a8f2b71c-003e-4f61-b934-9552eda4a8fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c783c879df64ef0a107892bf115410f', 'request_id': 'req-a8f2b71c-003e-4f61-b934-9552eda4a8fe'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:22.214283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a8f2b71c-003e-4f61-b934-9552eda4a8fe admin admin] The token cache is being invalidate because project 5c783c879df64ef0a107892bf115410f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:41:22.214946 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a8f2b71c-003e-4f61-b934-9552eda4a8fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:22.216411 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a8f2b71c-003e-4f61-b934-9552eda4a8fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:41:22.220125 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1115/2262] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:41:22 2022] DELETE /identity/v3/projects/5c783c879df64ef0a107892bf115410f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:41:22.226960 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f27d6-c205-4281-908b-c8829f1307de None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:22.227498 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f27d6-c205-4281-908b-c8829f1307de None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:22.227498 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f27d6-c205-4281-908b-c8829f1307de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:22.273187 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-407f27d6-c205-4281-908b-c8829f1307de None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:22.274550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-407f27d6-c205-4281-908b-c8829f1307de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:22.396103 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1148/2263] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:22.404537 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2c726-37ce-45ac-8e49-fc66b441d2a0 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:22.404745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2c726-37ce-45ac-8e49-fc66b441d2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:22.405275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2c726-37ce-45ac-8e49-fc66b441d2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:22.441703 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d6f2c726-37ce-45ac-8e49-fc66b441d2a0 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:22.443181 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d6f2c726-37ce-45ac-8e49-fc66b441d2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:22.457957 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1116/2264] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:22.463725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f27d6-c205-4281-908b-c8829f1307de None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:22.477950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f27d6-c205-4281-908b-c8829f1307de None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:22.485624 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ed2e2-0fcf-4faa-bc4c-72a79660c822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:22.486643 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ed2e2-0fcf-4faa-bc4c-72a79660c822 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:22.489356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ed2e2-0fcf-4faa-bc4c-72a79660c822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:22.489356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ed2e2-0fcf-4faa-bc4c-72a79660c822 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:22.489356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ed2e2-0fcf-4faa-bc4c-72a79660c822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 15:41:22.489356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ed2e2-0fcf-4faa-bc4c-72a79660c822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:22.491826 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ed2e2-0fcf-4faa-bc4c-72a79660c822 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:22.511514 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1149/2265] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 15:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 15:41:22.512826 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2c726-37ce-45ac-8e49-fc66b441d2a0 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:22.532745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2c726-37ce-45ac-8e49-fc66b441d2a0 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:22.537621 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceffea2-aa2c-47a7-9a69-4dbe3271915e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:22.538878 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceffea2-aa2c-47a7-9a69-4dbe3271915e admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:22.539279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceffea2-aa2c-47a7-9a69-4dbe3271915e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:22.539650 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceffea2-aa2c-47a7-9a69-4dbe3271915e admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:22.540704 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceffea2-aa2c-47a7-9a69-4dbe3271915e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:22.543030 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceffea2-aa2c-47a7-9a69-4dbe3271915e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:22.572609 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:22.590122 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1117/2266] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:41:22 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:41:22.595044 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ed2e2-0fcf-4faa-bc4c-72a79660c822 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:22.611355 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ed2e2-0fcf-4faa-bc4c-72a79660c822 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:22.697832 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbc7d6-7cc3-460c-a593-9db7700ddfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:22.698973 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbc7d6-7cc3-460c-a593-9db7700ddfdf admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:22.699320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbc7d6-7cc3-460c-a593-9db7700ddfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:22.699655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbc7d6-7cc3-460c-a593-9db7700ddfdf admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:22.704309 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbc7d6-7cc3-460c-a593-9db7700ddfdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:22.706352 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbc7d6-7cc3-460c-a593-9db7700ddfdf admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:22.751934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1150/2267] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:41:22 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:41:22.752256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceffea2-aa2c-47a7-9a69-4dbe3271915e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:22.770130 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceffea2-aa2c-47a7-9a69-4dbe3271915e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:22.773523 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ef8dc-b41a-4075-9db1-b950a02ea527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:22.774592 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ef8dc-b41a-4075-9db1-b950a02ea527 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:22.774886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ef8dc-b41a-4075-9db1-b950a02ea527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:22.775171 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ef8dc-b41a-4075-9db1-b950a02ea527 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:22.775920 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ef8dc-b41a-4075-9db1-b950a02ea527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:22.777930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ef8dc-b41a-4075-9db1-b950a02ea527 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:22.791852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1118/2268] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:41:22.796895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbc7d6-7cc3-460c-a593-9db7700ddfdf admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:22.813872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbc7d6-7cc3-460c-a593-9db7700ddfdf admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:22.823594 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a0456-fa34-4600-91a4-7ef5b5196866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:22.825038 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a0456-fa34-4600-91a4-7ef5b5196866 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:22.825525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a0456-fa34-4600-91a4-7ef5b5196866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:22.825940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a0456-fa34-4600-91a4-7ef5b5196866 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:22.828152 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a0456-fa34-4600-91a4-7ef5b5196866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:22.830584 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a0456-fa34-4600-91a4-7ef5b5196866 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:22.844610 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1151/2269] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:41:22.850917 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ef8dc-b41a-4075-9db1-b950a02ea527 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:22.865864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ef8dc-b41a-4075-9db1-b950a02ea527 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:22.872968 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe30bf4-d407-4d18-b296-603bfc97cba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:22.875473 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe30bf4-d407-4d18-b296-603bfc97cba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:22.882170 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe30bf4-d407-4d18-b296-603bfc97cba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:22.883612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe30bf4-d407-4d18-b296-603bfc97cba0 admin admin] PATH_INFO: `/v3/projects/afcd2ade25aa4862999924a5dcc01ea6/users/cd90157283b14734a25cd02027ec64cf/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:22.901438 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe30bf4-d407-4d18-b296-603bfc97cba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afcd2ade25aa4862999924a5dcc01ea6, user_id=cd90157283b14734a25cd02027ec64cf, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:22.904828 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe30bf4-d407-4d18-b296-603bfc97cba0 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:22.938557 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1119/2270] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:41:22 2022] PUT /identity/v3/projects/afcd2ade25aa4862999924a5dcc01ea6/users/cd90157283b14734a25cd02027ec64cf/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:41:22.941980 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7933e4-d20c-4df9-ade9-75197c8dd166 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:22.943552 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7933e4-d20c-4df9-ade9-75197c8dd166 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:22.943847 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7933e4-d20c-4df9-ade9-75197c8dd166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:22.969279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5d7933e4-d20c-4df9-ade9-75197c8dd166 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:22.970856 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5d7933e4-d20c-4df9-ade9-75197c8dd166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:22.994557 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:23.090741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1152/2271] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:23.104832 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe30bf4-d407-4d18-b296-603bfc97cba0 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:23.110188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4fe30bf4-d407-4d18-b296-603bfc97cba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:23.193763 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe30bf4-d407-4d18-b296-603bfc97cba0 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:23.198831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f30ae-4e36-445d-ac21-84871b7f54b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:23.199716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f30ae-4e36-445d-ac21-84871b7f54b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:23.200470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f30ae-4e36-445d-ac21-84871b7f54b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:23.200801 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f30ae-4e36-445d-ac21-84871b7f54b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:23.219348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f30ae-4e36-445d-ac21-84871b7f54b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:23.221802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f30ae-4e36-445d-ac21-84871b7f54b6 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:23.234842 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1120/2272] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:41:23.947534 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e38684-02d7-41fa-a5b0-6748a529b453 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:23.948087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e38684-02d7-41fa-a5b0-6748a529b453 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:23.948087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e38684-02d7-41fa-a5b0-6748a529b453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:23.992172 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f9e38684-02d7-41fa-a5b0-6748a529b453 None None] MFA Rules not processed for user `828b58f859204e2e8aa40913853ec2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:23.993105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f9e38684-02d7-41fa-a5b0-6748a529b453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:24.122577 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1153/2273] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:41:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:24.140123 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f30ae-4e36-445d-ac21-84871b7f54b6 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:24.141840 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-608f30ae-4e36-445d-ac21-84871b7f54b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:24.251680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f30ae-4e36-445d-ac21-84871b7f54b6 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:24.261670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad98b3-f9a4-4010-b494-b90335f79d49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:24.262319 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad98b3-f9a4-4010-b494-b90335f79d49 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:24.262607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad98b3-f9a4-4010-b494-b90335f79d49 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:24.262931 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad98b3-f9a4-4010-b494-b90335f79d49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:24.271087 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-70ad98b3-f9a4-4010-b494-b90335f79d49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:24.370426 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad98b3-f9a4-4010-b494-b90335f79d49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:24.372356 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad98b3-f9a4-4010-b494-b90335f79d49 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:24.386478 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1121/2274] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:41:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:41:28.451152 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41fc7a-34c5-4c0b-b613-425c22cc1579 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:28.451711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41fc7a-34c5-4c0b-b613-425c22cc1579 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:28.452129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41fc7a-34c5-4c0b-b613-425c22cc1579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:28.484513 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-9f41fc7a-34c5-4c0b-b613-425c22cc1579 None None] MFA Rules not processed for user `cd90157283b14734a25cd02027ec64cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:28.485834 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9f41fc7a-34c5-4c0b-b613-425c22cc1579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:28.571254 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1154/2275] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:41:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:28.575916 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad98b3-f9a4-4010-b494-b90335f79d49 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:28.581705 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:28.588981 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad98b3-f9a4-4010-b494-b90335f79d49 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:28.594580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ed22b-40d4-4351-94c6-7dfd3c783cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:28.595246 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ed22b-40d4-4351-94c6-7dfd3c783cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:28.595632 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ed22b-40d4-4351-94c6-7dfd3c783cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:28.595809 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ed22b-40d4-4351-94c6-7dfd3c783cc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:28.596500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ed22b-40d4-4351-94c6-7dfd3c783cc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:28.598460 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ed22b-40d4-4351-94c6-7dfd3c783cc6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:28.632423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1122/2276] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 15:41:28 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 15:41:28.636706 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41fc7a-34c5-4c0b-b613-425c22cc1579 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:28.649434 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41fc7a-34c5-4c0b-b613-425c22cc1579 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:28.690847 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:28.729771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119cc29-1fe4-420e-9f49-3ac556a8e7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:28.730521 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119cc29-1fe4-420e-9f49-3ac556a8e7ce admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:28.730806 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119cc29-1fe4-420e-9f49-3ac556a8e7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:28.731094 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119cc29-1fe4-420e-9f49-3ac556a8e7ce admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:28.731771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119cc29-1fe4-420e-9f49-3ac556a8e7ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:28.734372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119cc29-1fe4-420e-9f49-3ac556a8e7ce admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:28.759995 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1155/2277] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 15:41:28 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 15:41:28.764249 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ed22b-40d4-4351-94c6-7dfd3c783cc6 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:28.776405 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ed22b-40d4-4351-94c6-7dfd3c783cc6 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:28.782720 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0516496-221e-45ce-92f1-d27f76d45406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:28.783429 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0516496-221e-45ce-92f1-d27f76d45406 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:28.783717 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0516496-221e-45ce-92f1-d27f76d45406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:28.784002 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0516496-221e-45ce-92f1-d27f76d45406 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:28.784740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0516496-221e-45ce-92f1-d27f76d45406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:28.786455 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0516496-221e-45ce-92f1-d27f76d45406 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:28.803195 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1123/2278] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 15:41:28.807606 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119cc29-1fe4-420e-9f49-3ac556a8e7ce admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:28.825107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119cc29-1fe4-420e-9f49-3ac556a8e7ce admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:28.832968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873393b9-57fa-426e-be6a-5a8493e29cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:28.833884 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873393b9-57fa-426e-be6a-5a8493e29cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:28.834234 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873393b9-57fa-426e-be6a-5a8493e29cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:28.834589 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873393b9-57fa-426e-be6a-5a8493e29cdc admin admin] PATH_INFO: `/v3/projects/e39680e4b37f4922bd6779b1e44cfd1c/users/9ee1380851a74b5fa769c5c407398a30/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:28.858433 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873393b9-57fa-426e-be6a-5a8493e29cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39680e4b37f4922bd6779b1e44cfd1c, user_id=9ee1380851a74b5fa769c5c407398a30, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:28.861563 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873393b9-57fa-426e-be6a-5a8493e29cdc admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:28.890432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1156/2279] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:41:28 2022] PUT /identity/v3/projects/e39680e4b37f4922bd6779b1e44cfd1c/users/9ee1380851a74b5fa769c5c407398a30/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:41:28.894579 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0516496-221e-45ce-92f1-d27f76d45406 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:28.906448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0516496-221e-45ce-92f1-d27f76d45406 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:29.026256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da3419-4996-4d7a-9ec7-716a36832996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:29.026942 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da3419-4996-4d7a-9ec7-716a36832996 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:29.027464 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da3419-4996-4d7a-9ec7-716a36832996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:29.027581 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da3419-4996-4d7a-9ec7-716a36832996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:29.028388 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da3419-4996-4d7a-9ec7-716a36832996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:29.030211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da3419-4996-4d7a-9ec7-716a36832996 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:29.046819 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1124/2280] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 15:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 15:41:29.048764 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873393b9-57fa-426e-be6a-5a8493e29cdc admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:29.064380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873393b9-57fa-426e-be6a-5a8493e29cdc admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:29.069273 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337ee7e-866d-44e4-898c-0807a513acfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:29.070837 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337ee7e-866d-44e4-898c-0807a513acfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:29.070837 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337ee7e-866d-44e4-898c-0807a513acfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:29.071048 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337ee7e-866d-44e4-898c-0807a513acfe admin admin] PATH_INFO: `/v3/projects/e39680e4b37f4922bd6779b1e44cfd1c/users/9ee1380851a74b5fa769c5c407398a30/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:29.073430 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337ee7e-866d-44e4-898c-0807a513acfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39680e4b37f4922bd6779b1e44cfd1c, user_id=9ee1380851a74b5fa769c5c407398a30, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:29.077654 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337ee7e-866d-44e4-898c-0807a513acfe admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:29.099361 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1157/2281] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 15:41:29 2022] PUT /identity/v3/projects/e39680e4b37f4922bd6779b1e44cfd1c/users/9ee1380851a74b5fa769c5c407398a30/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:41:34.404240 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3bf80-80ef-4c65-851a-c8bebdf4c432 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:34.405108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3bf80-80ef-4c65-851a-c8bebdf4c432 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:34.405108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3bf80-80ef-4c65-851a-c8bebdf4c432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:34.443889 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c6c3bf80-80ef-4c65-851a-c8bebdf4c432 None None] MFA Rules not processed for user `9ee1380851a74b5fa769c5c407398a30`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:34.445073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c6c3bf80-80ef-4c65-851a-c8bebdf4c432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:34.540107 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1125/2282] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:41:34 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:34.560659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337ee7e-866d-44e4-898c-0807a513acfe admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:41:34.564092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c337ee7e-866d-44e4-898c-0807a513acfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:34.678764 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337ee7e-866d-44e4-898c-0807a513acfe admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:41:34.687188 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4dde0-029a-4fd5-87d1-1701ccad18db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:41:34.687961 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4dde0-029a-4fd5-87d1-1701ccad18db service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:34.688432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4dde0-029a-4fd5-87d1-1701ccad18db service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:34.688802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4dde0-029a-4fd5-87d1-1701ccad18db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:34.755291 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4dde0-029a-4fd5-87d1-1701ccad18db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:41:34.756822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4dde0-029a-4fd5-87d1-1701ccad18db service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:41:34.767341 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1158/2283] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:41:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:41:35.924319 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dda40-aa68-4db9-8cf0-6f9a8e0f253a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:41:35.924851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dda40-aa68-4db9-8cf0-6f9a8e0f253a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:41:35.924964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3dda40-aa68-4db9-8cf0-6f9a8e0f253a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:41:35.942752 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-fe3dda40-aa68-4db9-8cf0-6f9a8e0f253a None None] MFA Rules not processed for user `cd90157283b14734a25cd02027ec64cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:41:35.943987 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-fe3dda40-aa68-4db9-8cf0-6f9a8e0f253a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:41:35.954690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1126/2284] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:41:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:41:44.762286 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=86,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:45.937101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=79,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:13.490046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088ff99-1452-4ff8-afe6-4ba0c030b006 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:13.490839 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088ff99-1452-4ff8-afe6-4ba0c030b006 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:13.490839 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088ff99-1452-4ff8-afe6-4ba0c030b006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:13.508936 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6088ff99-1452-4ff8-afe6-4ba0c030b006 None None] MFA Rules not processed for user `2f4c087814e748e892c6a3314e72582c`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:42:13.510171 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6088ff99-1452-4ff8-afe6-4ba0c030b006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:13.579683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1159/2285] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:42:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:42:23.570540 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=25 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:40.082336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dda40-aa68-4db9-8cf0-6f9a8e0f253a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:40.084779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-fe3dda40-aa68-4db9-8cf0-6f9a8e0f253a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:40.144550 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3dda40-aa68-4db9-8cf0-6f9a8e0f253a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:40.148899 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f7ec0-d961-424a-9aa5-9180fdc0a0a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:40.149557 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f7ec0-d961-424a-9aa5-9180fdc0a0a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:40.150245 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f7ec0-d961-424a-9aa5-9180fdc0a0a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:40.150245 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f7ec0-d961-424a-9aa5-9180fdc0a0a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:40.151950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b07f7ec0-d961-424a-9aa5-9180fdc0a0a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:40.166645 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f7ec0-d961-424a-9aa5-9180fdc0a0a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:40.168093 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f7ec0-d961-424a-9aa5-9180fdc0a0a0 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:40.179152 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1127/2286] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:42:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:42.717093 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088ff99-1452-4ff8-afe6-4ba0c030b006 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:42.727148 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088ff99-1452-4ff8-afe6-4ba0c030b006 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:42.730723 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e31fb-0438-45de-8dbf-b0e17363e42d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:42.731374 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e31fb-0438-45de-8dbf-b0e17363e42d service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:42.731658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e31fb-0438-45de-8dbf-b0e17363e42d service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:42.731934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e31fb-0438-45de-8dbf-b0e17363e42d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:42.733760 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8a0e31fb-0438-45de-8dbf-b0e17363e42d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:42.748986 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e31fb-0438-45de-8dbf-b0e17363e42d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:42.750536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e31fb-0438-45de-8dbf-b0e17363e42d service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:42.764817 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1160/2287] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:42:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:42:50.174199 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=26 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:52.757557 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:53.746968 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f7ec0-d961-424a-9aa5-9180fdc0a0a0 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:42:53.748431 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b07f7ec0-d961-424a-9aa5-9180fdc0a0a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:53.805120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f7ec0-d961-424a-9aa5-9180fdc0a0a0 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:42:53.809001 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c61583-022a-4b10-adde-5468a4155d9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:42:53.809645 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c61583-022a-4b10-adde-5468a4155d9c service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:42:53.809928 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c61583-022a-4b10-adde-5468a4155d9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:42:53.810244 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c61583-022a-4b10-adde-5468a4155d9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:42:53.812372 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-57c61583-022a-4b10-adde-5468a4155d9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:42:53.871303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c61583-022a-4b10-adde-5468a4155d9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:42:53.872743 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c61583-022a-4b10-adde-5468a4155d9c service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:42:53.881719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1128/2288] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:42:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:02.791425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e31fb-0438-45de-8dbf-b0e17363e42d service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:02.802262 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e31fb-0438-45de-8dbf-b0e17363e42d service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:02.807312 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9b6b4-bb23-4ac4-aaef-3d9ace89d171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:02.808108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9b6b4-bb23-4ac4-aaef-3d9ace89d171 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:02.808802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9b6b4-bb23-4ac4-aaef-3d9ace89d171 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:02.809300 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9b6b4-bb23-4ac4-aaef-3d9ace89d171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:02.813317 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ece9b6b4-bb23-4ac4-aaef-3d9ace89d171 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:02.938377 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9b6b4-bb23-4ac4-aaef-3d9ace89d171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:02.940903 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9b6b4-bb23-4ac4-aaef-3d9ace89d171 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:02.966328 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1161/2289] 10.222.0.39 () {60 vars in 1396 bytes} [Thu Jul 14 15:43:02 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:03.877538 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=48 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:04.215513 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c61583-022a-4b10-adde-5468a4155d9c service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:04.225188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c61583-022a-4b10-adde-5468a4155d9c service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:04.229087 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c97ff-8fff-4ea0-ad38-fbe4b60fbe9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:04.229937 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c97ff-8fff-4ea0-ad38-fbe4b60fbe9e service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:04.230425 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c97ff-8fff-4ea0-ad38-fbe4b60fbe9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:04.230702 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c97ff-8fff-4ea0-ad38-fbe4b60fbe9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:04.232496 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-288c97ff-8fff-4ea0-ad38-fbe4b60fbe9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:04.307084 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c97ff-8fff-4ea0-ad38-fbe4b60fbe9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:04.308582 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c97ff-8fff-4ea0-ad38-fbe4b60fbe9e service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:04.319976 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1129/2290] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:43:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:04.916702 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558600d-9773-4293-8672-1d932eb49f62 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:04.917863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558600d-9773-4293-8672-1d932eb49f62 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:04.918478 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558600d-9773-4293-8672-1d932eb49f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:04.939049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4558600d-9773-4293-8672-1d932eb49f62 None None] MFA Rules not processed for user `7791b825f4274af19051fd0fd884274f`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:04.940529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4558600d-9773-4293-8672-1d932eb49f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:04.950278 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1162/2291] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:43:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:05.311274 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c97ff-8fff-4ea0-ad38-fbe4b60fbe9e service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:05.321496 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c97ff-8fff-4ea0-ad38-fbe4b60fbe9e service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:05.325077 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723cd88e-5d94-4f99-9521-11a3639030f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:05.325716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cd88e-5d94-4f99-9521-11a3639030f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:05.325999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cd88e-5d94-4f99-9521-11a3639030f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:05.326313 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cd88e-5d94-4f99-9521-11a3639030f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:05.328081 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-723cd88e-5d94-4f99-9521-11a3639030f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:05.338412 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723cd88e-5d94-4f99-9521-11a3639030f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:05.339848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723cd88e-5d94-4f99-9521-11a3639030f3 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:05.347814 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1130/2292] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:43:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:05.690689 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558600d-9773-4293-8672-1d932eb49f62 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:05.692211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4558600d-9773-4293-8672-1d932eb49f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:05.765480 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558600d-9773-4293-8672-1d932eb49f62 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:05.770460 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92709862-b3dc-4bc2-8927-f5fd86594d7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:05.771202 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92709862-b3dc-4bc2-8927-f5fd86594d7a service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:05.771484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92709862-b3dc-4bc2-8927-f5fd86594d7a service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:05.771757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92709862-b3dc-4bc2-8927-f5fd86594d7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:05.773524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-92709862-b3dc-4bc2-8927-f5fd86594d7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:05.784522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92709862-b3dc-4bc2-8927-f5fd86594d7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:05.786915 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92709862-b3dc-4bc2-8927-f5fd86594d7a service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:05.796615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1163/2293] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:43:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:07.892175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723cd88e-5d94-4f99-9521-11a3639030f3 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:07.902597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723cd88e-5d94-4f99-9521-11a3639030f3 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:07.907602 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2de7d2-7e89-405c-8e16-a8104b256e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:07.908442 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2de7d2-7e89-405c-8e16-a8104b256e68 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:07.908824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2de7d2-7e89-405c-8e16-a8104b256e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:07.909351 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2de7d2-7e89-405c-8e16-a8104b256e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:07.911861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5a2de7d2-7e89-405c-8e16-a8104b256e68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:07.923219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2de7d2-7e89-405c-8e16-a8104b256e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:07.924731 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2de7d2-7e89-405c-8e16-a8104b256e68 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:07.937679 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1131/2294] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:43:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:12.462794 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8175c88-153e-4adf-b6ae-43f3f7e07379 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:12.463340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8175c88-153e-4adf-b6ae-43f3f7e07379 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:12.463340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8175c88-153e-4adf-b6ae-43f3f7e07379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:12.482030 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b8175c88-153e-4adf-b6ae-43f3f7e07379 None None] MFA Rules not processed for user `8103402ac83c4b4191a3ec4d55038e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:12.483320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b8175c88-153e-4adf-b6ae-43f3f7e07379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:12.543840 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1164/2295] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jul 14 15:43:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:12.596631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2de7d2-7e89-405c-8e16-a8104b256e68 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:12.603081 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5a2de7d2-7e89-405c-8e16-a8104b256e68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:12.702347 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2de7d2-7e89-405c-8e16-a8104b256e68 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:12.719790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce0c7c-0180-485c-8d85-8636f73e5c76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edbbc94ca71c42c0aac562c8c2ec83db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:12.720479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce0c7c-0180-485c-8d85-8636f73e5c76 service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:12.720772 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce0c7c-0180-485c-8d85-8636f73e5c76 service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:12.721056 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce0c7c-0180-485c-8d85-8636f73e5c76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:12.733015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce0c7c-0180-485c-8d85-8636f73e5c76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:12.735431 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce0c7c-0180-485c-8d85-8636f73e5c76 service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:12.745193 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1132/2296] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jul 14 15:43:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:43:22.537123 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=88 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:22.741360 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=72 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:27.836560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8175c88-153e-4adf-b6ae-43f3f7e07379 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:27.847497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8175c88-153e-4adf-b6ae-43f3f7e07379 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:27.853025 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6225c-1a38-4050-ac1a-928490d48df9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:27.853680 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6225c-1a38-4050-ac1a-928490d48df9 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.853964 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6225c-1a38-4050-ac1a-928490d48df9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.854265 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6225c-1a38-4050-ac1a-928490d48df9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.856083 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-84a6225c-1a38-4050-ac1a-928490d48df9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:27.867321 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6225c-1a38-4050-ac1a-928490d48df9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:27.868980 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6225c-1a38-4050-ac1a-928490d48df9 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:27.877343 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1165/2297] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:43:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:27.985437 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47d1e3-5d63-403f-b8c3-ed133be4dea0 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.985984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47d1e3-5d63-403f-b8c3-ed133be4dea0 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.986089 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47d1e3-5d63-403f-b8c3-ed133be4dea0 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:27.987436 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1133/2298] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jul 14 15:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:43:27.994517 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062b219-400c-4428-8945-fd1972ed817f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:27.994893 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062b219-400c-4428-8945-fd1972ed817f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:27.995253 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062b219-400c-4428-8945-fd1972ed817f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.014385 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4062b219-400c-4428-8945-fd1972ed817f None None] MFA Rules not processed for user `64f6b597a47c4a0eb08d1eabc4c0305c`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:28.015592 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4062b219-400c-4428-8945-fd1972ed817f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:28.026167 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1166/2299] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jul 14 15:43:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:28.041397 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47d1e3-5d63-403f-b8c3-ed133be4dea0 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:28.043133 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7b47d1e3-5d63-403f-b8c3-ed133be4dea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:28.104009 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47d1e3-5d63-403f-b8c3-ed133be4dea0 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:28.107582 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118f4c2-5141-42f4-a593-69e137409d68 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14c582c1127142f8a4ebf64bb7b34516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:28.108226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118f4c2-5141-42f4-a593-69e137409d68 service glance] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:28.108512 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118f4c2-5141-42f4-a593-69e137409d68 service glance] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:28.108807 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118f4c2-5141-42f4-a593-69e137409d68 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.123712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118f4c2-5141-42f4-a593-69e137409d68 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:28.123712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118f4c2-5141-42f4-a593-69e137409d68 service glance] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:28.133073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1134/2300] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:43:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:28.201917 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a62b9f-42ce-4a8d-8135-6e1c92b30deb None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:28.202238 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a62b9f-42ce-4a8d-8135-6e1c92b30deb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:28.202517 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a62b9f-42ce-4a8d-8135-6e1c92b30deb None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.203893 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1167/2301] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jul 14 15:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:43:28.209666 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75786911-02e2-4b09-80d8-1e7abad82d60 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:28.209965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75786911-02e2-4b09-80d8-1e7abad82d60 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:28.210275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75786911-02e2-4b09-80d8-1e7abad82d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.230050 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-75786911-02e2-4b09-80d8-1e7abad82d60 None None] MFA Rules not processed for user `7b82de4816a244c0b62b5f9f894ccaf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:28.231316 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-75786911-02e2-4b09-80d8-1e7abad82d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:28.237914 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1135/2302] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jul 14 15:43:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:28.250046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a62b9f-42ce-4a8d-8135-6e1c92b30deb None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:28.262100 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a62b9f-42ce-4a8d-8135-6e1c92b30deb None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:28.265722 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c383f-d26b-49a5-afc4-f515ddc17135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:28.266406 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c383f-d26b-49a5-afc4-f515ddc17135 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:28.266695 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c383f-d26b-49a5-afc4-f515ddc17135 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:28.266982 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c383f-d26b-49a5-afc4-f515ddc17135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.275204 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c383f-d26b-49a5-afc4-f515ddc17135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:28.276673 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c383f-d26b-49a5-afc4-f515ddc17135 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:28.285058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1168/2303] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:43:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:28.377738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325704f-cbaf-4847-bd63-9d7a8e74074e None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:28.377962 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325704f-cbaf-4847-bd63-9d7a8e74074e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:28.378275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325704f-cbaf-4847-bd63-9d7a8e74074e None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.380300 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1136/2304] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jul 14 15:43:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:43:28.385970 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a10fb4-c823-4316-a7b8-4a94c0b307c9 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:28.386285 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a10fb4-c823-4316-a7b8-4a94c0b307c9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:28.386562 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a10fb4-c823-4316-a7b8-4a94c0b307c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.408792 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b4a10fb4-c823-4316-a7b8-4a94c0b307c9 None None] MFA Rules not processed for user `64f6b597a47c4a0eb08d1eabc4c0305c`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:43:28.409993 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b4a10fb4-c823-4316-a7b8-4a94c0b307c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:28.423998 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1169/2305] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jul 14 15:43:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:43:28.435673 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325704f-cbaf-4847-bd63-9d7a8e74074e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:28.448808 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325704f-cbaf-4847-bd63-9d7a8e74074e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:28.452357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024b4d3-d1f0-4936-adbc-aad95c10386c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:28.453397 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024b4d3-d1f0-4936-adbc-aad95c10386c service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:28.453397 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024b4d3-d1f0-4936-adbc-aad95c10386c service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:28.453622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024b4d3-d1f0-4936-adbc-aad95c10386c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:28.463867 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024b4d3-d1f0-4936-adbc-aad95c10386c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:28.465294 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024b4d3-d1f0-4936-adbc-aad95c10386c service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:28.476253 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1137/2306] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:43:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:33.223992 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a10fb4-c823-4316-a7b8-4a94c0b307c9 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:43:33.235371 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a10fb4-c823-4316-a7b8-4a94c0b307c9 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:43:33.241379 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506a211-ba81-4b02-980d-ca892ccba320 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:43:33.242011 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506a211-ba81-4b02-980d-ca892ccba320 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:43:33.242321 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506a211-ba81-4b02-980d-ca892ccba320 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:43:33.242596 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506a211-ba81-4b02-980d-ca892ccba320 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:43:33.244449 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0506a211-ba81-4b02-980d-ca892ccba320 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:43:33.305219 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506a211-ba81-4b02-980d-ca892ccba320 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:43:33.306873 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506a211-ba81-4b02-980d-ca892ccba320 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:43:33.315892 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1170/2307] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:43:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:43:38.471538 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=35 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:43.311671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=46 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:54.304313 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024b4d3-d1f0-4936-adbc-aad95c10386c service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:44:54.317001 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024b4d3-d1f0-4936-adbc-aad95c10386c service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:44:54.335010 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c453f3e-1d4a-42c0-ad31-0b8a7a2d5d20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:44:54.337067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c453f3e-1d4a-42c0-ad31-0b8a7a2d5d20 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:44:54.337999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c453f3e-1d4a-42c0-ad31-0b8a7a2d5d20 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:44:54.338482 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c453f3e-1d4a-42c0-ad31-0b8a7a2d5d20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:44:54.340608 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6c453f3e-1d4a-42c0-ad31-0b8a7a2d5d20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:44:54.354328 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c453f3e-1d4a-42c0-ad31-0b8a7a2d5d20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:44:54.357331 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c453f3e-1d4a-42c0-ad31-0b8a7a2d5d20 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:44:54.369523 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1138/2308] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:44:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:45:04.364823 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=6 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:53.317088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506a211-ba81-4b02-980d-ca892ccba320 service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:45:53.337037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506a211-ba81-4b02-980d-ca892ccba320 service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:45:53.340838 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0733e-f788-4121-a573-9d889f8d6bd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:45:53.341487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0733e-f788-4121-a573-9d889f8d6bd0 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:45:53.341774 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0733e-f788-4121-a573-9d889f8d6bd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:45:53.342053 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0733e-f788-4121-a573-9d889f8d6bd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:45:53.343871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-edd0733e-f788-4121-a573-9d889f8d6bd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:45:53.430960 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0733e-f788-4121-a573-9d889f8d6bd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:45:53.432420 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0733e-f788-4121-a573-9d889f8d6bd0 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:45:53.442194 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1171/2309] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:45:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:46:03.437397 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=43 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:25.371322 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c453f3e-1d4a-42c0-ad31-0b8a7a2d5d20 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:46:25.437939 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c453f3e-1d4a-42c0-ad31-0b8a7a2d5d20 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:46:25.443700 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd5857-b3f1-4271-a2ab-12f5050e7592 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:46:25.444344 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd5857-b3f1-4271-a2ab-12f5050e7592 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:46:25.444630 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd5857-b3f1-4271-a2ab-12f5050e7592 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:46:25.444906 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd5857-b3f1-4271-a2ab-12f5050e7592 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:46:25.452899 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd5857-b3f1-4271-a2ab-12f5050e7592 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:46:25.454523 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd5857-b3f1-4271-a2ab-12f5050e7592 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:46:25.463871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1139/2310] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:46:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:46:35.441065 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0733e-f788-4121-a573-9d889f8d6bd0 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:46:35.459804 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=30 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:35.460334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0733e-f788-4121-a573-9d889f8d6bd0 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:46:35.464319 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad80671-67c3-49f5-98e2-92924909dfbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:46:35.464970 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad80671-67c3-49f5-98e2-92924909dfbc service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:46:35.465257 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad80671-67c3-49f5-98e2-92924909dfbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:46:35.465540 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad80671-67c3-49f5-98e2-92924909dfbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:46:35.474875 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad80671-67c3-49f5-98e2-92924909dfbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:46:35.476326 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad80671-67c3-49f5-98e2-92924909dfbc service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:46:35.485124 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1172/2311] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:46:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:46:45.481138 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=10 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:46.857928 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd5857-b3f1-4271-a2ab-12f5050e7592 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:46:46.881101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd5857-b3f1-4271-a2ab-12f5050e7592 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:46:46.886446 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72304274-8551-4649-9017-b5a1b33b684a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:46:46.887083 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72304274-8551-4649-9017-b5a1b33b684a service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:46:46.887398 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72304274-8551-4649-9017-b5a1b33b684a service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:46:46.887673 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72304274-8551-4649-9017-b5a1b33b684a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:46:46.889703 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-72304274-8551-4649-9017-b5a1b33b684a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:46:46.916169 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72304274-8551-4649-9017-b5a1b33b684a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:46:46.918056 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72304274-8551-4649-9017-b5a1b33b684a service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:46:46.929681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1140/2312] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:46:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:46:56.924185 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=15 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:36.728656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad80671-67c3-49f5-98e2-92924909dfbc service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:36.749034 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad80671-67c3-49f5-98e2-92924909dfbc service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:36.752691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446c14f-0a83-4017-8d03-ed841caa4ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:36.753343 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446c14f-0a83-4017-8d03-ed841caa4ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:36.753629 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446c14f-0a83-4017-8d03-ed841caa4ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:36.753910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446c14f-0a83-4017-8d03-ed841caa4ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:36.828308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446c14f-0a83-4017-8d03-ed841caa4ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:36.829685 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446c14f-0a83-4017-8d03-ed841caa4ce6 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:36.849801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1173/2313] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:47:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:47:40.277856 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910294d-60d3-425b-9044-7a793c8e00d8 None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:40.278401 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910294d-60d3-425b-9044-7a793c8e00d8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:40.278489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910294d-60d3-425b-9044-7a793c8e00d8 None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:40.279957 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1141/2314] 10.222.0.39 () {54 vars in 921 bytes} [Thu Jul 14 15:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:47:40.292480 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bdfb4-dafb-4a25-bbef-69652cad97e6 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:40.293051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bdfb4-dafb-4a25-bbef-69652cad97e6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:40.293051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bdfb4-dafb-4a25-bbef-69652cad97e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:40.387151 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6a0bdfb4-dafb-4a25-bbef-69652cad97e6 None None] MFA Rules not processed for user `1d1dbca57a4c43ce9bc37c2303417d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:47:40.388530 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6a0bdfb4-dafb-4a25-bbef-69652cad97e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:40.400662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1174/2315] 10.222.0.39 () {58 vars in 1018 bytes} [Thu Jul 14 15:47:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:47:40.413985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910294d-60d3-425b-9044-7a793c8e00d8 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:40.416571 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a910294d-60d3-425b-9044-7a793c8e00d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:40.441141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910294d-60d3-425b-9044-7a793c8e00d8 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:40.447923 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d380ea2-69d0-41c4-a60c-77d5268533ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:40.449944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d380ea2-69d0-41c4-a60c-77d5268533ef service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:40.449944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d380ea2-69d0-41c4-a60c-77d5268533ef service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:40.449944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d380ea2-69d0-41c4-a60c-77d5268533ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:40.459625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d380ea2-69d0-41c4-a60c-77d5268533ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:40.464247 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d380ea2-69d0-41c4-a60c-77d5268533ef service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:40.476448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1142/2316] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:47:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:47:40.583387 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bdfb4-dafb-4a25-bbef-69652cad97e6 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:40.594098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bdfb4-dafb-4a25-bbef-69652cad97e6 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:40.598277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca6d33-d58d-45a1-b84b-563eb22a2c30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:40.599006 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca6d33-d58d-45a1-b84b-563eb22a2c30 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:40.599500 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca6d33-d58d-45a1-b84b-563eb22a2c30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:40.599879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca6d33-d58d-45a1-b84b-563eb22a2c30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:40.615775 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca6d33-d58d-45a1-b84b-563eb22a2c30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:40.618463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca6d33-d58d-45a1-b84b-563eb22a2c30 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:40.630406 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1175/2317] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:47:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:47:42.922892 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d380ea2-69d0-41c4-a60c-77d5268533ef service placement] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:42.933519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d380ea2-69d0-41c4-a60c-77d5268533ef service placement] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:42.937685 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c248d53-116f-48a8-85ea-300e97d46465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:42.938514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c248d53-116f-48a8-85ea-300e97d46465 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:42.939185 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c248d53-116f-48a8-85ea-300e97d46465 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:42.939902 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c248d53-116f-48a8-85ea-300e97d46465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:42.953417 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c248d53-116f-48a8-85ea-300e97d46465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:42.955055 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c248d53-116f-48a8-85ea-300e97d46465 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:42.970910 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1143/2318] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:47:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:47:43.767454 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca6d33-d58d-45a1-b84b-563eb22a2c30 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:43.782377 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca6d33-d58d-45a1-b84b-563eb22a2c30 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:43.787556 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2775c4-8542-4de8-b8a7-5ea4e8254599 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:43.788316 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2775c4-8542-4de8-b8a7-5ea4e8254599 service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:43.788683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2775c4-8542-4de8-b8a7-5ea4e8254599 service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:43.788969 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2775c4-8542-4de8-b8a7-5ea4e8254599 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:43.790840 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dd2775c4-8542-4de8-b8a7-5ea4e8254599 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:43.802702 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2775c4-8542-4de8-b8a7-5ea4e8254599 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:43.804607 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2775c4-8542-4de8-b8a7-5ea4e8254599 service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:43.816169 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1176/2319] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:47:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:47:43.838923 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c248d53-116f-48a8-85ea-300e97d46465 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:43.856527 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c248d53-116f-48a8-85ea-300e97d46465 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:43.861296 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81f6a8-5cc4-43f8-bd1c-271a432e319b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:43.862187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81f6a8-5cc4-43f8-bd1c-271a432e319b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:43.862469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81f6a8-5cc4-43f8-bd1c-271a432e319b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:43.862741 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81f6a8-5cc4-43f8-bd1c-271a432e319b admin admin] PATH_INFO: `/v3/users/cd90157283b14734a25cd02027ec64cf` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:43.863920 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81f6a8-5cc4-43f8-bd1c-271a432e319b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd90157283b14734a25cd02027ec64cf)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:43.866763 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81f6a8-5cc4-43f8-bd1c-271a432e319b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:43.914496 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dd81f6a8-5cc4-43f8-bd1c-271a432e319b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd90157283b14734a25cd02027ec64cf'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:47:43.921209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dd81f6a8-5cc4-43f8-bd1c-271a432e319b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd90157283b14734a25cd02027ec64cf'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:47:43.933715 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dd81f6a8-5cc4-43f8-bd1c-271a432e319b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd90157283b14734a25cd02027ec64cf'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:47:43.941094 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dd81f6a8-5cc4-43f8-bd1c-271a432e319b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd90157283b14734a25cd02027ec64cf'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:47:43.941779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dd81f6a8-5cc4-43f8-bd1c-271a432e319b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd90157283b14734a25cd02027ec64cf'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:47:43.948546 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1144/2320] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:47:43 2022] DELETE /identity/v3/users/cd90157283b14734a25cd02027ec64cf => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:47:44.129762 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2775c4-8542-4de8-b8a7-5ea4e8254599 service placement] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:44.143358 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2775c4-8542-4de8-b8a7-5ea4e8254599 service placement] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:44.214461 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febecde7-527a-477b-992a-084ae544c5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:44.215326 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febecde7-527a-477b-992a-084ae544c5fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:44.215612 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febecde7-527a-477b-992a-084ae544c5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:44.215889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febecde7-527a-477b-992a-084ae544c5fa admin admin] PATH_INFO: `/v3/projects/afcd2ade25aa4862999924a5dcc01ea6` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:44.217121 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febecde7-527a-477b-992a-084ae544c5fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=afcd2ade25aa4862999924a5dcc01ea6)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:44.219176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febecde7-527a-477b-992a-084ae544c5fa admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:44.227528 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:44.282758 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-febecde7-527a-477b-992a-084ae544c5fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afcd2ade25aa4862999924a5dcc01ea6', 'request_id': 'req-febecde7-527a-477b-992a-084ae544c5fa'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:47:44.290407 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-febecde7-527a-477b-992a-084ae544c5fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afcd2ade25aa4862999924a5dcc01ea6', 'request_id': 'req-febecde7-527a-477b-992a-084ae544c5fa'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:47:44.301136 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-febecde7-527a-477b-992a-084ae544c5fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afcd2ade25aa4862999924a5dcc01ea6', 'request_id': 'req-febecde7-527a-477b-992a-084ae544c5fa'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:47:44.329174 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-febecde7-527a-477b-992a-084ae544c5fa admin admin] The token cache is being invalidate because project afcd2ade25aa4862999924a5dcc01ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:47:44.329304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-febecde7-527a-477b-992a-084ae544c5fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:47:44.329988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-febecde7-527a-477b-992a-084ae544c5fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:47:44.331623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1177/2321] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:47:44 2022] DELETE /identity/v3/projects/afcd2ade25aa4862999924a5dcc01ea6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:47:44.336069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81f6a8-5cc4-43f8-bd1c-271a432e319b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:44.337583 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-dd81f6a8-5cc4-43f8-bd1c-271a432e319b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:44.351185 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81f6a8-5cc4-43f8-bd1c-271a432e319b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:44.413730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b5e2e-66a1-469c-a9b2-1516023adf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:44.414807 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b5e2e-66a1-469c-a9b2-1516023adf1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:44.415224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b5e2e-66a1-469c-a9b2-1516023adf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:44.415634 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b5e2e-66a1-469c-a9b2-1516023adf1a admin admin] PATH_INFO: `/v3/users/9ee1380851a74b5fa769c5c407398a30` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:44.416928 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b5e2e-66a1-469c-a9b2-1516023adf1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ee1380851a74b5fa769c5c407398a30)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:44.418995 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b5e2e-66a1-469c-a9b2-1516023adf1a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:44.468204 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9f5b5e2e-66a1-469c-a9b2-1516023adf1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ee1380851a74b5fa769c5c407398a30'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:47:44.469419 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:44.478851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9f5b5e2e-66a1-469c-a9b2-1516023adf1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ee1380851a74b5fa769c5c407398a30'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:47:44.492876 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9f5b5e2e-66a1-469c-a9b2-1516023adf1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ee1380851a74b5fa769c5c407398a30'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:47:44.500981 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9f5b5e2e-66a1-469c-a9b2-1516023adf1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ee1380851a74b5fa769c5c407398a30'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:47:44.501616 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9f5b5e2e-66a1-469c-a9b2-1516023adf1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ee1380851a74b5fa769c5c407398a30'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:47:44.508258 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1145/2322] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:47:44 2022] DELETE /identity/v3/users/9ee1380851a74b5fa769c5c407398a30 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:47:44.688464 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febecde7-527a-477b-992a-084ae544c5fa admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:44.689940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-febecde7-527a-477b-992a-084ae544c5fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:44.708415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febecde7-527a-477b-992a-084ae544c5fa admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:44.782287 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541e5ea-8bbb-4c67-84cc-0d059556c426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:44.784226 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541e5ea-8bbb-4c67-84cc-0d059556c426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:44.784714 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541e5ea-8bbb-4c67-84cc-0d059556c426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:44.785159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541e5ea-8bbb-4c67-84cc-0d059556c426 admin admin] PATH_INFO: `/v3/projects/e39680e4b37f4922bd6779b1e44cfd1c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:44.786594 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541e5ea-8bbb-4c67-84cc-0d059556c426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e39680e4b37f4922bd6779b1e44cfd1c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:44.790841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541e5ea-8bbb-4c67-84cc-0d059556c426 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:44.837783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6541e5ea-8bbb-4c67-84cc-0d059556c426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e39680e4b37f4922bd6779b1e44cfd1c', 'request_id': 'req-6541e5ea-8bbb-4c67-84cc-0d059556c426'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:47:44.843272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6541e5ea-8bbb-4c67-84cc-0d059556c426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e39680e4b37f4922bd6779b1e44cfd1c', 'request_id': 'req-6541e5ea-8bbb-4c67-84cc-0d059556c426'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:47:44.851174 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6541e5ea-8bbb-4c67-84cc-0d059556c426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e39680e4b37f4922bd6779b1e44cfd1c', 'request_id': 'req-6541e5ea-8bbb-4c67-84cc-0d059556c426'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:47:44.862325 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6541e5ea-8bbb-4c67-84cc-0d059556c426 admin admin] The token cache is being invalidate because project e39680e4b37f4922bd6779b1e44cfd1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:47:44.862610 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6541e5ea-8bbb-4c67-84cc-0d059556c426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:47:44.863226 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6541e5ea-8bbb-4c67-84cc-0d059556c426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:47:44.864756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1178/2323] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:47:44 2022] DELETE /identity/v3/projects/e39680e4b37f4922bd6779b1e44cfd1c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:47:53.951555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b5e2e-66a1-469c-a9b2-1516023adf1a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:47:53.953117 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9f5b5e2e-66a1-469c-a9b2-1516023adf1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:54.049492 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b5e2e-66a1-469c-a9b2-1516023adf1a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:47:54.123061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251af1e6-e132-40ae-95e5-c0398656c9d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:47:54.123730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251af1e6-e132-40ae-95e5-c0398656c9d2 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:47:54.124014 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251af1e6-e132-40ae-95e5-c0398656c9d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:47:54.124318 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251af1e6-e132-40ae-95e5-c0398656c9d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:47:54.126131 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-251af1e6-e132-40ae-95e5-c0398656c9d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:47:54.178405 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:54.216826 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251af1e6-e132-40ae-95e5-c0398656c9d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:47:54.219687 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251af1e6-e132-40ae-95e5-c0398656c9d2 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:47:54.244986 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1146/2324] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:47:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:47:54.859257 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=78,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:02.974970 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541e5ea-8bbb-4c67-84cc-0d059556c426 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:02.977100 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6541e5ea-8bbb-4c67-84cc-0d059556c426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:03.047726 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541e5ea-8bbb-4c67-84cc-0d059556c426 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:03.051348 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e876bea-b024-41e9-8ccf-337433ee095b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:03.051995 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e876bea-b024-41e9-8ccf-337433ee095b service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:03.052284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e876bea-b024-41e9-8ccf-337433ee095b service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:03.052665 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e876bea-b024-41e9-8ccf-337433ee095b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:03.054548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5e876bea-b024-41e9-8ccf-337433ee095b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:03.138160 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e876bea-b024-41e9-8ccf-337433ee095b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:03.139619 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e876bea-b024-41e9-8ccf-337433ee095b service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:03.158288 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1179/2325] 10.222.0.39 () {60 vars in 1396 bytes} [Thu Jul 14 15:48:02 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:04.241826 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=18 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:04.801355 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251af1e6-e132-40ae-95e5-c0398656c9d2 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:04.802792 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-251af1e6-e132-40ae-95e5-c0398656c9d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:04.873635 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251af1e6-e132-40ae-95e5-c0398656c9d2 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:04.878156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c008635-4ff1-4ff4-a479-8a3e410003f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:04.879217 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c008635-4ff1-4ff4-a479-8a3e410003f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:04.879506 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c008635-4ff1-4ff4-a479-8a3e410003f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:04.879783 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c008635-4ff1-4ff4-a479-8a3e410003f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:04.895677 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5c008635-4ff1-4ff4-a479-8a3e410003f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:04.985086 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c008635-4ff1-4ff4-a479-8a3e410003f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:04.986600 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c008635-4ff1-4ff4-a479-8a3e410003f8 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:05.006426 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1147/2326] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:48:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:13.155329 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=66 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:14.404043 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54185c98-54ae-450a-b7bf-e9d21bb89a24 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:14.404725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54185c98-54ae-450a-b7bf-e9d21bb89a24 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:14.404725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54185c98-54ae-450a-b7bf-e9d21bb89a24 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:14.407084 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1180/2327] 10.222.0.39 () {54 vars in 912 bytes} [Thu Jul 14 15:48:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 15:48:14.413732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb9a5c-950d-4a90-8aa7-bbfcb9eb9857 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:14.415106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb9a5c-950d-4a90-8aa7-bbfcb9eb9857 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:14.416050 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb9a5c-950d-4a90-8aa7-bbfcb9eb9857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:14.439555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8ffb9a5c-950d-4a90-8aa7-bbfcb9eb9857 None None] MFA Rules not processed for user `1d1dbca57a4c43ce9bc37c2303417d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:14.440945 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8ffb9a5c-950d-4a90-8aa7-bbfcb9eb9857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:14.525862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1148/2328] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jul 14 15:48:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:14.552597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54185c98-54ae-450a-b7bf-e9d21bb89a24 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:14.556115 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-54185c98-54ae-450a-b7bf-e9d21bb89a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:14.574554 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54185c98-54ae-450a-b7bf-e9d21bb89a24 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:14.580216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135f983-1441-4d3a-bafd-4cf1bba269ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:14.580976 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135f983-1441-4d3a-bafd-4cf1bba269ba service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:14.581334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135f983-1441-4d3a-bafd-4cf1bba269ba service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:14.581687 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135f983-1441-4d3a-bafd-4cf1bba269ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:14.591205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135f983-1441-4d3a-bafd-4cf1bba269ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:14.593008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135f983-1441-4d3a-bafd-4cf1bba269ba service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:14.604138 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1181/2329] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:48:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:48:17.232221 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7608f-c786-49bd-8a0b-326e2f97a0d5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:17.232723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7608f-c786-49bd-8a0b-326e2f97a0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:17.232822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7608f-c786-49bd-8a0b-326e2f97a0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:17.252112 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:17.260265 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-8cc7608f-c786-49bd-8a0b-326e2f97a0d5 None None] MFA Rules not processed for user `a63509391b174805b4ae58b53195a44c`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:48:17.261509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8cc7608f-c786-49bd-8a0b-326e2f97a0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:17.268336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1149/2330] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:48:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:48:17.902743 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135f983-1441-4d3a-bafd-4cf1bba269ba service placement] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:17.914241 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135f983-1441-4d3a-bafd-4cf1bba269ba service placement] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:17.919780 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511afd6-d981-4b35-87ee-dc35ef6c3117 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:17.920425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511afd6-d981-4b35-87ee-dc35ef6c3117 service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:17.920716 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511afd6-d981-4b35-87ee-dc35ef6c3117 service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:17.921000 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511afd6-d981-4b35-87ee-dc35ef6c3117 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:17.922916 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3511afd6-d981-4b35-87ee-dc35ef6c3117 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:17.935909 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511afd6-d981-4b35-87ee-dc35ef6c3117 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:17.938511 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511afd6-d981-4b35-87ee-dc35ef6c3117 service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:17.950061 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1182/2331] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:48:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:19.791512 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7608f-c786-49bd-8a0b-326e2f97a0d5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:19.801450 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7608f-c786-49bd-8a0b-326e2f97a0d5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:19.805681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba407019-051e-4b22-956f-8ab76a19a83f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:19.806365 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba407019-051e-4b22-956f-8ab76a19a83f service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:19.806646 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba407019-051e-4b22-956f-8ab76a19a83f service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:19.806919 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba407019-051e-4b22-956f-8ab76a19a83f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:19.808736 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ba407019-051e-4b22-956f-8ab76a19a83f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:19.819194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba407019-051e-4b22-956f-8ab76a19a83f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:19.820795 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba407019-051e-4b22-956f-8ab76a19a83f service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:19.829243 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1150/2332] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:48:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:26.633958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511afd6-d981-4b35-87ee-dc35ef6c3117 service placement] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:26.635524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3511afd6-d981-4b35-87ee-dc35ef6c3117 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:26.651952 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511afd6-d981-4b35-87ee-dc35ef6c3117 service placement] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:26.657840 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724c4f3-83f9-452c-a28c-ed9e84d5423e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:26.658519 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724c4f3-83f9-452c-a28c-ed9e84d5423e service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:26.658811 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724c4f3-83f9-452c-a28c-ed9e84d5423e service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:26.659116 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724c4f3-83f9-452c-a28c-ed9e84d5423e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:26.660931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b724c4f3-83f9-452c-a28c-ed9e84d5423e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:26.673970 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724c4f3-83f9-452c-a28c-ed9e84d5423e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:26.675667 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724c4f3-83f9-452c-a28c-ed9e84d5423e service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:26.691894 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1183/2333] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:48:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:29.825415 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=7 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:33.261629 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba407019-051e-4b22-956f-8ab76a19a83f service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:48:33.271017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba407019-051e-4b22-956f-8ab76a19a83f service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:48:33.274759 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbd0a7-7911-436e-9164-527b3fd20d1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:48:33.275395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbd0a7-7911-436e-9164-527b3fd20d1b service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:48:33.275680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbd0a7-7911-436e-9164-527b3fd20d1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:48:33.275959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbd0a7-7911-436e-9164-527b3fd20d1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:48:33.277762 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-61cbd0a7-7911-436e-9164-527b3fd20d1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:48:33.359868 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbd0a7-7911-436e-9164-527b3fd20d1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:48:33.361309 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbd0a7-7911-436e-9164-527b3fd20d1b service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:48:33.379931 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1151/2334] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:48:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:48:36.683901 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=18 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:43.377193 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=41 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:29.118453 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65451467-aea6-4ec3-8536-56438f1e045d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:29.119239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65451467-aea6-4ec3-8536-56438f1e045d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:29.119239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65451467-aea6-4ec3-8536-56438f1e045d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:29.166640 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-65451467-aea6-4ec3-8536-56438f1e045d None None] MFA Rules not processed for user `8103402ac83c4b4191a3ec4d55038e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:29.167844 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-65451467-aea6-4ec3-8536-56438f1e045d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:29.233662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1184/2335] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jul 14 15:49:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:49:29.298026 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbd0a7-7911-436e-9164-527b3fd20d1b service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:29.299469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-61cbd0a7-7911-436e-9164-527b3fd20d1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:29.390192 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbd0a7-7911-436e-9164-527b3fd20d1b service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:29.395300 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f9f40-2aa3-4012-b511-30f55deef6af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edbbc94ca71c42c0aac562c8c2ec83db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:29.395942 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f9f40-2aa3-4012-b511-30f55deef6af service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:29.396249 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f9f40-2aa3-4012-b511-30f55deef6af service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:29.396520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f9f40-2aa3-4012-b511-30f55deef6af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:29.405512 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f9f40-2aa3-4012-b511-30f55deef6af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:29.407144 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f9f40-2aa3-4012-b511-30f55deef6af service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:29.415677 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1152/2336] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jul 14 15:49:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 15:49:30.657432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65451467-aea6-4ec3-8536-56438f1e045d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:30.670544 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65451467-aea6-4ec3-8536-56438f1e045d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:30.676981 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba89508-ecb7-4f82-91a0-13ce7b209178 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:30.677716 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba89508-ecb7-4f82-91a0-13ce7b209178 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:30.677947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba89508-ecb7-4f82-91a0-13ce7b209178 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:30.678235 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba89508-ecb7-4f82-91a0-13ce7b209178 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:30.680926 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1ba89508-ecb7-4f82-91a0-13ce7b209178 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:30.694700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba89508-ecb7-4f82-91a0-13ce7b209178 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:30.696890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba89508-ecb7-4f82-91a0-13ce7b209178 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:30.700486 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dda5a-f6da-4256-bf50-7d6002a202bc None None] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:30.700977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dda5a-f6da-4256-bf50-7d6002a202bc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:30.701150 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dda5a-f6da-4256-bf50-7d6002a202bc None None] PATH_INFO: `/` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:30.702753 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1153/2337] 10.222.0.39 () {54 vars in 912 bytes} [Thu Jul 14 15:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 15:49:30.708327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c132f-6bb4-4540-be0c-57aac3c1bc83 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:30.708496 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1185/2338] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:49:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:30.709162 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c132f-6bb4-4540-be0c-57aac3c1bc83 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:30.709723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c132f-6bb4-4540-be0c-57aac3c1bc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:30.730360 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-112c132f-6bb4-4540-be0c-57aac3c1bc83 None None] MFA Rules not processed for user `1d1dbca57a4c43ce9bc37c2303417d05`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:30.731573 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-112c132f-6bb4-4540-be0c-57aac3c1bc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:30.742595 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1154/2339] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jul 14 15:49:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 15:49:30.767399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba89508-ecb7-4f82-91a0-13ce7b209178 service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:30.779128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba89508-ecb7-4f82-91a0-13ce7b209178 service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:30.785087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70a1c9-207f-495f-8360-3a00a8064ac2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:30.785557 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70a1c9-207f-495f-8360-3a00a8064ac2 service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:30.785845 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70a1c9-207f-495f-8360-3a00a8064ac2 service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:30.786166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70a1c9-207f-495f-8360-3a00a8064ac2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:30.795552 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70a1c9-207f-495f-8360-3a00a8064ac2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:30.797210 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70a1c9-207f-495f-8360-3a00a8064ac2 service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:30.819771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1186/2340] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:49:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:33.111212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b86bff-52da-4aa1-a461-0832c734bdcd None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:33.111758 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b86bff-52da-4aa1-a461-0832c734bdcd None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:33.111758 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b86bff-52da-4aa1-a461-0832c734bdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:33.139859 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-66b86bff-52da-4aa1-a461-0832c734bdcd None None] MFA Rules not processed for user `f63aac7e7e0a458b8469bf0fd251daab`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 15:49:33.141093 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-66b86bff-52da-4aa1-a461-0832c734bdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:33.148177 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1155/2341] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 15:49:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 15:49:33.452850 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70a1c9-207f-495f-8360-3a00a8064ac2 service placement] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:49:33.454320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1c70a1c9-207f-495f-8360-3a00a8064ac2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:33.469211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70a1c9-207f-495f-8360-3a00a8064ac2 service placement] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:49:33.473162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2095f6-2b17-4c95-b9c7-50c8c2264c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:49:33.473899 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2095f6-2b17-4c95-b9c7-50c8c2264c60 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:49:33.474232 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2095f6-2b17-4c95-b9c7-50c8c2264c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:49:33.474515 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2095f6-2b17-4c95-b9c7-50c8c2264c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:49:33.476407 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6c2095f6-2b17-4c95-b9c7-50c8c2264c60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:49:33.487004 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2095f6-2b17-4c95-b9c7-50c8c2264c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:49:33.488567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2095f6-2b17-4c95-b9c7-50c8c2264c60 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:49:33.499260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1187/2342] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:49:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:49:43.137422 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=50 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:43.496007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=58 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:54.496576 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b86bff-52da-4aa1-a461-0832c734bdcd None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:50:54.498217 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-66b86bff-52da-4aa1-a461-0832c734bdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:54.510198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b86bff-52da-4aa1-a461-0832c734bdcd None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:50:54.514613 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf72e6-da84-4640-99ce-d2bbeb6f62dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:50:54.515297 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf72e6-da84-4640-99ce-d2bbeb6f62dc service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:50:54.515582 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf72e6-da84-4640-99ce-d2bbeb6f62dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:50:54.515856 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf72e6-da84-4640-99ce-d2bbeb6f62dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:50:54.517705 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d7bf72e6-da84-4640-99ce-d2bbeb6f62dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:50:54.596781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf72e6-da84-4640-99ce-d2bbeb6f62dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:50:54.598247 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf72e6-da84-4640-99ce-d2bbeb6f62dc service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:50:54.616390 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1156/2343] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:50:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:51:04.613294 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=41 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:51:06.302164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2095f6-2b17-4c95-b9c7-50c8c2264c60 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:51:06.303719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6c2095f6-2b17-4c95-b9c7-50c8c2264c60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:51:06.338660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2095f6-2b17-4c95-b9c7-50c8c2264c60 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:51:06.354838 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8927cd-a63d-427e-8341-455691a0529e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:51:06.354838 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8927cd-a63d-427e-8341-455691a0529e service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:51:06.354838 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8927cd-a63d-427e-8341-455691a0529e service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:51:06.355506 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8927cd-a63d-427e-8341-455691a0529e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:51:06.357503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-af8927cd-a63d-427e-8341-455691a0529e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:51:06.382872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8927cd-a63d-427e-8341-455691a0529e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:51:06.384790 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8927cd-a63d-427e-8341-455691a0529e service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:51:06.399006 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1188/2344] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:51:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:51:16.392714 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:51:24.993581 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf72e6-da84-4640-99ce-d2bbeb6f62dc service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:51:25.002449 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf72e6-da84-4640-99ce-d2bbeb6f62dc service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:51:25.006092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ae7a9-ed96-463f-94d0-3a00c029179c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:51:25.006728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ae7a9-ed96-463f-94d0-3a00c029179c service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:51:25.007012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ae7a9-ed96-463f-94d0-3a00c029179c service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:51:25.007290 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ae7a9-ed96-463f-94d0-3a00c029179c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:51:25.009156 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-926ae7a9-ed96-463f-94d0-3a00c029179c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:51:25.093109 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ae7a9-ed96-463f-94d0-3a00c029179c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:51:25.094995 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ae7a9-ed96-463f-94d0-3a00c029179c service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:51:25.113387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1157/2345] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:51:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:51:35.110648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=41 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:51:52.804423 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8927cd-a63d-427e-8341-455691a0529e service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:51:52.816434 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8927cd-a63d-427e-8341-455691a0529e service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:51:52.822060 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd628ddb-8f43-4c3a-af82-f1338160a2fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:51:52.822736 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd628ddb-8f43-4c3a-af82-f1338160a2fb service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:51:52.823023 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd628ddb-8f43-4c3a-af82-f1338160a2fb service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:51:52.823302 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd628ddb-8f43-4c3a-af82-f1338160a2fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:51:52.825163 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-fd628ddb-8f43-4c3a-af82-f1338160a2fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:51:52.836707 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd628ddb-8f43-4c3a-af82-f1338160a2fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:51:52.838334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd628ddb-8f43-4c3a-af82-f1338160a2fb service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:51:52.848859 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1189/2346] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:51:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:52:02.844676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:54.591844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ae7a9-ed96-463f-94d0-3a00c029179c service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:52:54.602648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ae7a9-ed96-463f-94d0-3a00c029179c service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:52:54.608076 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c1c2a-f09f-4474-9558-3611aa61ec33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:52:54.608921 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c1c2a-f09f-4474-9558-3611aa61ec33 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:52:54.609350 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c1c2a-f09f-4474-9558-3611aa61ec33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:52:54.609732 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c1c2a-f09f-4474-9558-3611aa61ec33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:52:54.620358 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c1c2a-f09f-4474-9558-3611aa61ec33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:52:54.621847 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c1c2a-f09f-4474-9558-3611aa61ec33 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:52:54.633030 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1158/2347] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:52:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:53:03.964678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd628ddb-8f43-4c3a-af82-f1338160a2fb service placement] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:03.975057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd628ddb-8f43-4c3a-af82-f1338160a2fb service placement] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:03.978634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d19f1-010c-4339-b175-86646bf564e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:03.979272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d19f1-010c-4339-b175-86646bf564e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:03.979558 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d19f1-010c-4339-b175-86646bf564e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:03.979902 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d19f1-010c-4339-b175-86646bf564e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:03.989511 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d19f1-010c-4339-b175-86646bf564e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:03.990996 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d19f1-010c-4339-b175-86646bf564e1 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:04.000534 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1190/2348] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:53:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:53:04.628145 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=6 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:06.032515 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c1c2a-f09f-4474-9558-3611aa61ec33 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:06.041241 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c1c2a-f09f-4474-9558-3611aa61ec33 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:06.045244 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd83c38-178e-49d5-ba27-c41ab2859018 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:06.045854 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd83c38-178e-49d5-ba27-c41ab2859018 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:06.046261 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd83c38-178e-49d5-ba27-c41ab2859018 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:06.046544 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd83c38-178e-49d5-ba27-c41ab2859018 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:06.055374 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd83c38-178e-49d5-ba27-c41ab2859018 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:06.056805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd83c38-178e-49d5-ba27-c41ab2859018 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:06.066503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1159/2349] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:53:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:53:13.996012 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:16.062444 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=6 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:32.505793 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d19f1-010c-4339-b175-86646bf564e1 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:53:32.515536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d19f1-010c-4339-b175-86646bf564e1 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:53:32.519595 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092d8ef-3773-43ca-835a-a18328860e32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:53:32.520235 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092d8ef-3773-43ca-835a-a18328860e32 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:53:32.520520 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092d8ef-3773-43ca-835a-a18328860e32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:53:32.524836 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092d8ef-3773-43ca-835a-a18328860e32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:53:32.530966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092d8ef-3773-43ca-835a-a18328860e32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:53:32.532412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092d8ef-3773-43ca-835a-a18328860e32 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:53:32.542219 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1191/2350] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:53:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:53:42.537673 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:00.487121 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd83c38-178e-49d5-ba27-c41ab2859018 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:00.497873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd83c38-178e-49d5-ba27-c41ab2859018 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:00.501555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb38a3-69b1-4e33-8bef-0f838d53ab44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:00.502233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb38a3-69b1-4e33-8bef-0f838d53ab44 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:00.502523 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb38a3-69b1-4e33-8bef-0f838d53ab44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:00.502801 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb38a3-69b1-4e33-8bef-0f838d53ab44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:00.510501 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb38a3-69b1-4e33-8bef-0f838d53ab44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:00.512548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb38a3-69b1-4e33-8bef-0f838d53ab44 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:00.521715 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1160/2351] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:54:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:54:10.517995 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=6 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:11.726921 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092d8ef-3773-43ca-835a-a18328860e32 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:11.736742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092d8ef-3773-43ca-835a-a18328860e32 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:11.740579 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f050e6-b976-48f2-96c6-99d74cc99bef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:11.741349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f050e6-b976-48f2-96c6-99d74cc99bef service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:11.741724 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f050e6-b976-48f2-96c6-99d74cc99bef service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:11.742183 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f050e6-b976-48f2-96c6-99d74cc99bef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:11.744088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-56f050e6-b976-48f2-96c6-99d74cc99bef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:11.758577 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f050e6-b976-48f2-96c6-99d74cc99bef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:11.760033 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f050e6-b976-48f2-96c6-99d74cc99bef service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:11.772033 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1192/2352] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:54:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:54:12.949074 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb38a3-69b1-4e33-8bef-0f838d53ab44 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:12.960896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb38a3-69b1-4e33-8bef-0f838d53ab44 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:12.965221 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149148e-0319-4601-ba09-bc19ca3a7085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:12.965930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149148e-0319-4601-ba09-bc19ca3a7085 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:12.966261 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149148e-0319-4601-ba09-bc19ca3a7085 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:12.966609 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149148e-0319-4601-ba09-bc19ca3a7085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:12.968468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e149148e-0319-4601-ba09-bc19ca3a7085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:12.985193 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149148e-0319-4601-ba09-bc19ca3a7085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:12.988121 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149148e-0319-4601-ba09-bc19ca3a7085 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:13.004574 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1161/2353] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:54:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:54:15.737723 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f050e6-b976-48f2-96c6-99d74cc99bef service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:15.749012 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f050e6-b976-48f2-96c6-99d74cc99bef service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:15.752785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f229bbb-f76a-4ff7-85da-e71b321da9a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:15.753371 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f229bbb-f76a-4ff7-85da-e71b321da9a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:15.753667 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f229bbb-f76a-4ff7-85da-e71b321da9a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:15.753933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f229bbb-f76a-4ff7-85da-e71b321da9a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:15.755800 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4f229bbb-f76a-4ff7-85da-e71b321da9a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:15.826567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f229bbb-f76a-4ff7-85da-e71b321da9a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:15.828041 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f229bbb-f76a-4ff7-85da-e71b321da9a5 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:15.837671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1193/2354] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:54:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:54:19.166622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149148e-0319-4601-ba09-bc19ca3a7085 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:19.168261 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e149148e-0319-4601-ba09-bc19ca3a7085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:19.189158 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149148e-0319-4601-ba09-bc19ca3a7085 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:19.196827 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3e1ff-74cb-4aa0-83d1-db400b954e0d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:19.198422 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3e1ff-74cb-4aa0-83d1-db400b954e0d service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:19.199590 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3e1ff-74cb-4aa0-83d1-db400b954e0d service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:19.200242 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3e1ff-74cb-4aa0-83d1-db400b954e0d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:19.202699 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b5d3e1ff-74cb-4aa0-83d1-db400b954e0d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:19.220103 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3e1ff-74cb-4aa0-83d1-db400b954e0d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:19.222041 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3e1ff-74cb-4aa0-83d1-db400b954e0d service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:19.241777 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1162/2355] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:54:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:54:22.586495 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f229bbb-f76a-4ff7-85da-e71b321da9a5 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:22.598987 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f229bbb-f76a-4ff7-85da-e71b321da9a5 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:22.605657 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ec785-c16e-46c3-ac6b-500b4c041e4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:22.606247 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ec785-c16e-46c3-ac6b-500b4c041e4d service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:22.606659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ec785-c16e-46c3-ac6b-500b4c041e4d service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:22.607125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ec785-c16e-46c3-ac6b-500b4c041e4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:22.609313 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d46ec785-c16e-46c3-ac6b-500b4c041e4d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:22.622698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ec785-c16e-46c3-ac6b-500b4c041e4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:22.624806 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ec785-c16e-46c3-ac6b-500b4c041e4d service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:22.648732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1194/2356] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:54:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:54:22.666998 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3e1ff-74cb-4aa0-83d1-db400b954e0d service placement] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:22.669674 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b5d3e1ff-74cb-4aa0-83d1-db400b954e0d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:22.685064 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3e1ff-74cb-4aa0-83d1-db400b954e0d service placement] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:22.689727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303b993-6599-4c92-b23c-73578030518f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:22.691093 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303b993-6599-4c92-b23c-73578030518f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:22.691279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303b993-6599-4c92-b23c-73578030518f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:22.691554 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303b993-6599-4c92-b23c-73578030518f admin admin] PATH_INFO: `/v3/users/2f4c087814e748e892c6a3314e72582c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:22.692775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303b993-6599-4c92-b23c-73578030518f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f4c087814e748e892c6a3314e72582c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:22.694755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303b993-6599-4c92-b23c-73578030518f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:22.753679 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a303b993-6599-4c92-b23c-73578030518f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f4c087814e748e892c6a3314e72582c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:22.761453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a303b993-6599-4c92-b23c-73578030518f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f4c087814e748e892c6a3314e72582c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:22.783695 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a303b993-6599-4c92-b23c-73578030518f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f4c087814e748e892c6a3314e72582c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:22.795349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a303b993-6599-4c92-b23c-73578030518f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f4c087814e748e892c6a3314e72582c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:22.795964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a303b993-6599-4c92-b23c-73578030518f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f4c087814e748e892c6a3314e72582c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:22.802765 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1163/2357] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:54:22 2022] DELETE /identity/v3/users/2f4c087814e748e892c6a3314e72582c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:54:22.984769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ec785-c16e-46c3-ac6b-500b4c041e4d service placement] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:22.996826 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ec785-c16e-46c3-ac6b-500b4c041e4d service placement] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:23.060298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718663a-f44e-4c8e-859e-1a63be092980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:23.061169 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718663a-f44e-4c8e-859e-1a63be092980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:23.061478 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718663a-f44e-4c8e-859e-1a63be092980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:23.061755 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718663a-f44e-4c8e-859e-1a63be092980 admin admin] PATH_INFO: `/v3/projects/2174489f71234ee6a072e17f0c59a640` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:23.062985 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718663a-f44e-4c8e-859e-1a63be092980 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2174489f71234ee6a072e17f0c59a640)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:23.064940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718663a-f44e-4c8e-859e-1a63be092980 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:23.112109 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3718663a-f44e-4c8e-859e-1a63be092980 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2174489f71234ee6a072e17f0c59a640', 'request_id': 'req-3718663a-f44e-4c8e-859e-1a63be092980'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:23.120279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3718663a-f44e-4c8e-859e-1a63be092980 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2174489f71234ee6a072e17f0c59a640', 'request_id': 'req-3718663a-f44e-4c8e-859e-1a63be092980'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:23.128785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3718663a-f44e-4c8e-859e-1a63be092980 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2174489f71234ee6a072e17f0c59a640', 'request_id': 'req-3718663a-f44e-4c8e-859e-1a63be092980'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:23.136738 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:23.141848 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3718663a-f44e-4c8e-859e-1a63be092980 admin admin] The token cache is being invalidate because project 2174489f71234ee6a072e17f0c59a640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:54:23.142199 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3718663a-f44e-4c8e-859e-1a63be092980 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:23.143691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3718663a-f44e-4c8e-859e-1a63be092980 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:23.145791 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1195/2358] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:54:22 2022] DELETE /identity/v3/projects/2174489f71234ee6a072e17f0c59a640 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:54:23.150147 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303b993-6599-4c92-b23c-73578030518f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:23.152969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a303b993-6599-4c92-b23c-73578030518f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:23.166878 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303b993-6599-4c92-b23c-73578030518f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:23.229136 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3b4a3-bae9-490b-9bdd-2ee1a270390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:23.230999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3b4a3-bae9-490b-9bdd-2ee1a270390e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:23.231286 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3b4a3-bae9-490b-9bdd-2ee1a270390e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:23.231568 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3b4a3-bae9-490b-9bdd-2ee1a270390e admin admin] PATH_INFO: `/v3/users/828b58f859204e2e8aa40913853ec2bd` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:23.245214 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3b4a3-bae9-490b-9bdd-2ee1a270390e admin admin] RBAC: Authorizing `identity:delete_user(user_id=828b58f859204e2e8aa40913853ec2bd)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:23.248125 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3b4a3-bae9-490b-9bdd-2ee1a270390e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:23.287020 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:23.298750 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-aaa3b4a3-bae9-490b-9bdd-2ee1a270390e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '828b58f859204e2e8aa40913853ec2bd'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:23.306312 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-aaa3b4a3-bae9-490b-9bdd-2ee1a270390e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '828b58f859204e2e8aa40913853ec2bd'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:23.319880 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-aaa3b4a3-bae9-490b-9bdd-2ee1a270390e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '828b58f859204e2e8aa40913853ec2bd'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:23.328962 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-aaa3b4a3-bae9-490b-9bdd-2ee1a270390e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '828b58f859204e2e8aa40913853ec2bd'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:23.329831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-aaa3b4a3-bae9-490b-9bdd-2ee1a270390e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '828b58f859204e2e8aa40913853ec2bd'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:23.335933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1164/2359] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 15:54:23 2022] DELETE /identity/v3/users/828b58f859204e2e8aa40913853ec2bd => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:54:23.519057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718663a-f44e-4c8e-859e-1a63be092980 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:54:23.520632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3718663a-f44e-4c8e-859e-1a63be092980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:54:23.533978 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718663a-f44e-4c8e-859e-1a63be092980 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:54:23.591520 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd74ca-6fa2-46c0-a7b2-e79ffe64050f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:54:23.592371 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd74ca-6fa2-46c0-a7b2-e79ffe64050f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:54:23.592651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd74ca-6fa2-46c0-a7b2-e79ffe64050f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:54:23.592924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd74ca-6fa2-46c0-a7b2-e79ffe64050f admin admin] PATH_INFO: `/v3/projects/a58561b46fef4f96be183d346f28bcf9` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:54:23.603540 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd74ca-6fa2-46c0-a7b2-e79ffe64050f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58561b46fef4f96be183d346f28bcf9)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:54:23.606730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd74ca-6fa2-46c0-a7b2-e79ffe64050f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:54:23.655437 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-47cd74ca-6fa2-46c0-a7b2-e79ffe64050f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58561b46fef4f96be183d346f28bcf9', 'request_id': 'req-47cd74ca-6fa2-46c0-a7b2-e79ffe64050f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:23.661158 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-47cd74ca-6fa2-46c0-a7b2-e79ffe64050f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58561b46fef4f96be183d346f28bcf9', 'request_id': 'req-47cd74ca-6fa2-46c0-a7b2-e79ffe64050f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:23.669026 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-47cd74ca-6fa2-46c0-a7b2-e79ffe64050f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58561b46fef4f96be183d346f28bcf9', 'request_id': 'req-47cd74ca-6fa2-46c0-a7b2-e79ffe64050f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:23.680578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-47cd74ca-6fa2-46c0-a7b2-e79ffe64050f admin admin] The token cache is being invalidate because project a58561b46fef4f96be183d346f28bcf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 15:54:23.680914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-47cd74ca-6fa2-46c0-a7b2-e79ffe64050f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:23.681480 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-47cd74ca-6fa2-46c0-a7b2-e79ffe64050f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 15:54:23.683098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1196/2360] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 15:54:23 2022] DELETE /identity/v3/projects/a58561b46fef4f96be183d346f28bcf9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 15:54:33.332371 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=15,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:33.677478 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=56,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:53.880748 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3b4a3-bae9-490b-9bdd-2ee1a270390e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:55:53.882549 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-aaa3b4a3-bae9-490b-9bdd-2ee1a270390e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:55:53.978402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3b4a3-bae9-490b-9bdd-2ee1a270390e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:55:54.035372 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8d82e-38cd-4391-a0dc-4f25589462be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:55:54.036075 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8d82e-38cd-4391-a0dc-4f25589462be service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:55:54.036420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8d82e-38cd-4391-a0dc-4f25589462be service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:55:54.036789 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa8d82e-38cd-4391-a0dc-4f25589462be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:55:54.039077 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1aa8d82e-38cd-4391-a0dc-4f25589462be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:55:54.112713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8d82e-38cd-4391-a0dc-4f25589462be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:55:54.114224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa8d82e-38cd-4391-a0dc-4f25589462be service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:55:54.125643 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1165/2361] 10.222.0.39 () {60 vars in 1396 bytes} [Thu Jul 14 15:55:53 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:56:04.119892 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=72 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:58.793403 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd74ca-6fa2-46c0-a7b2-e79ffe64050f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:56:58.795948 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-47cd74ca-6fa2-46c0-a7b2-e79ffe64050f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:59.001233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd74ca-6fa2-46c0-a7b2-e79ffe64050f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:56:59.010399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c60ccb-2bc4-4dc6-af35-e54ca359d613 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:56:59.011080 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c60ccb-2bc4-4dc6-af35-e54ca359d613 service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:56:59.011368 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c60ccb-2bc4-4dc6-af35-e54ca359d613 service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:56:59.011648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c60ccb-2bc4-4dc6-af35-e54ca359d613 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:56:59.013589 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-52c60ccb-2bc4-4dc6-af35-e54ca359d613 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:56:59.028108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c60ccb-2bc4-4dc6-af35-e54ca359d613 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:56:59.030020 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c60ccb-2bc4-4dc6-af35-e54ca359d613 service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:56:59.041848 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1197/2362] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:56:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:09.036459 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=59 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:09.729320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8d82e-38cd-4391-a0dc-4f25589462be service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:09.731851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1aa8d82e-38cd-4391-a0dc-4f25589462be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:09.937226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa8d82e-38cd-4391-a0dc-4f25589462be service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:09.944871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f737c-318b-40e5-9471-00e7ee3950dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:09.946311 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f737c-318b-40e5-9471-00e7ee3950dd service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:09.946734 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f737c-318b-40e5-9471-00e7ee3950dd service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:09.947075 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f737c-318b-40e5-9471-00e7ee3950dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:09.949443 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-509f737c-318b-40e5-9471-00e7ee3950dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:09.972049 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f737c-318b-40e5-9471-00e7ee3950dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:09.974014 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f737c-318b-40e5-9471-00e7ee3950dd service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:09.987282 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1166/2363] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:57:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:57:19.981265 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=56 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:54.213926 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c60ccb-2bc4-4dc6-af35-e54ca359d613 service placement] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:57:54.232220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c60ccb-2bc4-4dc6-af35-e54ca359d613 service placement] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:57:54.241705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a91fcd-90d8-40c9-9b7c-2a71465d5d4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:57:54.242837 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a91fcd-90d8-40c9-9b7c-2a71465d5d4a service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:57:54.243204 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a91fcd-90d8-40c9-9b7c-2a71465d5d4a service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:57:54.243477 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a91fcd-90d8-40c9-9b7c-2a71465d5d4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:57:54.245853 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-10a91fcd-90d8-40c9-9b7c-2a71465d5d4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:57:54.380225 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a91fcd-90d8-40c9-9b7c-2a71465d5d4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:57:54.383800 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a91fcd-90d8-40c9-9b7c-2a71465d5d4a service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:57:54.418136 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1198/2364] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:57:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:58:02.544401 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f737c-318b-40e5-9471-00e7ee3950dd service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:02.545915 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-509f737c-318b-40e5-9471-00e7ee3950dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:02.648783 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f737c-318b-40e5-9471-00e7ee3950dd service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:02.653360 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32de947-b0b5-4312-bf28-d37d4c4956ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:02.654031 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32de947-b0b5-4312-bf28-d37d4c4956ef service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:02.654354 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32de947-b0b5-4312-bf28-d37d4c4956ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:02.654621 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32de947-b0b5-4312-bf28-d37d4c4956ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:02.656569 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f32de947-b0b5-4312-bf28-d37d4c4956ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:02.734930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32de947-b0b5-4312-bf28-d37d4c4956ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:02.736570 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32de947-b0b5-4312-bf28-d37d4c4956ef service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:02.748495 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1167/2365] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:58:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:58:04.408300 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a91fcd-90d8-40c9-9b7c-2a71465d5d4a service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:04.421678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a91fcd-90d8-40c9-9b7c-2a71465d5d4a service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:04.426184 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d57f10-848e-46d4-807e-759f026d82f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:04.427016 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d57f10-848e-46d4-807e-759f026d82f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:04.427310 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d57f10-848e-46d4-807e-759f026d82f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:04.427648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d57f10-848e-46d4-807e-759f026d82f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:04.430640 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-26d57f10-848e-46d4-807e-759f026d82f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:04.518586 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d57f10-848e-46d4-807e-759f026d82f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:04.519089 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d57f10-848e-46d4-807e-759f026d82f8 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:04.536574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1199/2366] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:58:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 15:58:12.743274 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=52 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:14.525981 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=69 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:32.534775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32de947-b0b5-4312-bf28-d37d4c4956ef service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:58:32.547242 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32de947-b0b5-4312-bf28-d37d4c4956ef service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:58:32.553798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67ce98-2fb3-4ac8-8b43-0cf8f9af0e9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:58:32.554983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67ce98-2fb3-4ac8-8b43-0cf8f9af0e9d service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:58:32.555392 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67ce98-2fb3-4ac8-8b43-0cf8f9af0e9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:58:32.555793 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67ce98-2fb3-4ac8-8b43-0cf8f9af0e9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:58:32.559424 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ac67ce98-2fb3-4ac8-8b43-0cf8f9af0e9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:58:32.659435 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67ce98-2fb3-4ac8-8b43-0cf8f9af0e9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:58:32.667875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67ce98-2fb3-4ac8-8b43-0cf8f9af0e9d service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:58:32.689223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1168/2367] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:58:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:58:42.679783 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=28 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:11.975874 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d57f10-848e-46d4-807e-759f026d82f8 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:11.978285 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-26d57f10-848e-46d4-807e-759f026d82f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:12.048263 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d57f10-848e-46d4-807e-759f026d82f8 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:12.055260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39964325-71bc-4aeb-a666-0a2d3c3e2beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:12.059320 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39964325-71bc-4aeb-a666-0a2d3c3e2beb service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:12.059606 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39964325-71bc-4aeb-a666-0a2d3c3e2beb service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:12.060165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39964325-71bc-4aeb-a666-0a2d3c3e2beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:12.063538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-39964325-71bc-4aeb-a666-0a2d3c3e2beb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:12.113666 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39964325-71bc-4aeb-a666-0a2d3c3e2beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:12.115199 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39964325-71bc-4aeb-a666-0a2d3c3e2beb service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:12.127955 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1200/2368] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:59:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:59:13.192352 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67ce98-2fb3-4ac8-8b43-0cf8f9af0e9d service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 15:59:13.193820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ac67ce98-2fb3-4ac8-8b43-0cf8f9af0e9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:13.206267 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67ce98-2fb3-4ac8-8b43-0cf8f9af0e9d service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 15:59:13.210770 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c6357-d255-4f07-b399-b6e729f37338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 15:59:13.211420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c6357-d255-4f07-b399-b6e729f37338 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 15:59:13.211702 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c6357-d255-4f07-b399-b6e729f37338 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 15:59:13.211975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c6357-d255-4f07-b399-b6e729f37338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 15:59:13.213790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-844c6357-d255-4f07-b399-b6e729f37338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 15:59:13.228490 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c6357-d255-4f07-b399-b6e729f37338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 15:59:13.229940 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c6357-d255-4f07-b399-b6e729f37338 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 15:59:13.242085 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1169/2369] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 15:59:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 15:59:22.122407 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=20 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:23.237581 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=6 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:06.472812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39964325-71bc-4aeb-a666-0a2d3c3e2beb service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:06.481712 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39964325-71bc-4aeb-a666-0a2d3c3e2beb service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:06.485762 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b90f03-cd7e-4051-a683-699c6e0c76c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:06.487048 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b90f03-cd7e-4051-a683-699c6e0c76c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:06.487332 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b90f03-cd7e-4051-a683-699c6e0c76c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:06.487609 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b90f03-cd7e-4051-a683-699c6e0c76c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:06.489531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-09b90f03-cd7e-4051-a683-699c6e0c76c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:06.499782 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b90f03-cd7e-4051-a683-699c6e0c76c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:06.501233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b90f03-cd7e-4051-a683-699c6e0c76c5 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:06.509922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1201/2370] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:00:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:00:16.505975 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:54.383670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c6357-d255-4f07-b399-b6e729f37338 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:00:54.385182 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-844c6357-d255-4f07-b399-b6e729f37338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:00:54.412563 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c6357-d255-4f07-b399-b6e729f37338 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:00:54.416576 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf3d61-116e-4da3-ad5b-425f46f81aa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:00:54.417402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf3d61-116e-4da3-ad5b-425f46f81aa4 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:00:54.417689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf3d61-116e-4da3-ad5b-425f46f81aa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:00:54.417969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf3d61-116e-4da3-ad5b-425f46f81aa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:00:54.428068 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf3d61-116e-4da3-ad5b-425f46f81aa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:00:54.429652 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf3d61-116e-4da3-ad5b-425f46f81aa4 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:00:54.440858 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1170/2371] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:00:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:01:04.435211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=11 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:04.746747 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b90f03-cd7e-4051-a683-699c6e0c76c5 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:01:04.774746 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b90f03-cd7e-4051-a683-699c6e0c76c5 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:01:04.782544 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f4d38-dd14-4b51-831d-601eecce9efc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:01:04.784044 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f4d38-dd14-4b51-831d-601eecce9efc service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:01:04.784580 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f4d38-dd14-4b51-831d-601eecce9efc service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:01:04.784948 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f4d38-dd14-4b51-831d-601eecce9efc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:01:04.787064 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6e3f4d38-dd14-4b51-831d-601eecce9efc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:01:04.807933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-6e3f4d38-dd14-4b51-831d-601eecce9efc service cinder] Could not find project: 2174489f71234ee6a072e17f0c59a640.: keystone.exception.ProjectNotFound: Could not find project: 2174489f71234ee6a072e17f0c59a640. Jul 14 16:01:04.807933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 16:01:04.807933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 16:01:04.807933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 16:01:04.807933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 16:01:04.807933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 16:01:04.807933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 16:01:04.807933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 16:01:04.807933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 16:01:04.807933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 16:01:04.807933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 16:01:04.807933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 16:01:04.807933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jul 14 16:01:04.807933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jul 14 16:01:04.807933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 14 16:01:04.810639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 14 16:01:04.810639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 14 16:01:04.810639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 14 16:01:04.810639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 16:01:04.810639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 16:01:04.810639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Jul 14 16:01:04.810639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Jul 14 16:01:04.810639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 16:01:04.810639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 16:01:04.810639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 16:01:04.810639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 16:01:04.810639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 16:01:04.810639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 16:01:04.810639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 16:01:04.810639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 16:01:04.810639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 16:01:04.810639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 16:01:04.812925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 16:01:04.812925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 16:01:04.812925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 16:01:04.812925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 16:01:04.812925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Jul 14 16:01:04.812925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Jul 14 16:01:04.812925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Jul 14 16:01:04.812925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._validate_token_resources() Jul 14 16:01:04.812925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Jul 14 16:01:04.812925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Jul 14 16:01:04.812925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Jul 14 16:01:04.812925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Jul 14 16:01:04.812925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 16:01:04.812925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 16:01:04.812925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 16:01:04.812925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 16:01:04.812925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 16:01:04.814787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 16:01:04.814787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 16:01:04.814787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 16:01:04.814787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 16:01:04.814787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 16:01:04.814787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 16:01:04.814787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 16:01:04.814787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 16:01:04.814787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 16:01:04.814787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 16:01:04.814787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 16:01:04.814787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 16:01:04.814787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 16:01:04.814787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 16:01:04.814787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 16:01:04.814787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 16:01:04.814787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 16:01:04.816964 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2174489f71234ee6a072e17f0c59a640. Jul 14 16:01:04.816964 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 16:01:04.816964 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1202/2372] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:01:04 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 16:01:14.793165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:03.816971 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf3d61-116e-4da3-ad5b-425f46f81aa4 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:02:03.818662 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-99bf3d61-116e-4da3-ad5b-425f46f81aa4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:02:03.836882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf3d61-116e-4da3-ad5b-425f46f81aa4 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:02:03.846624 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47670d2-ce45-4965-a649-8c21657fd4eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:02:03.847369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47670d2-ce45-4965-a649-8c21657fd4eb service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:02:03.847805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47670d2-ce45-4965-a649-8c21657fd4eb service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:02:03.848227 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47670d2-ce45-4965-a649-8c21657fd4eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:02:03.860541 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47670d2-ce45-4965-a649-8c21657fd4eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:02:03.862566 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47670d2-ce45-4965-a649-8c21657fd4eb service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:02:03.876592 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1171/2373] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:02:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:02:13.870831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=6 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:55.235889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f4d38-dd14-4b51-831d-601eecce9efc service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:02:55.237513 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6e3f4d38-dd14-4b51-831d-601eecce9efc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:02:55.256683 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f4d38-dd14-4b51-831d-601eecce9efc service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:02:55.262760 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7335e-6c46-4ba9-894e-acf32c3de318 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:02:55.263404 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7335e-6c46-4ba9-894e-acf32c3de318 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:02:55.263696 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7335e-6c46-4ba9-894e-acf32c3de318 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:02:55.263976 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7335e-6c46-4ba9-894e-acf32c3de318 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:02:55.274312 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7335e-6c46-4ba9-894e-acf32c3de318 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:02:55.276167 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7335e-6c46-4ba9-894e-acf32c3de318 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:02:55.297592 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1203/2374] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:02:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:03:01.488583 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be9c2f-1b5e-40f7-b4ea-efc1624053af None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:01.489198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be9c2f-1b5e-40f7-b4ea-efc1624053af None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:01.489198 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be9c2f-1b5e-40f7-b4ea-efc1624053af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:01.524463 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-22be9c2f-1b5e-40f7-b4ea-efc1624053af None None] MFA Rules not processed for user `7791b825f4274af19051fd0fd884274f`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:03:01.525716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-22be9c2f-1b5e-40f7-b4ea-efc1624053af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:03:01.534180 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1172/2375] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:03:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:03:01.926140 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7335e-6c46-4ba9-894e-acf32c3de318 service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:01.937391 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7335e-6c46-4ba9-894e-acf32c3de318 service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:01.941311 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23880031-ffbd-4d34-b1a0-46ee4e193f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:01.941963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23880031-ffbd-4d34-b1a0-46ee4e193f08 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:01.942282 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23880031-ffbd-4d34-b1a0-46ee4e193f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:01.942561 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23880031-ffbd-4d34-b1a0-46ee4e193f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:01.944453 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-23880031-ffbd-4d34-b1a0-46ee4e193f08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:03:01.957930 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23880031-ffbd-4d34-b1a0-46ee4e193f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:01.959733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23880031-ffbd-4d34-b1a0-46ee4e193f08 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:01.970800 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1204/2376] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:03:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:03:02.377729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be9c2f-1b5e-40f7-b4ea-efc1624053af None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:02.395873 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be9c2f-1b5e-40f7-b4ea-efc1624053af None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:02.404282 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b958f-8890-4abd-bb05-6a8d8c69cfc4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:02.405264 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b958f-8890-4abd-bb05-6a8d8c69cfc4 service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:02.405860 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b958f-8890-4abd-bb05-6a8d8c69cfc4 service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:02.406349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b958f-8890-4abd-bb05-6a8d8c69cfc4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:02.409362 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2f9b958f-8890-4abd-bb05-6a8d8c69cfc4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:03:02.429697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b958f-8890-4abd-bb05-6a8d8c69cfc4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:02.433067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b958f-8890-4abd-bb05-6a8d8c69cfc4 service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:02.451055 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1173/2377] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:03:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:03:05.790420 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23880031-ffbd-4d34-b1a0-46ee4e193f08 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:05.848354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23880031-ffbd-4d34-b1a0-46ee4e193f08 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:05.862890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5a839-61fb-4b70-9a7c-3fda176a7297 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:05.865898 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5a839-61fb-4b70-9a7c-3fda176a7297 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:05.866715 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5a839-61fb-4b70-9a7c-3fda176a7297 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:05.868037 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5a839-61fb-4b70-9a7c-3fda176a7297 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:05.889959 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5a839-61fb-4b70-9a7c-3fda176a7297 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:05.891907 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5a839-61fb-4b70-9a7c-3fda176a7297 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:05.922381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1205/2378] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:03:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:03:06.303269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b958f-8890-4abd-bb05-6a8d8c69cfc4 service placement] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:06.319922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b958f-8890-4abd-bb05-6a8d8c69cfc4 service placement] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:06.324518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46d4f4-1c6f-489b-9c3a-ec528c0ab003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:06.325433 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46d4f4-1c6f-489b-9c3a-ec528c0ab003 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:06.325716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46d4f4-1c6f-489b-9c3a-ec528c0ab003 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:06.325999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46d4f4-1c6f-489b-9c3a-ec528c0ab003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:06.336337 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46d4f4-1c6f-489b-9c3a-ec528c0ab003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:06.338025 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46d4f4-1c6f-489b-9c3a-ec528c0ab003 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:06.394193 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1174/2379] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:03:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:03:06.550646 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5a839-61fb-4b70-9a7c-3fda176a7297 service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:06.564515 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5a839-61fb-4b70-9a7c-3fda176a7297 service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:06.568437 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458151f1-579d-4c9e-a98d-33319a8746c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:06.569103 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458151f1-579d-4c9e-a98d-33319a8746c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:06.569398 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458151f1-579d-4c9e-a98d-33319a8746c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:06.569794 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458151f1-579d-4c9e-a98d-33319a8746c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:06.580743 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458151f1-579d-4c9e-a98d-33319a8746c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:06.582362 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458151f1-579d-4c9e-a98d-33319a8746c3 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:06.617991 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1206/2380] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:03:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:03:13.295472 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46d4f4-1c6f-489b-9c3a-ec528c0ab003 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:13.311733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46d4f4-1c6f-489b-9c3a-ec528c0ab003 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:13.318230 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbea5a-1e4f-43ee-976d-a0529492cb17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:13.319446 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbea5a-1e4f-43ee-976d-a0529492cb17 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:13.319948 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbea5a-1e4f-43ee-976d-a0529492cb17 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:13.320224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbea5a-1e4f-43ee-976d-a0529492cb17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:13.322427 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f0bbea5a-1e4f-43ee-976d-a0529492cb17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:03:13.340476 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbea5a-1e4f-43ee-976d-a0529492cb17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:13.342748 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbea5a-1e4f-43ee-976d-a0529492cb17 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:13.355270 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1175/2381] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:03:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:03:16.614275 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=31 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:17.596004 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458151f1-579d-4c9e-a98d-33319a8746c3 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:17.611771 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458151f1-579d-4c9e-a98d-33319a8746c3 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:17.619204 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb84ef-b1af-4376-a3d8-348211981e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:17.620941 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb84ef-b1af-4376-a3d8-348211981e8c service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:17.620941 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb84ef-b1af-4376-a3d8-348211981e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:17.621285 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb84ef-b1af-4376-a3d8-348211981e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:17.624737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0dcb84ef-b1af-4376-a3d8-348211981e8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:03:17.751702 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb84ef-b1af-4376-a3d8-348211981e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:17.753469 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb84ef-b1af-4376-a3d8-348211981e8c service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:17.778861 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1207/2382] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:03:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:03:21.927999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbea5a-1e4f-43ee-976d-a0529492cb17 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:21.952503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbea5a-1e4f-43ee-976d-a0529492cb17 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:21.958211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d14a9d-5709-4132-b43f-3922cb10d69e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:21.959313 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d14a9d-5709-4132-b43f-3922cb10d69e service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:21.959921 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d14a9d-5709-4132-b43f-3922cb10d69e service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:21.960429 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d14a9d-5709-4132-b43f-3922cb10d69e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:21.963136 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-28d14a9d-5709-4132-b43f-3922cb10d69e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:03:21.983039 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d14a9d-5709-4132-b43f-3922cb10d69e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:21.985611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d14a9d-5709-4132-b43f-3922cb10d69e service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:21.998956 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1176/2383] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:03:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:03:22.022476 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb84ef-b1af-4376-a3d8-348211981e8c service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:22.025082 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0dcb84ef-b1af-4376-a3d8-348211981e8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:03:22.049008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb84ef-b1af-4376-a3d8-348211981e8c service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:22.065588 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b95176-9293-454f-b77c-2cccc01ab686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:22.066596 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b95176-9293-454f-b77c-2cccc01ab686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:22.067123 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b95176-9293-454f-b77c-2cccc01ab686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:22.067482 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b95176-9293-454f-b77c-2cccc01ab686 admin admin] PATH_INFO: `/v3/users/c7527df3bd954e939aa9dc63d7664e30` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:22.087622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b95176-9293-454f-b77c-2cccc01ab686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7527df3bd954e939aa9dc63d7664e30)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:22.091636 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b95176-9293-454f-b77c-2cccc01ab686 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:22.161147 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d7b95176-9293-454f-b77c-2cccc01ab686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7527df3bd954e939aa9dc63d7664e30'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:03:22.161147 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d7b95176-9293-454f-b77c-2cccc01ab686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7527df3bd954e939aa9dc63d7664e30'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:03:22.172044 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d7b95176-9293-454f-b77c-2cccc01ab686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7527df3bd954e939aa9dc63d7664e30'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:03:22.182945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d7b95176-9293-454f-b77c-2cccc01ab686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7527df3bd954e939aa9dc63d7664e30'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:03:22.203051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d7b95176-9293-454f-b77c-2cccc01ab686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7527df3bd954e939aa9dc63d7664e30'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:03:22.211308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1208/2384] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:03:22 2022] DELETE /identity/v3/users/c7527df3bd954e939aa9dc63d7664e30 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:03:22.459910 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d14a9d-5709-4132-b43f-3922cb10d69e service placement] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:22.474756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d14a9d-5709-4132-b43f-3922cb10d69e service placement] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:22.556853 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28aa474-2d95-4fc2-bf05-42a3e3cce857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:22.558401 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aa474-2d95-4fc2-bf05-42a3e3cce857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:22.558680 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aa474-2d95-4fc2-bf05-42a3e3cce857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:22.558953 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aa474-2d95-4fc2-bf05-42a3e3cce857 admin admin] PATH_INFO: `/v3/projects/a12415e38f6140a182f5d0c90da5f02d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:22.572444 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28aa474-2d95-4fc2-bf05-42a3e3cce857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a12415e38f6140a182f5d0c90da5f02d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:22.574550 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28aa474-2d95-4fc2-bf05-42a3e3cce857 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:22.634897 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b28aa474-2d95-4fc2-bf05-42a3e3cce857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a12415e38f6140a182f5d0c90da5f02d', 'request_id': 'req-b28aa474-2d95-4fc2-bf05-42a3e3cce857'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:03:22.643158 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b28aa474-2d95-4fc2-bf05-42a3e3cce857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a12415e38f6140a182f5d0c90da5f02d', 'request_id': 'req-b28aa474-2d95-4fc2-bf05-42a3e3cce857'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:03:22.650448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b28aa474-2d95-4fc2-bf05-42a3e3cce857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a12415e38f6140a182f5d0c90da5f02d', 'request_id': 'req-b28aa474-2d95-4fc2-bf05-42a3e3cce857'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:03:22.662486 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:22.668467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b28aa474-2d95-4fc2-bf05-42a3e3cce857 admin admin] The token cache is being invalidate because project a12415e38f6140a182f5d0c90da5f02d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:03:22.668838 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b28aa474-2d95-4fc2-bf05-42a3e3cce857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:03:22.669997 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-b28aa474-2d95-4fc2-bf05-42a3e3cce857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:03:22.672385 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1177/2385] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:03:22 2022] DELETE /identity/v3/projects/a12415e38f6140a182f5d0c90da5f02d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:03:22.687036 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf988154-924c-40a6-8b0c-5c4e91b10150 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:22.687560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf988154-924c-40a6-8b0c-5c4e91b10150 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:22.689060 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf988154-924c-40a6-8b0c-5c4e91b10150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:22.745918 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:22.782897 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-cf988154-924c-40a6-8b0c-5c4e91b10150 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:03:22.783785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cf988154-924c-40a6-8b0c-5c4e91b10150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:03:22.877500 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1209/2386] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:03:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:03:22.887677 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa3467-cd9b-41ba-ba57-098b8b7661d9 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:22.888200 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa3467-cd9b-41ba-ba57-098b8b7661d9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:22.888737 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa3467-cd9b-41ba-ba57-098b8b7661d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:22.916503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-12fa3467-cd9b-41ba-ba57-098b8b7661d9 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:03:22.918470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-12fa3467-cd9b-41ba-ba57-098b8b7661d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:03:22.928311 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1178/2387] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:03:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:03:22.933628 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf988154-924c-40a6-8b0c-5c4e91b10150 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:22.946004 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf988154-924c-40a6-8b0c-5c4e91b10150 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:22.952225 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225eb12-8a07-4fea-a731-43c5f67002b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:22.952914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225eb12-8a07-4fea-a731-43c5f67002b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:22.953199 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225eb12-8a07-4fea-a731-43c5f67002b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:22.953471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225eb12-8a07-4fea-a731-43c5f67002b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:22.954241 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225eb12-8a07-4fea-a731-43c5f67002b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:03:22.954623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225eb12-8a07-4fea-a731-43c5f67002b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:22.956183 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225eb12-8a07-4fea-a731-43c5f67002b9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:22.969913 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1210/2388] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:03:22.974928 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa3467-cd9b-41ba-ba57-098b8b7661d9 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:22.986015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa3467-cd9b-41ba-ba57-098b8b7661d9 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:22.995066 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ded1f-d299-4b8f-a19f-13c878cca016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:22.995879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ded1f-d299-4b8f-a19f-13c878cca016 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:22.996289 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ded1f-d299-4b8f-a19f-13c878cca016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:22.996671 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ded1f-d299-4b8f-a19f-13c878cca016 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:22.997488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ded1f-d299-4b8f-a19f-13c878cca016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:22.999767 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ded1f-d299-4b8f-a19f-13c878cca016 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:23.047848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1179/2389] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:03:22 2022] POST /identity/v3/projects => generated 409 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:03:23.053039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225eb12-8a07-4fea-a731-43c5f67002b9 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:23.064899 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225eb12-8a07-4fea-a731-43c5f67002b9 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:23.132944 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0420b6-9194-4a27-893a-83a14b6be66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:23.133632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0420b6-9194-4a27-893a-83a14b6be66f admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:23.133922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0420b6-9194-4a27-893a-83a14b6be66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:23.134395 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0420b6-9194-4a27-893a-83a14b6be66f admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:23.135097 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0420b6-9194-4a27-893a-83a14b6be66f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:23.137621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0420b6-9194-4a27-893a-83a14b6be66f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:23.162539 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1211/2390] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:03:23 2022] POST /identity/v3/users => generated 305 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:03:23.167167 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ded1f-d299-4b8f-a19f-13c878cca016 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:23.179938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ded1f-d299-4b8f-a19f-13c878cca016 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:23.185858 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac7239-3333-4168-9579-352fcd22f664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:23.186631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac7239-3333-4168-9579-352fcd22f664 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:23.186902 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac7239-3333-4168-9579-352fcd22f664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:23.187315 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac7239-3333-4168-9579-352fcd22f664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:23.188067 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac7239-3333-4168-9579-352fcd22f664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:23.189928 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac7239-3333-4168-9579-352fcd22f664 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:23.207753 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1180/2391] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 16:03:23.210102 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0420b6-9194-4a27-893a-83a14b6be66f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:23.226244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0420b6-9194-4a27-893a-83a14b6be66f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:23.234318 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2c9db-1648-44e3-ba1f-b2ddcb60f21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:23.235678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2c9db-1648-44e3-ba1f-b2ddcb60f21f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:23.235978 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2c9db-1648-44e3-ba1f-b2ddcb60f21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:23.236265 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2c9db-1648-44e3-ba1f-b2ddcb60f21f admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:23.237154 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2c9db-1648-44e3-ba1f-b2ddcb60f21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:23.239764 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2c9db-1648-44e3-ba1f-b2ddcb60f21f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:23.254672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1212/2392] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 16:03:23.259309 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac7239-3333-4168-9579-352fcd22f664 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:23.275242 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac7239-3333-4168-9579-352fcd22f664 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:23.284269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7829f-9a7e-408d-82f5-3d9ca6b98ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:23.285976 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7829f-9a7e-408d-82f5-3d9ca6b98ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:23.286500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7829f-9a7e-408d-82f5-3d9ca6b98ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:23.286995 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7829f-9a7e-408d-82f5-3d9ca6b98ad5 admin admin] PATH_INFO: `/v3/projects/fcd58af33ce64aac843c65af13a40cb9/users/993f39c88ee241e0b7790174d6369110/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:23.313017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7829f-9a7e-408d-82f5-3d9ca6b98ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcd58af33ce64aac843c65af13a40cb9, user_id=993f39c88ee241e0b7790174d6369110, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:23.317376 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7829f-9a7e-408d-82f5-3d9ca6b98ad5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:23.335278 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1181/2393] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:03:23 2022] PUT /identity/v3/projects/fcd58af33ce64aac843c65af13a40cb9/users/993f39c88ee241e0b7790174d6369110/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:03:23.357121 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c70e95-83a0-4c96-a509-8f2741a79bee None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:23.357581 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c70e95-83a0-4c96-a509-8f2741a79bee None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:23.357990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c70e95-83a0-4c96-a509-8f2741a79bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:23.392551 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d1c70e95-83a0-4c96-a509-8f2741a79bee None None] MFA Rules not processed for user `993f39c88ee241e0b7790174d6369110`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:03:23.394543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d1c70e95-83a0-4c96-a509-8f2741a79bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:03:23.453891 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:23.475246 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1213/2394] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:03:23 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:03:23.480476 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7829f-9a7e-408d-82f5-3d9ca6b98ad5 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:23.559374 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7829f-9a7e-408d-82f5-3d9ca6b98ad5 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:23.564163 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05224efd-f2ef-4c21-8f5c-31c497dd48bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:23.564823 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05224efd-f2ef-4c21-8f5c-31c497dd48bc admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:23.565160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05224efd-f2ef-4c21-8f5c-31c497dd48bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:23.565440 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05224efd-f2ef-4c21-8f5c-31c497dd48bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:23.566154 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05224efd-f2ef-4c21-8f5c-31c497dd48bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:23.568065 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05224efd-f2ef-4c21-8f5c-31c497dd48bc admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:23.600509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1182/2395] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:03:23 2022] POST /identity/v3/projects => generated 409 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:03:23.605337 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c70e95-83a0-4c96-a509-8f2741a79bee None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:23.616735 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c70e95-83a0-4c96-a509-8f2741a79bee None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:23.685019 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ca7ab-79be-43ef-9176-dbec76503562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:23.686315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ca7ab-79be-43ef-9176-dbec76503562 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:23.686914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ca7ab-79be-43ef-9176-dbec76503562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:23.687420 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ca7ab-79be-43ef-9176-dbec76503562 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:23.688832 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ca7ab-79be-43ef-9176-dbec76503562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:23.693091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ca7ab-79be-43ef-9176-dbec76503562 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:23.717830 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1214/2396] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:03:23 2022] POST /identity/v3/users => generated 311 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:03:23.721864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05224efd-f2ef-4c21-8f5c-31c497dd48bc admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:23.733710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05224efd-f2ef-4c21-8f5c-31c497dd48bc admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:23.738655 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fc4e3-77e3-451b-90ea-03358ab4de0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:23.739330 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fc4e3-77e3-451b-90ea-03358ab4de0a admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:23.739610 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fc4e3-77e3-451b-90ea-03358ab4de0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:23.739888 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fc4e3-77e3-451b-90ea-03358ab4de0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:23.740616 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fc4e3-77e3-451b-90ea-03358ab4de0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:23.742442 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fc4e3-77e3-451b-90ea-03358ab4de0a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:23.754256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1183/2397] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:03:23.762307 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ca7ab-79be-43ef-9176-dbec76503562 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:23.772938 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ca7ab-79be-43ef-9176-dbec76503562 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:23.778770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd962bc-4b91-4312-bd35-06b1e6aced10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:23.779414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd962bc-4b91-4312-bd35-06b1e6aced10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:23.779758 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd962bc-4b91-4312-bd35-06b1e6aced10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:23.779934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd962bc-4b91-4312-bd35-06b1e6aced10 admin admin] PATH_INFO: `/v3/projects/0dcf1f3bd5fb4e6486cd5eb39de172b4/users/a360664bb81b47d18992924681573f55/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:23.797530 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd962bc-4b91-4312-bd35-06b1e6aced10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dcf1f3bd5fb4e6486cd5eb39de172b4, user_id=a360664bb81b47d18992924681573f55, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:23.800612 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd962bc-4b91-4312-bd35-06b1e6aced10 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:23.816269 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1215/2398] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:03:23 2022] PUT /identity/v3/projects/0dcf1f3bd5fb4e6486cd5eb39de172b4/users/a360664bb81b47d18992924681573f55/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:03:23.820631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fc4e3-77e3-451b-90ea-03358ab4de0a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:23.830889 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fc4e3-77e3-451b-90ea-03358ab4de0a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:23.892011 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02bc67-707f-46c1-b206-dd8512f191b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:23.892688 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02bc67-707f-46c1-b206-dd8512f191b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:23.892971 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02bc67-707f-46c1-b206-dd8512f191b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:23.893249 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02bc67-707f-46c1-b206-dd8512f191b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:23.893973 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02bc67-707f-46c1-b206-dd8512f191b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:23.895616 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02bc67-707f-46c1-b206-dd8512f191b0 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:23.898027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:23.909136 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1184/2399] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:03:23.913582 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd962bc-4b91-4312-bd35-06b1e6aced10 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:03:23.924379 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd962bc-4b91-4312-bd35-06b1e6aced10 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:03:23.930119 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b486af-160c-4c1d-b7f2-7646de083865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:03:23.931031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b486af-160c-4c1d-b7f2-7646de083865 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:23.931310 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b486af-160c-4c1d-b7f2-7646de083865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:23.931591 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b486af-160c-4c1d-b7f2-7646de083865 admin admin] PATH_INFO: `/v3/projects/0dcf1f3bd5fb4e6486cd5eb39de172b4/users/a360664bb81b47d18992924681573f55/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:23.933912 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b486af-160c-4c1d-b7f2-7646de083865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dcf1f3bd5fb4e6486cd5eb39de172b4, user_id=a360664bb81b47d18992924681573f55, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:03:23.936589 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b486af-160c-4c1d-b7f2-7646de083865 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:03:23.947495 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1216/2400] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:03:23 2022] PUT /identity/v3/projects/0dcf1f3bd5fb4e6486cd5eb39de172b4/users/a360664bb81b47d18992924681573f55/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:03:23.958942 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005757a6-0500-44ff-a7a2-a0886c32b4ef None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:03:23.959555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005757a6-0500-44ff-a7a2-a0886c32b4ef None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:03:23.959679 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005757a6-0500-44ff-a7a2-a0886c32b4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:03:23.994531 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-005757a6-0500-44ff-a7a2-a0886c32b4ef None None] MFA Rules not processed for user `a360664bb81b47d18992924681573f55`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:03:23.996211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-005757a6-0500-44ff-a7a2-a0886c32b4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:03:24.068298 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1185/2401] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:03:23 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:03:33.943564 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=48,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:34.065334 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=35 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:06.982228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b486af-160c-4c1d-b7f2-7646de083865 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:05:06.984225 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-97b486af-160c-4c1d-b7f2-7646de083865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:07.048957 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b486af-160c-4c1d-b7f2-7646de083865 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:05:07.052679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b75127-db00-4b84-a74c-729483ea7038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:05:07.053423 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b75127-db00-4b84-a74c-729483ea7038 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:07.053730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b75127-db00-4b84-a74c-729483ea7038 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:07.053989 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b75127-db00-4b84-a74c-729483ea7038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:07.064267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b75127-db00-4b84-a74c-729483ea7038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:05:07.065732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b75127-db00-4b84-a74c-729483ea7038 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:05:07.075976 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1217/2402] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:05:06 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:05:11.456037 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005757a6-0500-44ff-a7a2-a0886c32b4ef None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:05:11.457473 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-005757a6-0500-44ff-a7a2-a0886c32b4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:11.517091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005757a6-0500-44ff-a7a2-a0886c32b4ef None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:05:11.520715 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7823a-20b2-494d-875a-97b5194966b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:05:11.521366 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7823a-20b2-494d-875a-97b5194966b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:05:11.521749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7823a-20b2-494d-875a-97b5194966b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:05:11.522031 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7823a-20b2-494d-875a-97b5194966b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:05:11.523928 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a8c7823a-20b2-494d-875a-97b5194966b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:05:11.534271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7823a-20b2-494d-875a-97b5194966b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:05:11.535743 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7823a-20b2-494d-875a-97b5194966b7 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:05:11.545185 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1186/2403] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:05:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:05:17.071360 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=26 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:21.540632 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=26 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:06.758026 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b75127-db00-4b84-a74c-729483ea7038 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:06.759468 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-51b75127-db00-4b84-a74c-729483ea7038 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:06.871780 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b75127-db00-4b84-a74c-729483ea7038 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:06.876941 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8131f-c811-49cd-9c73-7e75ddc2b008 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:06.877584 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8131f-c811-49cd-9c73-7e75ddc2b008 service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:06.877871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8131f-c811-49cd-9c73-7e75ddc2b008 service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:06.878194 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8131f-c811-49cd-9c73-7e75ddc2b008 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:06.879975 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6ea8131f-c811-49cd-9c73-7e75ddc2b008 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:06.892878 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8131f-c811-49cd-9c73-7e75ddc2b008 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:06.894523 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8131f-c811-49cd-9c73-7e75ddc2b008 service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:06.905283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1218/2404] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:07:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:07:07.572547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7823a-20b2-494d-875a-97b5194966b7 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:07.582871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7823a-20b2-494d-875a-97b5194966b7 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:07.586606 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873b313-d43d-477b-abe0-665eb31ea74a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:07.587262 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873b313-d43d-477b-abe0-665eb31ea74a service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:07.587525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873b313-d43d-477b-abe0-665eb31ea74a service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:07.587804 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873b313-d43d-477b-abe0-665eb31ea74a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:07.649160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873b313-d43d-477b-abe0-665eb31ea74a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:07.650651 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873b313-d43d-477b-abe0-665eb31ea74a service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:07.660502 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1187/2405] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:07:07 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:07:07.990202 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8131f-c811-49cd-9c73-7e75ddc2b008 service placement] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:08.001755 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8131f-c811-49cd-9c73-7e75ddc2b008 service placement] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:08.005467 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdda3c6-1839-4107-a419-c8b93642d7bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:08.006134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdda3c6-1839-4107-a419-c8b93642d7bf service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:08.006425 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdda3c6-1839-4107-a419-c8b93642d7bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:08.006703 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdda3c6-1839-4107-a419-c8b93642d7bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:08.008541 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6fdda3c6-1839-4107-a419-c8b93642d7bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:08.096194 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdda3c6-1839-4107-a419-c8b93642d7bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:08.097657 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdda3c6-1839-4107-a419-c8b93642d7bf service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:08.120002 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1219/2406] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:07:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:07:08.325990 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873b313-d43d-477b-abe0-665eb31ea74a service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:08.393350 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873b313-d43d-477b-abe0-665eb31ea74a service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:08.397929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059c126-4e9f-42c8-9253-cbe0db23090f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:08.398834 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059c126-4e9f-42c8-9253-cbe0db23090f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:08.399115 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059c126-4e9f-42c8-9253-cbe0db23090f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:08.399428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059c126-4e9f-42c8-9253-cbe0db23090f admin admin] PATH_INFO: `/v3/users/993f39c88ee241e0b7790174d6369110` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:08.400567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059c126-4e9f-42c8-9253-cbe0db23090f admin admin] RBAC: Authorizing `identity:delete_user(user_id=993f39c88ee241e0b7790174d6369110)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:08.403060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059c126-4e9f-42c8-9253-cbe0db23090f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:08.469592 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0059c126-4e9f-42c8-9253-cbe0db23090f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '993f39c88ee241e0b7790174d6369110'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:08.481932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0059c126-4e9f-42c8-9253-cbe0db23090f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '993f39c88ee241e0b7790174d6369110'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:08.495388 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0059c126-4e9f-42c8-9253-cbe0db23090f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '993f39c88ee241e0b7790174d6369110'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:08.503074 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0059c126-4e9f-42c8-9253-cbe0db23090f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '993f39c88ee241e0b7790174d6369110'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:08.503686 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0059c126-4e9f-42c8-9253-cbe0db23090f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '993f39c88ee241e0b7790174d6369110'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:08.510119 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1188/2407] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:07:08 2022] DELETE /identity/v3/users/993f39c88ee241e0b7790174d6369110 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:07:08.515354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9349b-367b-49e7-bb73-07a98b6dc225 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:08.516082 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9349b-367b-49e7-bb73-07a98b6dc225 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:08.516376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9349b-367b-49e7-bb73-07a98b6dc225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:08.534453 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7fe9349b-367b-49e7-bb73-07a98b6dc225 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:07:08.535666 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7fe9349b-367b-49e7-bb73-07a98b6dc225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:08.554597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:08.595902 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1220/2408] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:07:08.605631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059c126-4e9f-42c8-9253-cbe0db23090f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:08.607233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0059c126-4e9f-42c8-9253-cbe0db23090f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:08.629463 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:08.675848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059c126-4e9f-42c8-9253-cbe0db23090f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:08.679577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5759e43-f946-41af-ba1f-7f321c09aa1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:08.680226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5759e43-f946-41af-ba1f-7f321c09aa1e service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:08.680514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5759e43-f946-41af-ba1f-7f321c09aa1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:08.680793 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5759e43-f946-41af-ba1f-7f321c09aa1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:08.690310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5759e43-f946-41af-ba1f-7f321c09aa1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:08.691702 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5759e43-f946-41af-ba1f-7f321c09aa1e service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:08.701403 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1189/2409] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:07:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:07:08.986470 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9349b-367b-49e7-bb73-07a98b6dc225 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:08.987990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7fe9349b-367b-49e7-bb73-07a98b6dc225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:09.000387 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9349b-367b-49e7-bb73-07a98b6dc225 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:09.006488 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5efa2-98e7-4bc8-a18a-c218d1ea933e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:09.007720 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5efa2-98e7-4bc8-a18a-c218d1ea933e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:09.008013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5efa2-98e7-4bc8-a18a-c218d1ea933e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:09.008397 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5efa2-98e7-4bc8-a18a-c218d1ea933e admin admin] PATH_INFO: `/v3/projects/fcd58af33ce64aac843c65af13a40cb9` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:09.009509 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5efa2-98e7-4bc8-a18a-c218d1ea933e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcd58af33ce64aac843c65af13a40cb9)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:09.013433 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5efa2-98e7-4bc8-a18a-c218d1ea933e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:09.068367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-36b5efa2-98e7-4bc8-a18a-c218d1ea933e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcd58af33ce64aac843c65af13a40cb9', 'request_id': 'req-36b5efa2-98e7-4bc8-a18a-c218d1ea933e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:09.074231 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-36b5efa2-98e7-4bc8-a18a-c218d1ea933e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcd58af33ce64aac843c65af13a40cb9', 'request_id': 'req-36b5efa2-98e7-4bc8-a18a-c218d1ea933e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:09.083329 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-36b5efa2-98e7-4bc8-a18a-c218d1ea933e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcd58af33ce64aac843c65af13a40cb9', 'request_id': 'req-36b5efa2-98e7-4bc8-a18a-c218d1ea933e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:09.095760 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-36b5efa2-98e7-4bc8-a18a-c218d1ea933e admin admin] The token cache is being invalidate because project fcd58af33ce64aac843c65af13a40cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:07:09.096047 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-36b5efa2-98e7-4bc8-a18a-c218d1ea933e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:09.096705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-36b5efa2-98e7-4bc8-a18a-c218d1ea933e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:09.098293 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1221/2410] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:07:08 2022] DELETE /identity/v3/projects/fcd58af33ce64aac843c65af13a40cb9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:07:09.102444 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5759e43-f946-41af-ba1f-7f321c09aa1e service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:09.115292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5759e43-f946-41af-ba1f-7f321c09aa1e service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:09.178150 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d9355-791a-431d-ba6c-3a65c6b4bca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:09.179045 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d9355-791a-431d-ba6c-3a65c6b4bca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:09.179321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d9355-791a-431d-ba6c-3a65c6b4bca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:09.179595 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d9355-791a-431d-ba6c-3a65c6b4bca2 admin admin] PATH_INFO: `/v3/users/a360664bb81b47d18992924681573f55` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:09.180764 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d9355-791a-431d-ba6c-3a65c6b4bca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a360664bb81b47d18992924681573f55)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:09.182747 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d9355-791a-431d-ba6c-3a65c6b4bca2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:09.229821 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2c2d9355-791a-431d-ba6c-3a65c6b4bca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a360664bb81b47d18992924681573f55'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:09.240748 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2c2d9355-791a-431d-ba6c-3a65c6b4bca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a360664bb81b47d18992924681573f55'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:09.253540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2c2d9355-791a-431d-ba6c-3a65c6b4bca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a360664bb81b47d18992924681573f55'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:09.261344 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2c2d9355-791a-431d-ba6c-3a65c6b4bca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a360664bb81b47d18992924681573f55'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:09.262205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2c2d9355-791a-431d-ba6c-3a65c6b4bca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a360664bb81b47d18992924681573f55'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:09.269266 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1190/2411] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:07:09 2022] DELETE /identity/v3/users/a360664bb81b47d18992924681573f55 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:07:09.566129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5efa2-98e7-4bc8-a18a-c218d1ea933e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:09.567628 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-36b5efa2-98e7-4bc8-a18a-c218d1ea933e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:09.580684 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5efa2-98e7-4bc8-a18a-c218d1ea933e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:09.642397 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4da679-c978-4944-a3e4-2852da9f4269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:09.643262 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4da679-c978-4944-a3e4-2852da9f4269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:09.643552 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4da679-c978-4944-a3e4-2852da9f4269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:09.643901 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4da679-c978-4944-a3e4-2852da9f4269 admin admin] PATH_INFO: `/v3/projects/0dcf1f3bd5fb4e6486cd5eb39de172b4` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:09.645059 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4da679-c978-4944-a3e4-2852da9f4269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dcf1f3bd5fb4e6486cd5eb39de172b4)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:09.649167 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4da679-c978-4944-a3e4-2852da9f4269 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:09.698232 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5d4da679-c978-4944-a3e4-2852da9f4269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dcf1f3bd5fb4e6486cd5eb39de172b4', 'request_id': 'req-5d4da679-c978-4944-a3e4-2852da9f4269'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:09.699426 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:09.705410 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5d4da679-c978-4944-a3e4-2852da9f4269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dcf1f3bd5fb4e6486cd5eb39de172b4', 'request_id': 'req-5d4da679-c978-4944-a3e4-2852da9f4269'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:09.720491 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5d4da679-c978-4944-a3e4-2852da9f4269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dcf1f3bd5fb4e6486cd5eb39de172b4', 'request_id': 'req-5d4da679-c978-4944-a3e4-2852da9f4269'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:09.733062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5d4da679-c978-4944-a3e4-2852da9f4269 admin admin] The token cache is being invalidate because project 0dcf1f3bd5fb4e6486cd5eb39de172b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:07:09.734093 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5d4da679-c978-4944-a3e4-2852da9f4269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:09.735107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5d4da679-c978-4944-a3e4-2852da9f4269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:07:09.736994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1222/2412] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:07:09 2022] DELETE /identity/v3/projects/0dcf1f3bd5fb4e6486cd5eb39de172b4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:07:09.760078 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa8443-fed8-4e21-a1e1-aefbd3ea060a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:09.760600 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa8443-fed8-4e21-a1e1-aefbd3ea060a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:09.760600 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa8443-fed8-4e21-a1e1-aefbd3ea060a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:09.779021 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a7fa8443-fed8-4e21-a1e1-aefbd3ea060a None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:07:09.780325 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a7fa8443-fed8-4e21-a1e1-aefbd3ea060a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:09.817058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:09.843819 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1191/2413] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:07:09.851826 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8976f4-404e-4459-9544-ec9e51635a56 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:09.852192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8976f4-404e-4459-9544-ec9e51635a56 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:09.852538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8976f4-404e-4459-9544-ec9e51635a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:09.871628 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2f8976f4-404e-4459-9544-ec9e51635a56 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:07:09.872881 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2f8976f4-404e-4459-9544-ec9e51635a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:09.889969 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1223/2414] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:07:09.895613 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa8443-fed8-4e21-a1e1-aefbd3ea060a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:09.919891 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa8443-fed8-4e21-a1e1-aefbd3ea060a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:09.925346 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc10a58-66b0-4821-ba76-c3f51df5ba5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:09.926002 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc10a58-66b0-4821-ba76-c3f51df5ba5c admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:09.926319 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc10a58-66b0-4821-ba76-c3f51df5ba5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:09.926598 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc10a58-66b0-4821-ba76-c3f51df5ba5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:09.927322 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc10a58-66b0-4821-ba76-c3f51df5ba5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:07:09.927629 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc10a58-66b0-4821-ba76-c3f51df5ba5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:09.929234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc10a58-66b0-4821-ba76-c3f51df5ba5c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:09.941769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1192/2415] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:07:09.946343 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8976f4-404e-4459-9544-ec9e51635a56 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:09.966319 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8976f4-404e-4459-9544-ec9e51635a56 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:09.971938 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23455600-ea2d-4b65-b5d0-720fafc10c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:09.972607 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23455600-ea2d-4b65-b5d0-720fafc10c5f admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:09.972896 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23455600-ea2d-4b65-b5d0-720fafc10c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:09.973179 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23455600-ea2d-4b65-b5d0-720fafc10c5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:09.973887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23455600-ea2d-4b65-b5d0-720fafc10c5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:09.975867 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23455600-ea2d-4b65-b5d0-720fafc10c5f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:10.008632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1224/2416] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:07:09 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:07:10.012972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc10a58-66b0-4821-ba76-c3f51df5ba5c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:10.026552 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc10a58-66b0-4821-ba76-c3f51df5ba5c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:10.086172 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbec1f-921f-4deb-8fc4-c0f2fb42d9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:10.086864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbec1f-921f-4deb-8fc4-c0f2fb42d9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:10.087207 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbec1f-921f-4deb-8fc4-c0f2fb42d9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:10.087434 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbec1f-921f-4deb-8fc4-c0f2fb42d9e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:10.088144 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dbec1f-921f-4deb-8fc4-c0f2fb42d9e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:10.090125 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dbec1f-921f-4deb-8fc4-c0f2fb42d9e6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:10.118459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1193/2417] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:07:10 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:07:10.119796 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23455600-ea2d-4b65-b5d0-720fafc10c5f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:10.130752 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23455600-ea2d-4b65-b5d0-720fafc10c5f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:10.135457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727ec5f-bc5d-4446-98a5-7f54232a713c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:10.136378 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727ec5f-bc5d-4446-98a5-7f54232a713c admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:10.136670 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727ec5f-bc5d-4446-98a5-7f54232a713c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:10.136948 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727ec5f-bc5d-4446-98a5-7f54232a713c admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:10.137719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727ec5f-bc5d-4446-98a5-7f54232a713c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:10.139554 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727ec5f-bc5d-4446-98a5-7f54232a713c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:10.149858 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1225/2418] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:07:10.153854 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbec1f-921f-4deb-8fc4-c0f2fb42d9e6 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:10.164359 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbec1f-921f-4deb-8fc4-c0f2fb42d9e6 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:10.169376 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb615d1-b90d-43e9-b8a1-dff4f9245a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:10.170606 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb615d1-b90d-43e9-b8a1-dff4f9245a7d admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:10.171797 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb615d1-b90d-43e9-b8a1-dff4f9245a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:10.172082 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb615d1-b90d-43e9-b8a1-dff4f9245a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:10.172814 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb615d1-b90d-43e9-b8a1-dff4f9245a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:10.174497 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb615d1-b90d-43e9-b8a1-dff4f9245a7d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:10.184901 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1194/2419] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:07:10.189776 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727ec5f-bc5d-4446-98a5-7f54232a713c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:10.199985 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727ec5f-bc5d-4446-98a5-7f54232a713c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:10.205186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39350c-552a-41b6-b5b4-b127012d05a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:10.206062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39350c-552a-41b6-b5b4-b127012d05a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:10.206377 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39350c-552a-41b6-b5b4-b127012d05a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:10.206688 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39350c-552a-41b6-b5b4-b127012d05a7 admin admin] PATH_INFO: `/v3/projects/8fd48273cd6c496782c60bcbd3e0d28e/users/b12b78f4c83f4ef0b07b67a1dd87badc/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:10.221779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39350c-552a-41b6-b5b4-b127012d05a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd48273cd6c496782c60bcbd3e0d28e, user_id=b12b78f4c83f4ef0b07b67a1dd87badc, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:10.224613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39350c-552a-41b6-b5b4-b127012d05a7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:10.237903 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1226/2420] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:07:10 2022] PUT /identity/v3/projects/8fd48273cd6c496782c60bcbd3e0d28e/users/b12b78f4c83f4ef0b07b67a1dd87badc/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:07:10.297553 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ff7b5-03b2-425b-9c4a-bdc81aa84530 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:10.297759 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ff7b5-03b2-425b-9c4a-bdc81aa84530 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:10.298042 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ff7b5-03b2-425b-9c4a-bdc81aa84530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:10.324636 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a77ff7b5-03b2-425b-9c4a-bdc81aa84530 None None] MFA Rules not processed for user `b12b78f4c83f4ef0b07b67a1dd87badc`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:07:10.325880 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a77ff7b5-03b2-425b-9c4a-bdc81aa84530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:10.392505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1195/2421] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:07:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:07:10.397182 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39350c-552a-41b6-b5b4-b127012d05a7 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:10.471344 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39350c-552a-41b6-b5b4-b127012d05a7 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:10.476035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226e49b-a1f4-4590-8d19-90c6eaae8f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:10.476690 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226e49b-a1f4-4590-8d19-90c6eaae8f0a admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:10.476972 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226e49b-a1f4-4590-8d19-90c6eaae8f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:10.477250 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226e49b-a1f4-4590-8d19-90c6eaae8f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:10.477942 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226e49b-a1f4-4590-8d19-90c6eaae8f0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:10.479877 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226e49b-a1f4-4590-8d19-90c6eaae8f0a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:10.507209 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1227/2422] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:07:10 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:07:10.511515 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ff7b5-03b2-425b-9c4a-bdc81aa84530 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:10.523210 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ff7b5-03b2-425b-9c4a-bdc81aa84530 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:10.536298 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:10.584558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e887e98-5e81-475b-a057-bf94b6b056f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:10.585149 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e887e98-5e81-475b-a057-bf94b6b056f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:10.585438 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e887e98-5e81-475b-a057-bf94b6b056f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:10.585719 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e887e98-5e81-475b-a057-bf94b6b056f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:10.586453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e887e98-5e81-475b-a057-bf94b6b056f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:10.588507 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e887e98-5e81-475b-a057-bf94b6b056f5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:10.614862 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1196/2423] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:07:10 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:07:10.619478 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226e49b-a1f4-4590-8d19-90c6eaae8f0a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:10.631184 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226e49b-a1f4-4590-8d19-90c6eaae8f0a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:10.636576 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ed8f1-18da-49b0-98ff-9791bc6d021b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:10.637241 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ed8f1-18da-49b0-98ff-9791bc6d021b admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:10.637522 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ed8f1-18da-49b0-98ff-9791bc6d021b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:10.637795 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ed8f1-18da-49b0-98ff-9791bc6d021b admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:10.638565 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ed8f1-18da-49b0-98ff-9791bc6d021b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:10.640686 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ed8f1-18da-49b0-98ff-9791bc6d021b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:10.651871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1228/2424] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:07:10.656962 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e887e98-5e81-475b-a057-bf94b6b056f5 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:10.667147 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e887e98-5e81-475b-a057-bf94b6b056f5 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:10.672196 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0b253-ebb0-4db4-8e03-fc9f11dbeffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:10.672931 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0b253-ebb0-4db4-8e03-fc9f11dbeffd admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:10.673232 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0b253-ebb0-4db4-8e03-fc9f11dbeffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:10.673516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0b253-ebb0-4db4-8e03-fc9f11dbeffd admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:10.674279 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0b253-ebb0-4db4-8e03-fc9f11dbeffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:10.675910 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0b253-ebb0-4db4-8e03-fc9f11dbeffd admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:10.690217 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1197/2425] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:07:10.694712 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ed8f1-18da-49b0-98ff-9791bc6d021b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:10.710164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ed8f1-18da-49b0-98ff-9791bc6d021b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:10.715239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28930349-8c36-4133-9d6b-616f4da2dfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:10.716144 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28930349-8c36-4133-9d6b-616f4da2dfd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:10.716424 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28930349-8c36-4133-9d6b-616f4da2dfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:10.716700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28930349-8c36-4133-9d6b-616f4da2dfd0 admin admin] PATH_INFO: `/v3/projects/73c9aba2bf5e4234adc08a2c9a09350b/users/622ecaeb5d1a4dccb7b35eb20d7f5e5d/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:10.735675 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28930349-8c36-4133-9d6b-616f4da2dfd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73c9aba2bf5e4234adc08a2c9a09350b, user_id=622ecaeb5d1a4dccb7b35eb20d7f5e5d, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:10.738777 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28930349-8c36-4133-9d6b-616f4da2dfd0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:10.765189 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1229/2426] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:07:10 2022] PUT /identity/v3/projects/73c9aba2bf5e4234adc08a2c9a09350b/users/622ecaeb5d1a4dccb7b35eb20d7f5e5d/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:07:10.777937 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4160ee-385d-42b4-ac03-ee33bb28c475 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:10.778587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4160ee-385d-42b4-ac03-ee33bb28c475 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:10.778587 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4160ee-385d-42b4-ac03-ee33bb28c475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:10.814813 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-ec4160ee-385d-42b4-ac03-ee33bb28c475 None None] MFA Rules not processed for user `622ecaeb5d1a4dccb7b35eb20d7f5e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:07:10.817239 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ec4160ee-385d-42b4-ac03-ee33bb28c475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:10.900383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1198/2427] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:07:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:07:10.905163 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28930349-8c36-4133-9d6b-616f4da2dfd0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:10.921782 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:10.986333 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28930349-8c36-4133-9d6b-616f4da2dfd0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:10.991174 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffb33c-ccba-4e28-b12e-09eecd1cf171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:10.991839 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffb33c-ccba-4e28-b12e-09eecd1cf171 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:10.992127 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffb33c-ccba-4e28-b12e-09eecd1cf171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:10.992407 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffb33c-ccba-4e28-b12e-09eecd1cf171 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:10.993114 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffb33c-ccba-4e28-b12e-09eecd1cf171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:10.995094 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffb33c-ccba-4e28-b12e-09eecd1cf171 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:11.027654 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1230/2428] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:07:10 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:07:11.028967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4160ee-385d-42b4-ac03-ee33bb28c475 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:11.039934 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4160ee-385d-42b4-ac03-ee33bb28c475 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:11.098843 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21511e4a-f5e3-4075-bdce-12d4dbd6e46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:11.099517 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21511e4a-f5e3-4075-bdce-12d4dbd6e46d admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:11.099797 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21511e4a-f5e3-4075-bdce-12d4dbd6e46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:11.100071 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21511e4a-f5e3-4075-bdce-12d4dbd6e46d admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:11.100761 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21511e4a-f5e3-4075-bdce-12d4dbd6e46d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:11.102722 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21511e4a-f5e3-4075-bdce-12d4dbd6e46d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:11.125991 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1199/2429] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:07:11 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:07:11.132112 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffb33c-ccba-4e28-b12e-09eecd1cf171 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:11.143446 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffb33c-ccba-4e28-b12e-09eecd1cf171 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:11.149570 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda350d-a4fa-419d-9630-43343f36494b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:11.150593 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda350d-a4fa-419d-9630-43343f36494b admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:11.150857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda350d-a4fa-419d-9630-43343f36494b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:11.151162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda350d-a4fa-419d-9630-43343f36494b admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:11.151897 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda350d-a4fa-419d-9630-43343f36494b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:11.153646 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda350d-a4fa-419d-9630-43343f36494b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:11.166669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1231/2430] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:07:11.170957 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21511e4a-f5e3-4075-bdce-12d4dbd6e46d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:11.182645 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21511e4a-f5e3-4075-bdce-12d4dbd6e46d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:11.187432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a9df9-9054-44f9-9882-c6132e6179b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:11.189305 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a9df9-9054-44f9-9882-c6132e6179b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:11.189596 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a9df9-9054-44f9-9882-c6132e6179b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:11.189876 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a9df9-9054-44f9-9882-c6132e6179b8 admin admin] PATH_INFO: `/v3/projects/8d24f93c62594ca6848bf163cc486d5a/users/df1a8cfbc07e4976bbb04e89103a05ad/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:11.202850 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:11.206983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a9df9-9054-44f9-9882-c6132e6179b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d24f93c62594ca6848bf163cc486d5a, user_id=df1a8cfbc07e4976bbb04e89103a05ad, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:11.209722 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a9df9-9054-44f9-9882-c6132e6179b8 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:11.224685 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1200/2431] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:07:11 2022] PUT /identity/v3/projects/8d24f93c62594ca6848bf163cc486d5a/users/df1a8cfbc07e4976bbb04e89103a05ad/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:07:11.228828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda350d-a4fa-419d-9630-43343f36494b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:11.240055 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda350d-a4fa-419d-9630-43343f36494b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:11.300283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09138b76-5fa2-4019-871b-1cba93c62fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:11.300956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09138b76-5fa2-4019-871b-1cba93c62fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:11.301240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09138b76-5fa2-4019-871b-1cba93c62fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:11.301517 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09138b76-5fa2-4019-871b-1cba93c62fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:11.302297 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09138b76-5fa2-4019-871b-1cba93c62fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:11.303981 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09138b76-5fa2-4019-871b-1cba93c62fb8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:11.315118 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1232/2432] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:07:11.320574 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a9df9-9054-44f9-9882-c6132e6179b8 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:07:11.331092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a9df9-9054-44f9-9882-c6132e6179b8 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:07:11.336199 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05161718-9831-4ec8-a4d6-44d1f36b13b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:07:11.337089 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05161718-9831-4ec8-a4d6-44d1f36b13b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:11.337399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05161718-9831-4ec8-a4d6-44d1f36b13b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:11.337673 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05161718-9831-4ec8-a4d6-44d1f36b13b7 admin admin] PATH_INFO: `/v3/projects/8d24f93c62594ca6848bf163cc486d5a/users/df1a8cfbc07e4976bbb04e89103a05ad/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:11.339678 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05161718-9831-4ec8-a4d6-44d1f36b13b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d24f93c62594ca6848bf163cc486d5a, user_id=df1a8cfbc07e4976bbb04e89103a05ad, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:07:11.342378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05161718-9831-4ec8-a4d6-44d1f36b13b7 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:07:11.353518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1201/2433] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:07:11 2022] PUT /identity/v3/projects/8d24f93c62594ca6848bf163cc486d5a/users/df1a8cfbc07e4976bbb04e89103a05ad/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:07:11.364822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ddc1d-c34d-4b4b-8e90-f4c26c60dcdb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:07:11.365112 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ddc1d-c34d-4b4b-8e90-f4c26c60dcdb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:07:11.365397 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ddc1d-c34d-4b4b-8e90-f4c26c60dcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:07:11.393650 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6a9ddc1d-c34d-4b4b-8e90-f4c26c60dcdb None None] MFA Rules not processed for user `df1a8cfbc07e4976bbb04e89103a05ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:07:11.394922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6a9ddc1d-c34d-4b4b-8e90-f4c26c60dcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:07:11.467684 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1233/2434] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:07:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:07:21.349598 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=8,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:21.464758 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=98,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:08.456605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05161718-9831-4ec8-a4d6-44d1f36b13b7 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:08.458389 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-05161718-9831-4ec8-a4d6-44d1f36b13b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:08.548081 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05161718-9831-4ec8-a4d6-44d1f36b13b7 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:08.551978 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcd25c-105c-486c-9b05-6b8c9379318f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:08.552628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcd25c-105c-486c-9b05-6b8c9379318f service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:08.552916 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcd25c-105c-486c-9b05-6b8c9379318f service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:08.553195 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcd25c-105c-486c-9b05-6b8c9379318f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:08.555149 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-46fcd25c-105c-486c-9b05-6b8c9379318f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:08.642057 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fcd25c-105c-486c-9b05-6b8c9379318f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:08.643584 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fcd25c-105c-486c-9b05-6b8c9379318f service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:08.665682 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1202/2435] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:09:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:09:08.711781 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ddc1d-c34d-4b4b-8e90-f4c26c60dcdb None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:08.723412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ddc1d-c34d-4b4b-8e90-f4c26c60dcdb None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:08.728000 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe597b-8db0-42ba-a0ef-c713d89a57f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:08.728844 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe597b-8db0-42ba-a0ef-c713d89a57f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:08.729134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe597b-8db0-42ba-a0ef-c713d89a57f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:08.729446 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe597b-8db0-42ba-a0ef-c713d89a57f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:08.731738 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5fbe597b-8db0-42ba-a0ef-c713d89a57f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:08.808042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe597b-8db0-42ba-a0ef-c713d89a57f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:08.809493 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe597b-8db0-42ba-a0ef-c713d89a57f1 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:08.818894 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1234/2436] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:09:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:09:08.884536 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcd25c-105c-486c-9b05-6b8c9379318f service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:08.894470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcd25c-105c-486c-9b05-6b8c9379318f service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:08.898655 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab855dc-f5ba-49f4-abe7-4fe71e00463b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:08.899300 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab855dc-f5ba-49f4-abe7-4fe71e00463b service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:08.899586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab855dc-f5ba-49f4-abe7-4fe71e00463b service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:08.899866 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab855dc-f5ba-49f4-abe7-4fe71e00463b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:08.901692 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1ab855dc-f5ba-49f4-abe7-4fe71e00463b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:08.963668 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:08.976656 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab855dc-f5ba-49f4-abe7-4fe71e00463b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:08.978136 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab855dc-f5ba-49f4-abe7-4fe71e00463b service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:08.987691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1203/2437] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:09:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:09:09.033051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe597b-8db0-42ba-a0ef-c713d89a57f1 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:09.041709 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe597b-8db0-42ba-a0ef-c713d89a57f1 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:09.045532 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e540c-1331-4915-826b-5f37dc4b0561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:09.046218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e540c-1331-4915-826b-5f37dc4b0561 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:09.046512 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e540c-1331-4915-826b-5f37dc4b0561 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:09.046795 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e540c-1331-4915-826b-5f37dc4b0561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:09.056479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e540c-1331-4915-826b-5f37dc4b0561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:09.057926 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e540c-1331-4915-826b-5f37dc4b0561 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:09.068723 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1235/2438] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:09:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:09:09.284212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab855dc-f5ba-49f4-abe7-4fe71e00463b service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:09.285897 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1ab855dc-f5ba-49f4-abe7-4fe71e00463b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:09.346321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab855dc-f5ba-49f4-abe7-4fe71e00463b service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:09.349961 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf82d0-7985-4215-9e36-c054d74ef1de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:09.350634 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf82d0-7985-4215-9e36-c054d74ef1de service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:09.350918 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf82d0-7985-4215-9e36-c054d74ef1de service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:09.351192 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf82d0-7985-4215-9e36-c054d74ef1de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:09.353482 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bcdf82d0-7985-4215-9e36-c054d74ef1de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:09.423280 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf82d0-7985-4215-9e36-c054d74ef1de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:09.424781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf82d0-7985-4215-9e36-c054d74ef1de service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:09.435731 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1204/2439] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:09:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:09:12.559685 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e540c-1331-4915-826b-5f37dc4b0561 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:12.561248 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-494e540c-1331-4915-826b-5f37dc4b0561 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:12.640882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf82d0-7985-4215-9e36-c054d74ef1de service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:12.642954 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bcdf82d0-7985-4215-9e36-c054d74ef1de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:12.658052 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf82d0-7985-4215-9e36-c054d74ef1de service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:12.663513 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e8c46-4dc9-41cb-af47-c92baf07908a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:12.664403 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e8c46-4dc9-41cb-af47-c92baf07908a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:12.664691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e8c46-4dc9-41cb-af47-c92baf07908a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:12.664959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e8c46-4dc9-41cb-af47-c92baf07908a admin admin] PATH_INFO: `/v3/users/a63509391b174805b4ae58b53195a44c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:12.667019 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e8c46-4dc9-41cb-af47-c92baf07908a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a63509391b174805b4ae58b53195a44c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:12.669293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e8c46-4dc9-41cb-af47-c92baf07908a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:12.675633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e540c-1331-4915-826b-5f37dc4b0561 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:12.682232 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432ebc5-0ca6-44b8-9044-6ac0089a00db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:12.682914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432ebc5-0ca6-44b8-9044-6ac0089a00db service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:12.683197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432ebc5-0ca6-44b8-9044-6ac0089a00db service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:12.683480 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432ebc5-0ca6-44b8-9044-6ac0089a00db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:12.685357 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3432ebc5-0ca6-44b8-9044-6ac0089a00db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:12.699579 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3432ebc5-0ca6-44b8-9044-6ac0089a00db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:12.701219 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3432ebc5-0ca6-44b8-9044-6ac0089a00db service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:12.714138 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1236/2440] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:09:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:09:12.731851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4a3e8c46-4dc9-41cb-af47-c92baf07908a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a63509391b174805b4ae58b53195a44c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:12.740316 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4a3e8c46-4dc9-41cb-af47-c92baf07908a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a63509391b174805b4ae58b53195a44c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:12.753804 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4a3e8c46-4dc9-41cb-af47-c92baf07908a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a63509391b174805b4ae58b53195a44c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:12.762683 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4a3e8c46-4dc9-41cb-af47-c92baf07908a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a63509391b174805b4ae58b53195a44c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:12.763323 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4a3e8c46-4dc9-41cb-af47-c92baf07908a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a63509391b174805b4ae58b53195a44c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:12.769826 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1205/2441] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:09:12 2022] DELETE /identity/v3/users/a63509391b174805b4ae58b53195a44c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:12.949781 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432ebc5-0ca6-44b8-9044-6ac0089a00db service placement] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:12.961124 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432ebc5-0ca6-44b8-9044-6ac0089a00db service placement] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:13.026159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c580474-9b9a-4e16-b69b-75d5169e7e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:13.027036 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c580474-9b9a-4e16-b69b-75d5169e7e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:13.027325 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c580474-9b9a-4e16-b69b-75d5169e7e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:13.027602 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c580474-9b9a-4e16-b69b-75d5169e7e72 admin admin] PATH_INFO: `/v3/projects/1dd117ba2f1f4695bc89e420278a487c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:13.028793 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c580474-9b9a-4e16-b69b-75d5169e7e72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dd117ba2f1f4695bc89e420278a487c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:13.030840 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c580474-9b9a-4e16-b69b-75d5169e7e72 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:13.039055 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:13.084221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9c580474-9b9a-4e16-b69b-75d5169e7e72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dd117ba2f1f4695bc89e420278a487c', 'request_id': 'req-9c580474-9b9a-4e16-b69b-75d5169e7e72'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:13.090263 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9c580474-9b9a-4e16-b69b-75d5169e7e72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dd117ba2f1f4695bc89e420278a487c', 'request_id': 'req-9c580474-9b9a-4e16-b69b-75d5169e7e72'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:13.099591 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9c580474-9b9a-4e16-b69b-75d5169e7e72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dd117ba2f1f4695bc89e420278a487c', 'request_id': 'req-9c580474-9b9a-4e16-b69b-75d5169e7e72'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:13.112491 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9c580474-9b9a-4e16-b69b-75d5169e7e72 admin admin] The token cache is being invalidate because project 1dd117ba2f1f4695bc89e420278a487c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:09:13.112825 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9c580474-9b9a-4e16-b69b-75d5169e7e72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:13.113494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9c580474-9b9a-4e16-b69b-75d5169e7e72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:13.115165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1237/2442] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:09:12 2022] DELETE /identity/v3/projects/1dd117ba2f1f4695bc89e420278a487c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:13.121283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a9784-7266-466d-a1dd-4c652edea917 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:13.121532 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a9784-7266-466d-a1dd-4c652edea917 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:13.121885 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a9784-7266-466d-a1dd-4c652edea917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:13.143834 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-135a9784-7266-466d-a1dd-4c652edea917 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:13.145078 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-135a9784-7266-466d-a1dd-4c652edea917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:13.150851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:13.210880 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1206/2443] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:13.219197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca22b98-683c-4b2a-beab-727593e6dd1c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:13.220123 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca22b98-683c-4b2a-beab-727593e6dd1c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:13.220392 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca22b98-683c-4b2a-beab-727593e6dd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:13.241471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-dca22b98-683c-4b2a-beab-727593e6dd1c None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:13.242749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dca22b98-683c-4b2a-beab-727593e6dd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:13.251868 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1238/2444] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:13.256407 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a9784-7266-466d-a1dd-4c652edea917 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:13.268013 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a9784-7266-466d-a1dd-4c652edea917 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:13.272802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbf0db-fbb2-4643-a0e9-42551e7369df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:13.273466 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbf0db-fbb2-4643-a0e9-42551e7369df admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:13.273746 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbf0db-fbb2-4643-a0e9-42551e7369df admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:13.274026 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbf0db-fbb2-4643-a0e9-42551e7369df admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:13.274945 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fbf0db-fbb2-4643-a0e9-42551e7369df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:09:13.275316 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fbf0db-fbb2-4643-a0e9-42551e7369df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:13.276980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fbf0db-fbb2-4643-a0e9-42551e7369df admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:13.289850 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1207/2445] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:09:13.294687 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca22b98-683c-4b2a-beab-727593e6dd1c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:13.304223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca22b98-683c-4b2a-beab-727593e6dd1c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:13.308948 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a390d-c574-4ab2-a96f-f5679a22a65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:13.309602 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a390d-c574-4ab2-a96f-f5679a22a65f admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:13.309886 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a390d-c574-4ab2-a96f-f5679a22a65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:13.310206 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a390d-c574-4ab2-a96f-f5679a22a65f admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:13.310901 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a390d-c574-4ab2-a96f-f5679a22a65f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:13.312834 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a390d-c574-4ab2-a96f-f5679a22a65f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:13.343181 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1239/2446] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:09:13 2022] POST /identity/v3/projects => generated 405 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:09:13.345340 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbf0db-fbb2-4643-a0e9-42551e7369df admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:13.361565 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbf0db-fbb2-4643-a0e9-42551e7369df admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:13.439856 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f120478-fc3d-47ad-ba45-07423e0e95b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:13.440961 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f120478-fc3d-47ad-ba45-07423e0e95b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:13.441341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f120478-fc3d-47ad-ba45-07423e0e95b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:13.441693 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f120478-fc3d-47ad-ba45-07423e0e95b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:13.442431 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f120478-fc3d-47ad-ba45-07423e0e95b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:13.445030 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f120478-fc3d-47ad-ba45-07423e0e95b8 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:13.470621 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1208/2447] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:09:13 2022] POST /identity/v3/users => generated 303 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:09:13.476295 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a390d-c574-4ab2-a96f-f5679a22a65f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:13.488343 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a390d-c574-4ab2-a96f-f5679a22a65f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:13.493410 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5b8bb-2c05-40f8-9ea0-a6ebc9949ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:13.494093 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5b8bb-2c05-40f8-9ea0-a6ebc9949ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:13.494388 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5b8bb-2c05-40f8-9ea0-a6ebc9949ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:13.494662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5b8bb-2c05-40f8-9ea0-a6ebc9949ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:13.495386 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5b8bb-2c05-40f8-9ea0-a6ebc9949ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:13.496981 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5b8bb-2c05-40f8-9ea0-a6ebc9949ef7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:13.508350 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1240/2448] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:13.512814 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f120478-fc3d-47ad-ba45-07423e0e95b8 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:13.525461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f120478-fc3d-47ad-ba45-07423e0e95b8 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:13.530815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b263a7-423e-456c-96f2-e90886e647b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:13.531373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b263a7-423e-456c-96f2-e90886e647b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:13.531711 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b263a7-423e-456c-96f2-e90886e647b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:13.532025 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b263a7-423e-456c-96f2-e90886e647b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:13.532769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b263a7-423e-456c-96f2-e90886e647b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:13.534534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b263a7-423e-456c-96f2-e90886e647b8 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:13.545289 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1209/2449] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:13.550003 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5b8bb-2c05-40f8-9ea0-a6ebc9949ef7 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:13.560834 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5b8bb-2c05-40f8-9ea0-a6ebc9949ef7 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:13.567741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c0c73-75ba-47c0-937b-9241aca3861b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:13.568743 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c0c73-75ba-47c0-937b-9241aca3861b admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:13.569121 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c0c73-75ba-47c0-937b-9241aca3861b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:13.569504 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c0c73-75ba-47c0-937b-9241aca3861b admin admin] PATH_INFO: `/v3/projects/a928cb47703b4d21a4c302316f9e2ec2/users/e6daef2ca59f4fa68de0580d368e3885/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:13.589883 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c0c73-75ba-47c0-937b-9241aca3861b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a928cb47703b4d21a4c302316f9e2ec2, user_id=e6daef2ca59f4fa68de0580d368e3885, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:13.592617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c0c73-75ba-47c0-937b-9241aca3861b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:13.611140 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1241/2450] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:09:13 2022] PUT /identity/v3/projects/a928cb47703b4d21a4c302316f9e2ec2/users/e6daef2ca59f4fa68de0580d368e3885/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:13.619284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fef76-7f04-4a80-9f99-bdce1dc11d95 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:13.619573 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fef76-7f04-4a80-9f99-bdce1dc11d95 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:13.619856 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7fef76-7f04-4a80-9f99-bdce1dc11d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:13.640208 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-5e7fef76-7f04-4a80-9f99-bdce1dc11d95 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:13.641726 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5e7fef76-7f04-4a80-9f99-bdce1dc11d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:13.722807 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1210/2451] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:09:13.733829 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c0c73-75ba-47c0-937b-9241aca3861b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:13.736893 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9a2c0c73-75ba-47c0-937b-9241aca3861b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:13.847321 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c0c73-75ba-47c0-937b-9241aca3861b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:13.851347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790abf29-bd54-48a2-95d6-e897e6154726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:13.852006 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790abf29-bd54-48a2-95d6-e897e6154726 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:13.852293 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790abf29-bd54-48a2-95d6-e897e6154726 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:13.852566 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790abf29-bd54-48a2-95d6-e897e6154726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:13.863698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790abf29-bd54-48a2-95d6-e897e6154726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:13.865175 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790abf29-bd54-48a2-95d6-e897e6154726 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:13.877974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1242/2452] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:09:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:09:14.646556 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96602f3e-4788-4d6a-be8f-4369c345f098 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:14.647091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96602f3e-4788-4d6a-be8f-4369c345f098 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:14.647091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96602f3e-4788-4d6a-be8f-4369c345f098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:14.676367 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-96602f3e-4788-4d6a-be8f-4369c345f098 None None] MFA Rules not processed for user `e6daef2ca59f4fa68de0580d368e3885`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:14.677634 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-96602f3e-4788-4d6a-be8f-4369c345f098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:14.683116 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:14.751550 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1211/2453] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:09:14 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:09:14.756242 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790abf29-bd54-48a2-95d6-e897e6154726 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:14.769372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790abf29-bd54-48a2-95d6-e897e6154726 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:14.775931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7f0e7-b544-4e53-b47a-731f6cf2f4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:14.776684 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7f0e7-b544-4e53-b47a-731f6cf2f4fb admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:14.777049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7f0e7-b544-4e53-b47a-731f6cf2f4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:14.777543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7f0e7-b544-4e53-b47a-731f6cf2f4fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:14.778369 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7f0e7-b544-4e53-b47a-731f6cf2f4fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:14.780390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7f0e7-b544-4e53-b47a-731f6cf2f4fb admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:14.795380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:14.814128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1243/2454] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:09:14 2022] POST /identity/v3/projects => generated 405 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:09:14.819239 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96602f3e-4788-4d6a-be8f-4369c345f098 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:14.834816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96602f3e-4788-4d6a-be8f-4369c345f098 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:14.904853 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7dfee8-5b6f-4b91-bfb0-a9702731c76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:14.905451 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dfee8-5b6f-4b91-bfb0-a9702731c76d admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:14.905840 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dfee8-5b6f-4b91-bfb0-a9702731c76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:14.906241 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dfee8-5b6f-4b91-bfb0-a9702731c76d admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:14.907404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7dfee8-5b6f-4b91-bfb0-a9702731c76d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:14.909674 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7dfee8-5b6f-4b91-bfb0-a9702731c76d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:14.932540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1212/2455] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:09:14 2022] POST /identity/v3/users => generated 309 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:09:14.936789 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7f0e7-b544-4e53-b47a-731f6cf2f4fb admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:14.947876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7f0e7-b544-4e53-b47a-731f6cf2f4fb admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:14.952534 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214a7db-6356-446b-ae5b-1979768d66f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:14.953190 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214a7db-6356-446b-ae5b-1979768d66f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:14.953523 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214a7db-6356-446b-ae5b-1979768d66f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:14.953808 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214a7db-6356-446b-ae5b-1979768d66f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:14.954588 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214a7db-6356-446b-ae5b-1979768d66f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:14.956203 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214a7db-6356-446b-ae5b-1979768d66f7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:14.968916 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1244/2456] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:14.973927 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7dfee8-5b6f-4b91-bfb0-a9702731c76d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:14.986017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7dfee8-5b6f-4b91-bfb0-a9702731c76d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:14.991758 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3707fb-8e0e-46ff-ba62-7048b818831b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:14.992655 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3707fb-8e0e-46ff-ba62-7048b818831b admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:14.992991 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3707fb-8e0e-46ff-ba62-7048b818831b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:14.993453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3707fb-8e0e-46ff-ba62-7048b818831b admin admin] PATH_INFO: `/v3/projects/7fec777a8f264421ace705c2705255d3/users/0a26bb71fb654ecdb4e737abf6413979/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:15.012204 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3707fb-8e0e-46ff-ba62-7048b818831b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fec777a8f264421ace705c2705255d3, user_id=0a26bb71fb654ecdb4e737abf6413979, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:15.014446 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3707fb-8e0e-46ff-ba62-7048b818831b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:15.029800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1213/2457] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:09:14 2022] PUT /identity/v3/projects/7fec777a8f264421ace705c2705255d3/users/0a26bb71fb654ecdb4e737abf6413979/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:15.034837 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214a7db-6356-446b-ae5b-1979768d66f7 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:15.048074 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214a7db-6356-446b-ae5b-1979768d66f7 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:15.111274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468272f0-c501-455b-b32e-46d0d7409463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:15.111981 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468272f0-c501-455b-b32e-46d0d7409463 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:15.112268 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468272f0-c501-455b-b32e-46d0d7409463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:15.112557 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468272f0-c501-455b-b32e-46d0d7409463 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:15.113301 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468272f0-c501-455b-b32e-46d0d7409463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:15.114973 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468272f0-c501-455b-b32e-46d0d7409463 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:15.126113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1245/2458] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:15.131556 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3707fb-8e0e-46ff-ba62-7048b818831b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:15.146645 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3707fb-8e0e-46ff-ba62-7048b818831b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:15.152934 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b127459-6434-4c0c-91b8-2b68fe097922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:15.153837 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b127459-6434-4c0c-91b8-2b68fe097922 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:15.154186 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b127459-6434-4c0c-91b8-2b68fe097922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:15.154478 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b127459-6434-4c0c-91b8-2b68fe097922 admin admin] PATH_INFO: `/v3/projects/7fec777a8f264421ace705c2705255d3/users/0a26bb71fb654ecdb4e737abf6413979/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:15.157107 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b127459-6434-4c0c-91b8-2b68fe097922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fec777a8f264421ace705c2705255d3, user_id=0a26bb71fb654ecdb4e737abf6413979, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:15.160311 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b127459-6434-4c0c-91b8-2b68fe097922 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:15.173675 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1214/2459] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:09:15 2022] PUT /identity/v3/projects/7fec777a8f264421ace705c2705255d3/users/0a26bb71fb654ecdb4e737abf6413979/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:15.838107 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613d454-b9c4-45de-8131-cf7e653413d1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:15.839259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613d454-b9c4-45de-8131-cf7e653413d1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:15.839259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613d454-b9c4-45de-8131-cf7e653413d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:15.866891 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e613d454-b9c4-45de-8131-cf7e653413d1 None None] MFA Rules not processed for user `0a26bb71fb654ecdb4e737abf6413979`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:15.868241 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e613d454-b9c4-45de-8131-cf7e653413d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:15.963141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1246/2460] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:09:15 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:16.434951 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b127459-6434-4c0c-91b8-2b68fe097922 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:16.436731 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1b127459-6434-4c0c-91b8-2b68fe097922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:16.518897 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:16.526256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b127459-6434-4c0c-91b8-2b68fe097922 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:16.536682 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1afc7-f48a-46b1-bb07-887f88a05a54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:16.537446 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1afc7-f48a-46b1-bb07-887f88a05a54 service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:16.537807 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1afc7-f48a-46b1-bb07-887f88a05a54 service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:16.538209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1afc7-f48a-46b1-bb07-887f88a05a54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:16.540221 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-36c1afc7-f48a-46b1-bb07-887f88a05a54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:16.554718 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1afc7-f48a-46b1-bb07-887f88a05a54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:16.556492 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1afc7-f48a-46b1-bb07-887f88a05a54 service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:16.568954 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1215/2461] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:09:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:09:17.053017 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613d454-b9c4-45de-8131-cf7e653413d1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:17.134324 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613d454-b9c4-45de-8131-cf7e653413d1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:17.140203 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92248ae7-a78e-4fa9-803e-c8c37cb61e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:17.141791 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92248ae7-a78e-4fa9-803e-c8c37cb61e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:17.142282 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92248ae7-a78e-4fa9-803e-c8c37cb61e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:17.142573 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92248ae7-a78e-4fa9-803e-c8c37cb61e84 admin admin] PATH_INFO: `/v3/users/e6daef2ca59f4fa68de0580d368e3885` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:17.143792 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92248ae7-a78e-4fa9-803e-c8c37cb61e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6daef2ca59f4fa68de0580d368e3885)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:17.145747 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92248ae7-a78e-4fa9-803e-c8c37cb61e84 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:17.148290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:17.194234 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-92248ae7-a78e-4fa9-803e-c8c37cb61e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6daef2ca59f4fa68de0580d368e3885'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:17.194895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-92248ae7-a78e-4fa9-803e-c8c37cb61e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6daef2ca59f4fa68de0580d368e3885'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:17.203874 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-92248ae7-a78e-4fa9-803e-c8c37cb61e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6daef2ca59f4fa68de0580d368e3885'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:17.211662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-92248ae7-a78e-4fa9-803e-c8c37cb61e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6daef2ca59f4fa68de0580d368e3885'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:17.224842 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-92248ae7-a78e-4fa9-803e-c8c37cb61e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6daef2ca59f4fa68de0580d368e3885'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:17.231029 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1247/2462] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:09:17 2022] DELETE /identity/v3/users/e6daef2ca59f4fa68de0580d368e3885 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:17.414208 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1afc7-f48a-46b1-bb07-887f88a05a54 service placement] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:17.427086 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1afc7-f48a-46b1-bb07-887f88a05a54 service placement] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:17.489253 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f20f1-cc65-43d1-b70b-576122568ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:17.490148 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f20f1-cc65-43d1-b70b-576122568ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:17.490433 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f20f1-cc65-43d1-b70b-576122568ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:17.490711 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f20f1-cc65-43d1-b70b-576122568ff0 admin admin] PATH_INFO: `/v3/projects/a928cb47703b4d21a4c302316f9e2ec2` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:17.491909 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f20f1-cc65-43d1-b70b-576122568ff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a928cb47703b4d21a4c302316f9e2ec2)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:17.493839 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f20f1-cc65-43d1-b70b-576122568ff0 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:17.543510 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-642f20f1-cc65-43d1-b70b-576122568ff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a928cb47703b4d21a4c302316f9e2ec2', 'request_id': 'req-642f20f1-cc65-43d1-b70b-576122568ff0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:17.549927 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-642f20f1-cc65-43d1-b70b-576122568ff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a928cb47703b4d21a4c302316f9e2ec2', 'request_id': 'req-642f20f1-cc65-43d1-b70b-576122568ff0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:17.555858 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-642f20f1-cc65-43d1-b70b-576122568ff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a928cb47703b4d21a4c302316f9e2ec2', 'request_id': 'req-642f20f1-cc65-43d1-b70b-576122568ff0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:17.574226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-642f20f1-cc65-43d1-b70b-576122568ff0 admin admin] The token cache is being invalidate because project a928cb47703b4d21a4c302316f9e2ec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:09:17.574521 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-642f20f1-cc65-43d1-b70b-576122568ff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:17.575197 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-642f20f1-cc65-43d1-b70b-576122568ff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:17.576790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1216/2463] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:09:17 2022] DELETE /identity/v3/projects/a928cb47703b4d21a4c302316f9e2ec2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:09:17.583189 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92248ae7-a78e-4fa9-803e-c8c37cb61e84 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:17.584460 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-92248ae7-a78e-4fa9-803e-c8c37cb61e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:17.598165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92248ae7-a78e-4fa9-803e-c8c37cb61e84 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:17.667552 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcc61d-3b28-4c1d-8029-7c66cc4edec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:17.668325 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcc61d-3b28-4c1d-8029-7c66cc4edec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:17.668613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcc61d-3b28-4c1d-8029-7c66cc4edec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:17.668894 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcc61d-3b28-4c1d-8029-7c66cc4edec6 admin admin] PATH_INFO: `/v3/users/0a26bb71fb654ecdb4e737abf6413979` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:17.670159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcc61d-3b28-4c1d-8029-7c66cc4edec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a26bb71fb654ecdb4e737abf6413979)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:17.672766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcc61d-3b28-4c1d-8029-7c66cc4edec6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:17.726321 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e7dcc61d-3b28-4c1d-8029-7c66cc4edec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a26bb71fb654ecdb4e737abf6413979'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:17.727142 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e7dcc61d-3b28-4c1d-8029-7c66cc4edec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a26bb71fb654ecdb4e737abf6413979'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:17.735689 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e7dcc61d-3b28-4c1d-8029-7c66cc4edec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a26bb71fb654ecdb4e737abf6413979'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:17.743814 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e7dcc61d-3b28-4c1d-8029-7c66cc4edec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a26bb71fb654ecdb4e737abf6413979'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:17.757691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e7dcc61d-3b28-4c1d-8029-7c66cc4edec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a26bb71fb654ecdb4e737abf6413979'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:17.760239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:17.764941 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1248/2464] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:09:17 2022] DELETE /identity/v3/users/0a26bb71fb654ecdb4e737abf6413979 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:17.949290 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f20f1-cc65-43d1-b70b-576122568ff0 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:17.950839 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-642f20f1-cc65-43d1-b70b-576122568ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:17.964223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f20f1-cc65-43d1-b70b-576122568ff0 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:18.027546 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9b1fc-8e5c-4066-b879-ea93daf18c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:18.028442 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9b1fc-8e5c-4066-b879-ea93daf18c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:18.028712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9b1fc-8e5c-4066-b879-ea93daf18c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:18.028990 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9b1fc-8e5c-4066-b879-ea93daf18c7e admin admin] PATH_INFO: `/v3/projects/7fec777a8f264421ace705c2705255d3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:18.030258 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9b1fc-8e5c-4066-b879-ea93daf18c7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fec777a8f264421ace705c2705255d3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:18.032740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9b1fc-8e5c-4066-b879-ea93daf18c7e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:18.057424 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:18.084559 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-46f9b1fc-8e5c-4066-b879-ea93daf18c7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fec777a8f264421ace705c2705255d3', 'request_id': 'req-46f9b1fc-8e5c-4066-b879-ea93daf18c7e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:18.090982 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-46f9b1fc-8e5c-4066-b879-ea93daf18c7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fec777a8f264421ace705c2705255d3', 'request_id': 'req-46f9b1fc-8e5c-4066-b879-ea93daf18c7e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:18.097408 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-46f9b1fc-8e5c-4066-b879-ea93daf18c7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fec777a8f264421ace705c2705255d3', 'request_id': 'req-46f9b1fc-8e5c-4066-b879-ea93daf18c7e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:18.112682 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-46f9b1fc-8e5c-4066-b879-ea93daf18c7e admin admin] The token cache is being invalidate because project 7fec777a8f264421ace705c2705255d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:09:18.112974 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-46f9b1fc-8e5c-4066-b879-ea93daf18c7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:18.113612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-46f9b1fc-8e5c-4066-b879-ea93daf18c7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:09:18.115233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1217/2465] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:09:17 2022] DELETE /identity/v3/projects/7fec777a8f264421ace705c2705255d3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:18.120190 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d2b04-7a91-42a7-b246-daf01f4190b0 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:18.120684 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d2b04-7a91-42a7-b246-daf01f4190b0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:18.120788 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d2b04-7a91-42a7-b246-daf01f4190b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:18.143156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-608d2b04-7a91-42a7-b246-daf01f4190b0 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:18.144919 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-608d2b04-7a91-42a7-b246-daf01f4190b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:18.216356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1249/2466] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:18.231656 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e05cc-b4cd-4a63-a57e-2f2d40947e4d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:18.231943 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e05cc-b4cd-4a63-a57e-2f2d40947e4d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:18.232227 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e05cc-b4cd-4a63-a57e-2f2d40947e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:18.252231 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-e21e05cc-b4cd-4a63-a57e-2f2d40947e4d None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:18.254374 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e21e05cc-b4cd-4a63-a57e-2f2d40947e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:18.264032 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1218/2467] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:18.269368 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d2b04-7a91-42a7-b246-daf01f4190b0 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:18.280529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d2b04-7a91-42a7-b246-daf01f4190b0 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:18.285928 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f895d2c-9304-4909-8a0c-39334bdc9f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:18.286629 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f895d2c-9304-4909-8a0c-39334bdc9f74 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:18.286920 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f895d2c-9304-4909-8a0c-39334bdc9f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:18.287206 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f895d2c-9304-4909-8a0c-39334bdc9f74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:18.288301 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f895d2c-9304-4909-8a0c-39334bdc9f74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:09:18.288654 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f895d2c-9304-4909-8a0c-39334bdc9f74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:18.290315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f895d2c-9304-4909-8a0c-39334bdc9f74 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:18.308027 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1250/2468] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:09:18.313937 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e05cc-b4cd-4a63-a57e-2f2d40947e4d None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:18.323688 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e05cc-b4cd-4a63-a57e-2f2d40947e4d None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:18.330474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776467d-2eaf-47b3-8f21-8f6bb3a9dc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:18.331552 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776467d-2eaf-47b3-8f21-8f6bb3a9dc28 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:18.332052 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776467d-2eaf-47b3-8f21-8f6bb3a9dc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:18.332492 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776467d-2eaf-47b3-8f21-8f6bb3a9dc28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:18.333213 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776467d-2eaf-47b3-8f21-8f6bb3a9dc28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:18.335249 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776467d-2eaf-47b3-8f21-8f6bb3a9dc28 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:18.363310 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1219/2469] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:09:18 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:09:18.367350 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f895d2c-9304-4909-8a0c-39334bdc9f74 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:18.378511 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f895d2c-9304-4909-8a0c-39334bdc9f74 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:18.451676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a53ebb-0fec-4f12-b456-2e50ebf3f538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:18.452370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a53ebb-0fec-4f12-b456-2e50ebf3f538 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:18.452660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a53ebb-0fec-4f12-b456-2e50ebf3f538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:18.452944 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a53ebb-0fec-4f12-b456-2e50ebf3f538 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:18.453689 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a53ebb-0fec-4f12-b456-2e50ebf3f538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:18.455721 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a53ebb-0fec-4f12-b456-2e50ebf3f538 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:18.476191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1251/2470] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:09:18 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:09:18.480400 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776467d-2eaf-47b3-8f21-8f6bb3a9dc28 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:18.491890 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776467d-2eaf-47b3-8f21-8f6bb3a9dc28 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:18.496780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a3cbc-1ee7-49f9-b1df-8aab6807bec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:18.497452 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a3cbc-1ee7-49f9-b1df-8aab6807bec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:18.497733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a3cbc-1ee7-49f9-b1df-8aab6807bec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:18.498006 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a3cbc-1ee7-49f9-b1df-8aab6807bec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:18.498783 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a3cbc-1ee7-49f9-b1df-8aab6807bec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:18.500487 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a3cbc-1ee7-49f9-b1df-8aab6807bec7 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:18.515136 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1220/2471] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:18.519674 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a53ebb-0fec-4f12-b456-2e50ebf3f538 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:18.530537 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a53ebb-0fec-4f12-b456-2e50ebf3f538 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:18.535748 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9a5cd-975f-40b8-9e6b-74c17bb3e5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:18.536400 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9a5cd-975f-40b8-9e6b-74c17bb3e5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:18.536676 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9a5cd-975f-40b8-9e6b-74c17bb3e5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:18.536947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9a5cd-975f-40b8-9e6b-74c17bb3e5c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:18.537677 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9a5cd-975f-40b8-9e6b-74c17bb3e5c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:18.539319 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9a5cd-975f-40b8-9e6b-74c17bb3e5c7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:18.550813 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1252/2472] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:18.555348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a3cbc-1ee7-49f9-b1df-8aab6807bec7 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:18.570262 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a3cbc-1ee7-49f9-b1df-8aab6807bec7 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:18.575009 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb8077-525c-4e06-91cb-c8ded9f15beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:18.575896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb8077-525c-4e06-91cb-c8ded9f15beb admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:18.576169 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb8077-525c-4e06-91cb-c8ded9f15beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:18.576447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb8077-525c-4e06-91cb-c8ded9f15beb admin admin] PATH_INFO: `/v3/projects/05743d2045d44c8e8e7343099d74ca72/users/eb8073260db94ae1b90f034f34745ddb/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:18.599612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb8077-525c-4e06-91cb-c8ded9f15beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=05743d2045d44c8e8e7343099d74ca72, user_id=eb8073260db94ae1b90f034f34745ddb, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:18.602305 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb8077-525c-4e06-91cb-c8ded9f15beb admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:18.619152 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1221/2473] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:09:18 2022] PUT /identity/v3/projects/05743d2045d44c8e8e7343099d74ca72/users/eb8073260db94ae1b90f034f34745ddb/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:09:18.629849 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8cebf-d6ac-4c61-b6bc-983653f2d345 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:18.630174 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8cebf-d6ac-4c61-b6bc-983653f2d345 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:18.630451 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8cebf-d6ac-4c61-b6bc-983653f2d345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:18.674861 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-1fb8cebf-d6ac-4c61-b6bc-983653f2d345 None None] MFA Rules not processed for user `eb8073260db94ae1b90f034f34745ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:18.676083 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1fb8cebf-d6ac-4c61-b6bc-983653f2d345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:18.737991 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:18.748035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1253/2474] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:09:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:18.755107 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb8077-525c-4e06-91cb-c8ded9f15beb admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:18.822140 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb8077-525c-4e06-91cb-c8ded9f15beb admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:18.827936 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122b192-d45c-4f9b-aa42-2dc94b44ae09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:18.828647 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122b192-d45c-4f9b-aa42-2dc94b44ae09 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:18.828965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122b192-d45c-4f9b-aa42-2dc94b44ae09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:18.829242 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7122b192-d45c-4f9b-aa42-2dc94b44ae09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:18.829954 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122b192-d45c-4f9b-aa42-2dc94b44ae09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:18.831947 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7122b192-d45c-4f9b-aa42-2dc94b44ae09 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:18.863580 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1222/2475] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:09:18 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:09:18.867952 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8cebf-d6ac-4c61-b6bc-983653f2d345 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:18.880048 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8cebf-d6ac-4c61-b6bc-983653f2d345 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:18.952642 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e553ec-07cf-4499-883a-e30a696cdfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:18.953369 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e553ec-07cf-4499-883a-e30a696cdfb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:18.953644 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e553ec-07cf-4499-883a-e30a696cdfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:18.953920 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e553ec-07cf-4499-883a-e30a696cdfb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:18.954659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e553ec-07cf-4499-883a-e30a696cdfb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:18.956649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e553ec-07cf-4499-883a-e30a696cdfb7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:18.981585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1254/2476] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:09:18 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:09:18.986498 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122b192-d45c-4f9b-aa42-2dc94b44ae09 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:18.997892 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7122b192-d45c-4f9b-aa42-2dc94b44ae09 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:19.004332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bab043-7465-4607-9366-ab6fc83f0681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:19.005021 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bab043-7465-4607-9366-ab6fc83f0681 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:19.005307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bab043-7465-4607-9366-ab6fc83f0681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:19.005589 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bab043-7465-4607-9366-ab6fc83f0681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:19.006353 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bab043-7465-4607-9366-ab6fc83f0681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:19.007975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bab043-7465-4607-9366-ab6fc83f0681 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:19.022453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1223/2477] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 16:09:19.027610 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e553ec-07cf-4499-883a-e30a696cdfb7 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:19.041267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e553ec-07cf-4499-883a-e30a696cdfb7 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:19.046010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a3c62-d611-4515-a50a-3412561875a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:19.047055 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a3c62-d611-4515-a50a-3412561875a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:19.047976 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a3c62-d611-4515-a50a-3412561875a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:19.048560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a3c62-d611-4515-a50a-3412561875a0 admin admin] PATH_INFO: `/v3/projects/3216d2668dd44fd48ca8cc0edd6cce38/users/94118e69988f4a928524bfbe543771ba/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:19.067557 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a3c62-d611-4515-a50a-3412561875a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3216d2668dd44fd48ca8cc0edd6cce38, user_id=94118e69988f4a928524bfbe543771ba, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:19.070388 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a3c62-d611-4515-a50a-3412561875a0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:19.093211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1255/2478] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:09:19 2022] PUT /identity/v3/projects/3216d2668dd44fd48ca8cc0edd6cce38/users/94118e69988f4a928524bfbe543771ba/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:19.097997 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bab043-7465-4607-9366-ab6fc83f0681 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:19.108814 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bab043-7465-4607-9366-ab6fc83f0681 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:19.135243 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:19.186064 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908fd04-fc64-4eb7-8ad0-a25c0d4b2427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:19.186874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908fd04-fc64-4eb7-8ad0-a25c0d4b2427 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:19.187244 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908fd04-fc64-4eb7-8ad0-a25c0d4b2427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:19.187534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908fd04-fc64-4eb7-8ad0-a25c0d4b2427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:19.188658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908fd04-fc64-4eb7-8ad0-a25c0d4b2427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:19.190316 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908fd04-fc64-4eb7-8ad0-a25c0d4b2427 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:19.201340 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1224/2479] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:09:19.208285 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a3c62-d611-4515-a50a-3412561875a0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:09:19.220488 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a3c62-d611-4515-a50a-3412561875a0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:09:19.225224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4628af1-f124-437b-b20d-d0524a764986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:09:19.226148 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4628af1-f124-437b-b20d-d0524a764986 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:19.226440 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4628af1-f124-437b-b20d-d0524a764986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:19.226722 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4628af1-f124-437b-b20d-d0524a764986 admin admin] PATH_INFO: `/v3/projects/3216d2668dd44fd48ca8cc0edd6cce38/users/94118e69988f4a928524bfbe543771ba/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:19.228947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4628af1-f124-437b-b20d-d0524a764986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3216d2668dd44fd48ca8cc0edd6cce38, user_id=94118e69988f4a928524bfbe543771ba, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:09:19.231801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4628af1-f124-437b-b20d-d0524a764986 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:09:19.243152 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1256/2480] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:09:19 2022] PUT /identity/v3/projects/3216d2668dd44fd48ca8cc0edd6cce38/users/94118e69988f4a928524bfbe543771ba/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:09:19.254102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717ff7b-2cd6-4fe9-b421-4b8e22fae3d8 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:09:19.254322 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717ff7b-2cd6-4fe9-b421-4b8e22fae3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:09:19.254604 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717ff7b-2cd6-4fe9-b421-4b8e22fae3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:09:19.284631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-1717ff7b-2cd6-4fe9-b421-4b8e22fae3d8 None None] MFA Rules not processed for user `94118e69988f4a928524bfbe543771ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:09:19.285875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1717ff7b-2cd6-4fe9-b421-4b8e22fae3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:09:19.361569 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1225/2481] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:09:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:09:29.239151 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=46,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:29.357585 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=54 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:19.434833 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4628af1-f124-437b-b20d-d0524a764986 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:19.498296 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4628af1-f124-437b-b20d-d0524a764986 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:19.503604 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0f491-0777-411a-87d0-3b45a990f53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:19.504467 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0f491-0777-411a-87d0-3b45a990f53c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:19.504748 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0f491-0777-411a-87d0-3b45a990f53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:19.505023 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0f491-0777-411a-87d0-3b45a990f53c admin admin] PATH_INFO: `/v3/users/eb8073260db94ae1b90f034f34745ddb` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:19.506233 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0f491-0777-411a-87d0-3b45a990f53c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb8073260db94ae1b90f034f34745ddb)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:19.508447 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0f491-0777-411a-87d0-3b45a990f53c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:19.556016 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-42a0f491-0777-411a-87d0-3b45a990f53c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb8073260db94ae1b90f034f34745ddb'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:19.556699 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-42a0f491-0777-411a-87d0-3b45a990f53c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb8073260db94ae1b90f034f34745ddb'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:19.564671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-42a0f491-0777-411a-87d0-3b45a990f53c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb8073260db94ae1b90f034f34745ddb'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:19.572397 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-42a0f491-0777-411a-87d0-3b45a990f53c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb8073260db94ae1b90f034f34745ddb'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:19.585057 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-42a0f491-0777-411a-87d0-3b45a990f53c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb8073260db94ae1b90f034f34745ddb'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:19.591713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1257/2482] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:10:19 2022] DELETE /identity/v3/users/eb8073260db94ae1b90f034f34745ddb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:19.596769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560efce-2d53-4a97-820b-9e6171c30781 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:19.597254 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560efce-2d53-4a97-820b-9e6171c30781 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:19.597359 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560efce-2d53-4a97-820b-9e6171c30781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:19.615265 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3560efce-2d53-4a97-820b-9e6171c30781 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:10:19.616484 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3560efce-2d53-4a97-820b-9e6171c30781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:19.676482 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1226/2483] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:10:19.686305 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0f491-0777-411a-87d0-3b45a990f53c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:19.688243 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-42a0f491-0777-411a-87d0-3b45a990f53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:19.745776 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0f491-0777-411a-87d0-3b45a990f53c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:19.749464 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f73ad2-38eb-45c2-951b-b5a476885aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:19.750634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f73ad2-38eb-45c2-951b-b5a476885aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:19.750921 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f73ad2-38eb-45c2-951b-b5a476885aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:19.751199 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f73ad2-38eb-45c2-951b-b5a476885aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:19.760944 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f73ad2-38eb-45c2-951b-b5a476885aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:19.762435 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f73ad2-38eb-45c2-951b-b5a476885aa6 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:19.772602 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1258/2484] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:10:20.052571 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560efce-2d53-4a97-820b-9e6171c30781 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:20.054009 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3560efce-2d53-4a97-820b-9e6171c30781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:20.067341 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560efce-2d53-4a97-820b-9e6171c30781 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:20.072453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c81af-2311-4f8b-8b28-a28743481a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:20.073402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c81af-2311-4f8b-8b28-a28743481a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:20.073783 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c81af-2311-4f8b-8b28-a28743481a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:20.074092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c81af-2311-4f8b-8b28-a28743481a59 admin admin] PATH_INFO: `/v3/projects/05743d2045d44c8e8e7343099d74ca72` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:20.075370 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c81af-2311-4f8b-8b28-a28743481a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05743d2045d44c8e8e7343099d74ca72)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:20.077353 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c81af-2311-4f8b-8b28-a28743481a59 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:20.128016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-da6c81af-2311-4f8b-8b28-a28743481a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05743d2045d44c8e8e7343099d74ca72', 'request_id': 'req-da6c81af-2311-4f8b-8b28-a28743481a59'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:20.135291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-da6c81af-2311-4f8b-8b28-a28743481a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05743d2045d44c8e8e7343099d74ca72', 'request_id': 'req-da6c81af-2311-4f8b-8b28-a28743481a59'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:20.140900 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-da6c81af-2311-4f8b-8b28-a28743481a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05743d2045d44c8e8e7343099d74ca72', 'request_id': 'req-da6c81af-2311-4f8b-8b28-a28743481a59'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:20.153558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-da6c81af-2311-4f8b-8b28-a28743481a59 admin admin] The token cache is being invalidate because project 05743d2045d44c8e8e7343099d74ca72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:10:20.153852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-da6c81af-2311-4f8b-8b28-a28743481a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:20.154498 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-da6c81af-2311-4f8b-8b28-a28743481a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:20.156040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1227/2485] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:10:20 2022] DELETE /identity/v3/projects/05743d2045d44c8e8e7343099d74ca72 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:20.160042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f73ad2-38eb-45c2-951b-b5a476885aa6 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:20.169897 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f73ad2-38eb-45c2-951b-b5a476885aa6 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:20.189590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:20.238341 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fd2c8-e5f3-46de-94bb-579bd8041db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:20.239225 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fd2c8-e5f3-46de-94bb-579bd8041db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:20.239506 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fd2c8-e5f3-46de-94bb-579bd8041db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:20.239781 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fd2c8-e5f3-46de-94bb-579bd8041db9 admin admin] PATH_INFO: `/v3/users/94118e69988f4a928524bfbe543771ba` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:20.240963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139fd2c8-e5f3-46de-94bb-579bd8041db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94118e69988f4a928524bfbe543771ba)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:20.242937 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139fd2c8-e5f3-46de-94bb-579bd8041db9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:20.289986 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-139fd2c8-e5f3-46de-94bb-579bd8041db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94118e69988f4a928524bfbe543771ba'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:20.290655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-139fd2c8-e5f3-46de-94bb-579bd8041db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94118e69988f4a928524bfbe543771ba'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:20.299064 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-139fd2c8-e5f3-46de-94bb-579bd8041db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94118e69988f4a928524bfbe543771ba'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:20.306262 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-139fd2c8-e5f3-46de-94bb-579bd8041db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94118e69988f4a928524bfbe543771ba'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:20.319396 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-139fd2c8-e5f3-46de-94bb-579bd8041db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94118e69988f4a928524bfbe543771ba'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:20.325844 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1259/2486] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:10:20 2022] DELETE /identity/v3/users/94118e69988f4a928524bfbe543771ba => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:20.611493 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c81af-2311-4f8b-8b28-a28743481a59 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:20.613272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-da6c81af-2311-4f8b-8b28-a28743481a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:20.631096 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c81af-2311-4f8b-8b28-a28743481a59 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:20.695600 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213782a0-04f1-4d3e-8c5b-ab604cd978ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:20.696606 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213782a0-04f1-4d3e-8c5b-ab604cd978ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:20.696918 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213782a0-04f1-4d3e-8c5b-ab604cd978ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:20.697248 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213782a0-04f1-4d3e-8c5b-ab604cd978ce admin admin] PATH_INFO: `/v3/projects/3216d2668dd44fd48ca8cc0edd6cce38` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:20.698471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213782a0-04f1-4d3e-8c5b-ab604cd978ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=3216d2668dd44fd48ca8cc0edd6cce38)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:20.700413 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213782a0-04f1-4d3e-8c5b-ab604cd978ce admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:20.732682 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:20.751371 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-213782a0-04f1-4d3e-8c5b-ab604cd978ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3216d2668dd44fd48ca8cc0edd6cce38', 'request_id': 'req-213782a0-04f1-4d3e-8c5b-ab604cd978ce'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:20.758564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-213782a0-04f1-4d3e-8c5b-ab604cd978ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3216d2668dd44fd48ca8cc0edd6cce38', 'request_id': 'req-213782a0-04f1-4d3e-8c5b-ab604cd978ce'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:20.764234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-213782a0-04f1-4d3e-8c5b-ab604cd978ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3216d2668dd44fd48ca8cc0edd6cce38', 'request_id': 'req-213782a0-04f1-4d3e-8c5b-ab604cd978ce'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:20.777204 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-213782a0-04f1-4d3e-8c5b-ab604cd978ce admin admin] The token cache is being invalidate because project 3216d2668dd44fd48ca8cc0edd6cce38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:10:20.777491 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-213782a0-04f1-4d3e-8c5b-ab604cd978ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:20.778146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-213782a0-04f1-4d3e-8c5b-ab604cd978ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:10:20.779710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1228/2487] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:10:20 2022] DELETE /identity/v3/projects/3216d2668dd44fd48ca8cc0edd6cce38 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:20.785366 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953c144-9dab-49ae-a96f-5df88a9b8acb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:20.785845 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953c144-9dab-49ae-a96f-5df88a9b8acb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:20.785939 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953c144-9dab-49ae-a96f-5df88a9b8acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:20.805184 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-1953c144-9dab-49ae-a96f-5df88a9b8acb None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:10:20.806554 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1953c144-9dab-49ae-a96f-5df88a9b8acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:20.867685 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1260/2488] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:10:20.930687 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d782f0-ba4b-4e66-9d6f-7f7cf458ad17 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:20.930972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d782f0-ba4b-4e66-9d6f-7f7cf458ad17 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:20.931257 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d782f0-ba4b-4e66-9d6f-7f7cf458ad17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:20.950670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a8d782f0-ba4b-4e66-9d6f-7f7cf458ad17 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:10:20.951872 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a8d782f0-ba4b-4e66-9d6f-7f7cf458ad17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:20.959736 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1229/2489] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:10:20.963989 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953c144-9dab-49ae-a96f-5df88a9b8acb None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:20.974503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953c144-9dab-49ae-a96f-5df88a9b8acb None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:20.979559 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c666654-7fb7-43be-abcc-adf5b02cef32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:20.980206 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c666654-7fb7-43be-abcc-adf5b02cef32 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:20.980488 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c666654-7fb7-43be-abcc-adf5b02cef32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:20.980765 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c666654-7fb7-43be-abcc-adf5b02cef32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:20.981484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c666654-7fb7-43be-abcc-adf5b02cef32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:10:20.981792 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c666654-7fb7-43be-abcc-adf5b02cef32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:20.983495 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c666654-7fb7-43be-abcc-adf5b02cef32 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:20.995697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1261/2490] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:10:21.000010 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d782f0-ba4b-4e66-9d6f-7f7cf458ad17 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:21.009531 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d782f0-ba4b-4e66-9d6f-7f7cf458ad17 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:21.014148 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8472e75-35c3-467c-8303-4876a577ac5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:21.014790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8472e75-35c3-467c-8303-4876a577ac5e admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:21.015073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8472e75-35c3-467c-8303-4876a577ac5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:21.015348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8472e75-35c3-467c-8303-4876a577ac5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:21.016208 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8472e75-35c3-467c-8303-4876a577ac5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:21.018125 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8472e75-35c3-467c-8303-4876a577ac5e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:21.044358 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1230/2491] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:10:20 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:10:21.049876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c666654-7fb7-43be-abcc-adf5b02cef32 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:21.060087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c666654-7fb7-43be-abcc-adf5b02cef32 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:21.086251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:21.123363 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116fe0ab-3584-4597-8592-4c125ce5b2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:21.124035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fe0ab-3584-4597-8592-4c125ce5b2df admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:21.124321 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fe0ab-3584-4597-8592-4c125ce5b2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:21.124605 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fe0ab-3584-4597-8592-4c125ce5b2df admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:21.125806 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116fe0ab-3584-4597-8592-4c125ce5b2df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:21.127866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116fe0ab-3584-4597-8592-4c125ce5b2df admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:21.148879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1262/2492] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:10:21 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:10:21.153135 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8472e75-35c3-467c-8303-4876a577ac5e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:21.164268 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8472e75-35c3-467c-8303-4876a577ac5e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:21.168984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49040832-d319-4172-a7fe-5a3373d20a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:21.169841 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49040832-d319-4172-a7fe-5a3373d20a2b admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:21.170154 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49040832-d319-4172-a7fe-5a3373d20a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:21.170438 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49040832-d319-4172-a7fe-5a3373d20a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:21.173452 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49040832-d319-4172-a7fe-5a3373d20a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:21.175123 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49040832-d319-4172-a7fe-5a3373d20a2b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:21.190903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1231/2493] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:10:21.195064 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116fe0ab-3584-4597-8592-4c125ce5b2df admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:21.205760 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116fe0ab-3584-4597-8592-4c125ce5b2df admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:21.210537 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0aa251-80dc-4776-a188-f73f5adf54db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:21.211042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0aa251-80dc-4776-a188-f73f5adf54db admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:21.211327 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0aa251-80dc-4776-a188-f73f5adf54db admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:21.211606 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0aa251-80dc-4776-a188-f73f5adf54db admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:21.212332 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0aa251-80dc-4776-a188-f73f5adf54db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:21.213931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0aa251-80dc-4776-a188-f73f5adf54db admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:21.227389 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1263/2494] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:10:21.231776 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49040832-d319-4172-a7fe-5a3373d20a2b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:21.242384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49040832-d319-4172-a7fe-5a3373d20a2b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:21.247023 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8c10f-a878-487f-a28b-698593006839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:21.247905 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8c10f-a878-487f-a28b-698593006839 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:21.248188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8c10f-a878-487f-a28b-698593006839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:21.248468 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8c10f-a878-487f-a28b-698593006839 admin admin] PATH_INFO: `/v3/projects/2970819a85d44503bccaf80eef5f9426/users/11428571fc3a4d49af0e2623bec1fd3f/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:21.265057 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8c10f-a878-487f-a28b-698593006839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2970819a85d44503bccaf80eef5f9426, user_id=11428571fc3a4d49af0e2623bec1fd3f, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:21.268383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8c10f-a878-487f-a28b-698593006839 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:21.282355 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1232/2495] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:10:21 2022] PUT /identity/v3/projects/2970819a85d44503bccaf80eef5f9426/users/11428571fc3a4d49af0e2623bec1fd3f/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:21.292877 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b40962-fc23-4cf3-afa0-75f226559d9c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:21.293154 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b40962-fc23-4cf3-afa0-75f226559d9c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:21.293450 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b40962-fc23-4cf3-afa0-75f226559d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:21.447552 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-87b40962-fc23-4cf3-afa0-75f226559d9c None None] MFA Rules not processed for user `11428571fc3a4d49af0e2623bec1fd3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:10:21.448896 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-87b40962-fc23-4cf3-afa0-75f226559d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:21.464180 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8c10f-a878-487f-a28b-698593006839 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:21.465892 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6fb8c10f-a878-487f-a28b-698593006839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:21.524465 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1264/2496] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:10:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:10:21.526462 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8c10f-a878-487f-a28b-698593006839 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:21.529421 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b40962-fc23-4cf3-afa0-75f226559d9c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:21.530306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb07ac-9d3f-409e-b02c-e9e6010e2010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:21.531154 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb07ac-9d3f-409e-b02c-e9e6010e2010 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:21.532054 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb07ac-9d3f-409e-b02c-e9e6010e2010 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:21.532332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb07ac-9d3f-409e-b02c-e9e6010e2010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:21.534254 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-14eb07ac-9d3f-409e-b02c-e9e6010e2010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:21.544643 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb07ac-9d3f-409e-b02c-e9e6010e2010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:21.546102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb07ac-9d3f-409e-b02c-e9e6010e2010 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:21.554627 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1233/2497] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:10:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:10:21.599113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b40962-fc23-4cf3-afa0-75f226559d9c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:21.603703 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3019b-649a-41e3-b5b9-a7e7e9d9fd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:21.604362 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3019b-649a-41e3-b5b9-a7e7e9d9fd66 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:21.604648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3019b-649a-41e3-b5b9-a7e7e9d9fd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:21.604929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3019b-649a-41e3-b5b9-a7e7e9d9fd66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:21.605644 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3019b-649a-41e3-b5b9-a7e7e9d9fd66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:21.607611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3019b-649a-41e3-b5b9-a7e7e9d9fd66 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:21.635357 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1265/2498] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:10:21 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:10:21.639579 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb07ac-9d3f-409e-b02c-e9e6010e2010 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:21.652727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb07ac-9d3f-409e-b02c-e9e6010e2010 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:21.705376 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:21.716946 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f24230-4c44-44a6-b021-21ee3cd2a935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:21.717773 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f24230-4c44-44a6-b021-21ee3cd2a935 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:21.718061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f24230-4c44-44a6-b021-21ee3cd2a935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:21.718364 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f24230-4c44-44a6-b021-21ee3cd2a935 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:21.719875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f24230-4c44-44a6-b021-21ee3cd2a935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:21.721852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f24230-4c44-44a6-b021-21ee3cd2a935 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:21.743141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1234/2499] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:10:21 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:10:21.747164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3019b-649a-41e3-b5b9-a7e7e9d9fd66 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:21.758349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3019b-649a-41e3-b5b9-a7e7e9d9fd66 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:21.762995 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2360636-b608-4e9b-b6b4-33f84599aa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:21.763649 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2360636-b608-4e9b-b6b4-33f84599aa99 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:21.763930 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2360636-b608-4e9b-b6b4-33f84599aa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:21.764206 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2360636-b608-4e9b-b6b4-33f84599aa99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:21.764952 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2360636-b608-4e9b-b6b4-33f84599aa99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:21.767336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2360636-b608-4e9b-b6b4-33f84599aa99 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:21.777843 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1266/2500] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:10:21.782217 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f24230-4c44-44a6-b021-21ee3cd2a935 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:21.793267 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f24230-4c44-44a6-b021-21ee3cd2a935 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:21.798370 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879ad68-57ab-4ef0-9711-5f0395e60d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:21.799288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879ad68-57ab-4ef0-9711-5f0395e60d10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:21.799571 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879ad68-57ab-4ef0-9711-5f0395e60d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:21.799849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879ad68-57ab-4ef0-9711-5f0395e60d10 admin admin] PATH_INFO: `/v3/projects/b99f064281da494bb78f6774e9fb7810/users/2cbea48640c84d08ad844e03c77aedf2/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:21.815473 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879ad68-57ab-4ef0-9711-5f0395e60d10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b99f064281da494bb78f6774e9fb7810, user_id=2cbea48640c84d08ad844e03c77aedf2, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:21.818195 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879ad68-57ab-4ef0-9711-5f0395e60d10 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:21.832727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1235/2501] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:10:21 2022] PUT /identity/v3/projects/b99f064281da494bb78f6774e9fb7810/users/2cbea48640c84d08ad844e03c77aedf2/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:10:21.837017 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2360636-b608-4e9b-b6b4-33f84599aa99 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:21.848783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2360636-b608-4e9b-b6b4-33f84599aa99 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:21.857214 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:21.911817 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8675703-7589-4152-8085-fbf47761ca39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:21.912967 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8675703-7589-4152-8085-fbf47761ca39 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:21.912967 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8675703-7589-4152-8085-fbf47761ca39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:21.913182 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8675703-7589-4152-8085-fbf47761ca39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:21.913923 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8675703-7589-4152-8085-fbf47761ca39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:21.915589 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8675703-7589-4152-8085-fbf47761ca39 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:21.926280 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1267/2502] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:10:21.931027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879ad68-57ab-4ef0-9711-5f0395e60d10 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:10:21.941759 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879ad68-57ab-4ef0-9711-5f0395e60d10 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:10:21.946816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03489253-0428-45c8-8251-7f9cd94bca69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:10:21.947736 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03489253-0428-45c8-8251-7f9cd94bca69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:21.948017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03489253-0428-45c8-8251-7f9cd94bca69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:21.948295 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03489253-0428-45c8-8251-7f9cd94bca69 admin admin] PATH_INFO: `/v3/projects/b99f064281da494bb78f6774e9fb7810/users/2cbea48640c84d08ad844e03c77aedf2/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:21.950331 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03489253-0428-45c8-8251-7f9cd94bca69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b99f064281da494bb78f6774e9fb7810, user_id=2cbea48640c84d08ad844e03c77aedf2, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:10:21.953073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03489253-0428-45c8-8251-7f9cd94bca69 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:10:21.963808 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1236/2503] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:10:21 2022] PUT /identity/v3/projects/b99f064281da494bb78f6774e9fb7810/users/2cbea48640c84d08ad844e03c77aedf2/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:10:21.974789 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599d392-57ad-474a-8fe5-987757d23a93 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:10:21.975082 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599d392-57ad-474a-8fe5-987757d23a93 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:10:21.975366 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599d392-57ad-474a-8fe5-987757d23a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:10:22.003402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4599d392-57ad-474a-8fe5-987757d23a93 None None] MFA Rules not processed for user `2cbea48640c84d08ad844e03c77aedf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:10:22.004625 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4599d392-57ad-474a-8fe5-987757d23a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:10:22.076410 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1268/2504] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:10:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:10:31.959991 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=20,keystone:INSERT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:32.073282 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=58 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:09.417772 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03489253-0428-45c8-8251-7f9cd94bca69 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:09.419756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-03489253-0428-45c8-8251-7f9cd94bca69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:09.492116 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03489253-0428-45c8-8251-7f9cd94bca69 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:09.496026 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f072a7-8dd3-4f38-b7d3-1d25c9f35009 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:09.496871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f072a7-8dd3-4f38-b7d3-1d25c9f35009 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:09.497155 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f072a7-8dd3-4f38-b7d3-1d25c9f35009 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:09.497427 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f072a7-8dd3-4f38-b7d3-1d25c9f35009 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:09.499637 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b9f072a7-8dd3-4f38-b7d3-1d25c9f35009 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:09.514975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application [None req-b9f072a7-8dd3-4f38-b7d3-1d25c9f35009 service cinder] Could not find project: 3216d2668dd44fd48ca8cc0edd6cce38.: keystone.exception.ProjectNotFound: Could not find project: 3216d2668dd44fd48ca8cc0edd6cce38. Jul 14 16:11:09.514975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 16:11:09.514975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 16:11:09.514975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 16:11:09.514975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 16:11:09.514975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 16:11:09.514975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 16:11:09.514975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 16:11:09.514975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 16:11:09.514975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 16:11:09.514975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 16:11:09.514975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 16:11:09.514975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jul 14 16:11:09.514975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jul 14 16:11:09.514975 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 14 16:11:09.516225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 14 16:11:09.516225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 14 16:11:09.516225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 14 16:11:09.516225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 16:11:09.516225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 16:11:09.516225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Jul 14 16:11:09.516225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Jul 14 16:11:09.516225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 16:11:09.516225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 16:11:09.516225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 16:11:09.516225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 16:11:09.516225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 16:11:09.516225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 16:11:09.516225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 16:11:09.516225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 16:11:09.516225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 16:11:09.516225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 16:11:09.517224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 16:11:09.517224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 16:11:09.517224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 16:11:09.517224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 16:11:09.517224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Jul 14 16:11:09.517224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Jul 14 16:11:09.517224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Jul 14 16:11:09.517224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self._validate_token_resources() Jul 14 16:11:09.517224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Jul 14 16:11:09.517224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Jul 14 16:11:09.517224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Jul 14 16:11:09.517224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Jul 14 16:11:09.517224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 16:11:09.517224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 16:11:09.517224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 16:11:09.517224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 16:11:09.517224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 16:11:09.518236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 16:11:09.518236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 16:11:09.518236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application with Lock( Jul 14 16:11:09.518236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 16:11:09.518236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._enter() Jul 14 16:11:09.518236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 16:11:09.518236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 16:11:09.518236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 16:11:09.518236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.creator() Jul 14 16:11:09.518236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 16:11:09.518236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application created_value = creator( Jul 14 16:11:09.518236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 16:11:09.518236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 16:11:09.518236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 16:11:09.518236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 16:11:09.518236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 16:11:09.518236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 16:11:09.519783 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3216d2668dd44fd48ca8cc0edd6cce38. Jul 14 16:11:09.519783 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: ERROR keystone.server.flask.application Jul 14 16:11:09.519783 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1237/2505] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:11:09 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 16:11:09.539200 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599d392-57ad-474a-8fe5-987757d23a93 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:09.541358 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4599d392-57ad-474a-8fe5-987757d23a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:09.622715 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599d392-57ad-474a-8fe5-987757d23a93 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:09.631633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e4251-8188-4139-a2e6-f263993d4c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:09.633443 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e4251-8188-4139-a2e6-f263993d4c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:09.633970 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e4251-8188-4139-a2e6-f263993d4c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:09.634484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e4251-8188-4139-a2e6-f263993d4c88 admin admin] PATH_INFO: `/v3/users/b12b78f4c83f4ef0b07b67a1dd87badc` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:09.636923 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e4251-8188-4139-a2e6-f263993d4c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b12b78f4c83f4ef0b07b67a1dd87badc)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:09.639011 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e4251-8188-4139-a2e6-f263993d4c88 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:09.655960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f072a7-8dd3-4f38-b7d3-1d25c9f35009 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:09.665268 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f072a7-8dd3-4f38-b7d3-1d25c9f35009 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:09.669963 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179d97c-b556-4455-899c-b9ea6648d15b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:09.670335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179d97c-b556-4455-899c-b9ea6648d15b service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:09.670691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179d97c-b556-4455-899c-b9ea6648d15b service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:09.671202 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179d97c-b556-4455-899c-b9ea6648d15b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:09.688118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179d97c-b556-4455-899c-b9ea6648d15b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:09.690379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179d97c-b556-4455-899c-b9ea6648d15b service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:09.706667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1238/2506] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:11:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:11:09.717549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b23e4251-8188-4139-a2e6-f263993d4c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b12b78f4c83f4ef0b07b67a1dd87badc'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:09.718822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b23e4251-8188-4139-a2e6-f263993d4c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b12b78f4c83f4ef0b07b67a1dd87badc'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:09.729764 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b23e4251-8188-4139-a2e6-f263993d4c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b12b78f4c83f4ef0b07b67a1dd87badc'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:09.737755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179d97c-b556-4455-899c-b9ea6648d15b service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:09.746952 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b23e4251-8188-4139-a2e6-f263993d4c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b12b78f4c83f4ef0b07b67a1dd87badc'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:09.752579 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179d97c-b556-4455-899c-b9ea6648d15b service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:09.767797 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26108cf5-0e96-402e-8b5f-e5e44fc36865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:09.768004 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26108cf5-0e96-402e-8b5f-e5e44fc36865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:09.768188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26108cf5-0e96-402e-8b5f-e5e44fc36865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:09.768469 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26108cf5-0e96-402e-8b5f-e5e44fc36865 admin admin] PATH_INFO: `/v3/users/11428571fc3a4d49af0e2623bec1fd3f` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:09.770306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26108cf5-0e96-402e-8b5f-e5e44fc36865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11428571fc3a4d49af0e2623bec1fd3f)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:09.772713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26108cf5-0e96-402e-8b5f-e5e44fc36865 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:09.800139 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b23e4251-8188-4139-a2e6-f263993d4c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b12b78f4c83f4ef0b07b67a1dd87badc'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:09.809004 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1269/2507] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:11:09 2022] DELETE /identity/v3/users/b12b78f4c83f4ef0b07b67a1dd87badc => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:11:09.810468 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e4251-8188-4139-a2e6-f263993d4c88 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:09.812052 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b23e4251-8188-4139-a2e6-f263993d4c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:09.841793 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-26108cf5-0e96-402e-8b5f-e5e44fc36865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11428571fc3a4d49af0e2623bec1fd3f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:09.850907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-26108cf5-0e96-402e-8b5f-e5e44fc36865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11428571fc3a4d49af0e2623bec1fd3f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:09.867040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-26108cf5-0e96-402e-8b5f-e5e44fc36865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11428571fc3a4d49af0e2623bec1fd3f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:09.874856 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-26108cf5-0e96-402e-8b5f-e5e44fc36865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11428571fc3a4d49af0e2623bec1fd3f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:09.875814 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-26108cf5-0e96-402e-8b5f-e5e44fc36865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11428571fc3a4d49af0e2623bec1fd3f'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:09.881371 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e4251-8188-4139-a2e6-f263993d4c88 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:09.884223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1239/2508] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:11:09 2022] DELETE /identity/v3/users/11428571fc3a4d49af0e2623bec1fd3f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:11:09.885449 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fc773-3acc-4a13-8288-976296bed93b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:09.886217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fc773-3acc-4a13-8288-976296bed93b service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:09.886509 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fc773-3acc-4a13-8288-976296bed93b service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:09.886789 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fc773-3acc-4a13-8288-976296bed93b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:09.887630 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb0004-2c11-463c-acf7-a68b568a8de1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:09.887982 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb0004-2c11-463c-acf7-a68b568a8de1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:09.888269 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb0004-2c11-463c-acf7-a68b568a8de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:09.888716 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5b3fc773-3acc-4a13-8288-976296bed93b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:09.906717 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-46fb0004-2c11-463c-acf7-a68b568a8de1 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:11:09.907963 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-46fb0004-2c11-463c-acf7-a68b568a8de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:09.931118 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:09.960338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:09.966229 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fc773-3acc-4a13-8288-976296bed93b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:09.967678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fc773-3acc-4a13-8288-976296bed93b service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:09.975205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1240/2509] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:11:09.975893 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb0004-2c11-463c-acf7-a68b568a8de1 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:09.977241 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-46fb0004-2c11-463c-acf7-a68b568a8de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:09.980574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1270/2510] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:11:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:11:09.982112 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65280a30-c834-4081-b67e-c5a1f194038f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:09.982503 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65280a30-c834-4081-b67e-c5a1f194038f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:09.982787 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65280a30-c834-4081-b67e-c5a1f194038f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:10.012149 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-65280a30-c834-4081-b67e-c5a1f194038f None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:11:10.013661 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-65280a30-c834-4081-b67e-c5a1f194038f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:10.024119 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1271/2511] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:11:10.027905 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65280a30-c834-4081-b67e-c5a1f194038f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:10.027905 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-65280a30-c834-4081-b67e-c5a1f194038f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:10.047968 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb0004-2c11-463c-acf7-a68b568a8de1 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:10.048706 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65280a30-c834-4081-b67e-c5a1f194038f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:10.053958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4b3a1-2dfd-4444-8bf3-038c8fa208c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:10.054636 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaac092-c3b9-4f1b-959e-46821eb3157e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:10.054788 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4b3a1-2dfd-4444-8bf3-038c8fa208c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:10.055007 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4b3a1-2dfd-4444-8bf3-038c8fa208c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:10.055290 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4b3a1-2dfd-4444-8bf3-038c8fa208c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:10.055465 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaac092-c3b9-4f1b-959e-46821eb3157e service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:10.055768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaac092-c3b9-4f1b-959e-46821eb3157e service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:10.056095 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaac092-c3b9-4f1b-959e-46821eb3157e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:10.057381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-dcf4b3a1-2dfd-4444-8bf3-038c8fa208c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:10.071608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaac092-c3b9-4f1b-959e-46821eb3157e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:10.073186 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaac092-c3b9-4f1b-959e-46821eb3157e service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:10.093011 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1272/2512] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:11:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:11:10.094662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaac092-c3b9-4f1b-959e-46821eb3157e service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:10.107869 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaac092-c3b9-4f1b-959e-46821eb3157e service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:10.115953 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a94089-a4d7-4ad6-9039-5e797b1c64bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:10.116974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a94089-a4d7-4ad6-9039-5e797b1c64bd service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:10.117272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a94089-a4d7-4ad6-9039-5e797b1c64bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:10.117553 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a94089-a4d7-4ad6-9039-5e797b1c64bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:10.134121 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a94089-a4d7-4ad6-9039-5e797b1c64bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:10.136932 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a94089-a4d7-4ad6-9039-5e797b1c64bd service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:10.166329 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1273/2513] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:11:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:11:10.204331 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4b3a1-2dfd-4444-8bf3-038c8fa208c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:10.205959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4b3a1-2dfd-4444-8bf3-038c8fa208c8 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:10.234574 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1241/2514] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:11:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:11:10.818276 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a94089-a4d7-4ad6-9039-5e797b1c64bd service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:10.820046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-72a94089-a4d7-4ad6-9039-5e797b1c64bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:10.834161 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a94089-a4d7-4ad6-9039-5e797b1c64bd service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:10.839960 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8886c-f343-4402-ae65-9c045e243a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:10.841342 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8886c-f343-4402-ae65-9c045e243a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:10.841703 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8886c-f343-4402-ae65-9c045e243a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:10.841906 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8886c-f343-4402-ae65-9c045e243a7b admin admin] PATH_INFO: `/v3/projects/2970819a85d44503bccaf80eef5f9426` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:10.844243 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8886c-f343-4402-ae65-9c045e243a7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2970819a85d44503bccaf80eef5f9426)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:10.852555 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8886c-f343-4402-ae65-9c045e243a7b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:10.876933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4b3a1-2dfd-4444-8bf3-038c8fa208c8 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:10.880032 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-dcf4b3a1-2dfd-4444-8bf3-038c8fa208c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:10.900438 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4b3a1-2dfd-4444-8bf3-038c8fa208c8 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:10.909848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94588cb-046b-44e6-b1a0-b0a6d81ff757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:10.910960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94588cb-046b-44e6-b1a0-b0a6d81ff757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:10.911568 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94588cb-046b-44e6-b1a0-b0a6d81ff757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:10.912662 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94588cb-046b-44e6-b1a0-b0a6d81ff757 admin admin] PATH_INFO: `/v3/projects/8fd48273cd6c496782c60bcbd3e0d28e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:10.915478 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94588cb-046b-44e6-b1a0-b0a6d81ff757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fd48273cd6c496782c60bcbd3e0d28e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:10.917416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94588cb-046b-44e6-b1a0-b0a6d81ff757 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:10.936567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7ba8886c-f343-4402-ae65-9c045e243a7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2970819a85d44503bccaf80eef5f9426', 'request_id': 'req-7ba8886c-f343-4402-ae65-9c045e243a7b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:10.949625 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7ba8886c-f343-4402-ae65-9c045e243a7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2970819a85d44503bccaf80eef5f9426', 'request_id': 'req-7ba8886c-f343-4402-ae65-9c045e243a7b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:10.963586 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7ba8886c-f343-4402-ae65-9c045e243a7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2970819a85d44503bccaf80eef5f9426', 'request_id': 'req-7ba8886c-f343-4402-ae65-9c045e243a7b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:10.976036 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7ba8886c-f343-4402-ae65-9c045e243a7b admin admin] The token cache is being invalidate because project 2970819a85d44503bccaf80eef5f9426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:11:10.976326 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7ba8886c-f343-4402-ae65-9c045e243a7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:10.977001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7ba8886c-f343-4402-ae65-9c045e243a7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:10.978998 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1274/2515] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:11:10 2022] DELETE /identity/v3/projects/2970819a85d44503bccaf80eef5f9426 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:11:10.982544 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8886c-f343-4402-ae65-9c045e243a7b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:10.982707 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a94588cb-046b-44e6-b1a0-b0a6d81ff757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd48273cd6c496782c60bcbd3e0d28e', 'request_id': 'req-a94588cb-046b-44e6-b1a0-b0a6d81ff757'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:10.983890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7ba8886c-f343-4402-ae65-9c045e243a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:10.989955 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a94588cb-046b-44e6-b1a0-b0a6d81ff757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd48273cd6c496782c60bcbd3e0d28e', 'request_id': 'req-a94588cb-046b-44e6-b1a0-b0a6d81ff757'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:10.998173 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a94588cb-046b-44e6-b1a0-b0a6d81ff757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd48273cd6c496782c60bcbd3e0d28e', 'request_id': 'req-a94588cb-046b-44e6-b1a0-b0a6d81ff757'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:11.001370 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:11.019188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a94588cb-046b-44e6-b1a0-b0a6d81ff757 admin admin] The token cache is being invalidate because project 8fd48273cd6c496782c60bcbd3e0d28e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:11:11.019724 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a94588cb-046b-44e6-b1a0-b0a6d81ff757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:11.020602 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a94588cb-046b-44e6-b1a0-b0a6d81ff757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:11.022274 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1242/2516] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:11:10 2022] DELETE /identity/v3/projects/8fd48273cd6c496782c60bcbd3e0d28e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:11:11.027127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94588cb-046b-44e6-b1a0-b0a6d81ff757 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:11.029655 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a94588cb-046b-44e6-b1a0-b0a6d81ff757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:11.071076 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8886c-f343-4402-ae65-9c045e243a7b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:11.095981 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:11.131085 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94588cb-046b-44e6-b1a0-b0a6d81ff757 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:11.137868 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2eddd-7b07-4f9b-ad3d-a4c5c21db49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:11.138117 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a031c5-b580-4540-9583-7ba2ffd97607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:11.138788 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a031c5-b580-4540-9583-7ba2ffd97607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:11.139034 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2eddd-7b07-4f9b-ad3d-a4c5c21db49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:11.139145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a031c5-b580-4540-9583-7ba2ffd97607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:11.139320 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2eddd-7b07-4f9b-ad3d-a4c5c21db49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:11.139490 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a031c5-b580-4540-9583-7ba2ffd97607 admin admin] PATH_INFO: `/v3/users/2cbea48640c84d08ad844e03c77aedf2` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:11.139592 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2eddd-7b07-4f9b-ad3d-a4c5c21db49e admin admin] PATH_INFO: `/v3/users/622ecaeb5d1a4dccb7b35eb20d7f5e5d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:11.140843 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2eddd-7b07-4f9b-ad3d-a4c5c21db49e admin admin] RBAC: Authorizing `identity:delete_user(user_id=622ecaeb5d1a4dccb7b35eb20d7f5e5d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:11.141050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a031c5-b580-4540-9583-7ba2ffd97607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cbea48640c84d08ad844e03c77aedf2)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:11.142836 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2eddd-7b07-4f9b-ad3d-a4c5c21db49e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:11.143028 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a031c5-b580-4540-9583-7ba2ffd97607 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:11.207945 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-41b2eddd-7b07-4f9b-ad3d-a4c5c21db49e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '622ecaeb5d1a4dccb7b35eb20d7f5e5d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:11.208474 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a2a031c5-b580-4540-9583-7ba2ffd97607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cbea48640c84d08ad844e03c77aedf2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:11.209241 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a2a031c5-b580-4540-9583-7ba2ffd97607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cbea48640c84d08ad844e03c77aedf2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:11.218021 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a2a031c5-b580-4540-9583-7ba2ffd97607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cbea48640c84d08ad844e03c77aedf2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:11.220150 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-41b2eddd-7b07-4f9b-ad3d-a4c5c21db49e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '622ecaeb5d1a4dccb7b35eb20d7f5e5d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:11.229459 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a2a031c5-b580-4540-9583-7ba2ffd97607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cbea48640c84d08ad844e03c77aedf2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:11.242909 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-41b2eddd-7b07-4f9b-ad3d-a4c5c21db49e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '622ecaeb5d1a4dccb7b35eb20d7f5e5d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:11.245249 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a2a031c5-b580-4540-9583-7ba2ffd97607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cbea48640c84d08ad844e03c77aedf2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:11.254816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1275/2517] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:11:10 2022] DELETE /identity/v3/users/2cbea48640c84d08ad844e03c77aedf2 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:11:11.255815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-41b2eddd-7b07-4f9b-ad3d-a4c5c21db49e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '622ecaeb5d1a4dccb7b35eb20d7f5e5d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:11.257375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-41b2eddd-7b07-4f9b-ad3d-a4c5c21db49e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '622ecaeb5d1a4dccb7b35eb20d7f5e5d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:11.269107 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1243/2518] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:11:11 2022] DELETE /identity/v3/users/622ecaeb5d1a4dccb7b35eb20d7f5e5d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:11:11.605327 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a031c5-b580-4540-9583-7ba2ffd97607 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:11.607358 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a2a031c5-b580-4540-9583-7ba2ffd97607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:11.609897 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2eddd-7b07-4f9b-ad3d-a4c5c21db49e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:11.612982 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-41b2eddd-7b07-4f9b-ad3d-a4c5c21db49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:11.769378 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a031c5-b580-4540-9583-7ba2ffd97607 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:11.783467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2eddd-7b07-4f9b-ad3d-a4c5c21db49e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:11.794615 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ce3cb-a4dc-4c27-aa9b-f97dc644889c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:11.795571 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ce3cb-a4dc-4c27-aa9b-f97dc644889c service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:11.795945 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ce3cb-a4dc-4c27-aa9b-f97dc644889c service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:11.796313 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ce3cb-a4dc-4c27-aa9b-f97dc644889c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:11.798807 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c11ce3cb-a4dc-4c27-aa9b-f97dc644889c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:11.858273 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:11.869644 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:11.874693 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd116922-5554-40ec-8853-cb713536aaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:11.875991 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd116922-5554-40ec-8853-cb713536aaef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:11.876535 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd116922-5554-40ec-8853-cb713536aaef admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:11.877250 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd116922-5554-40ec-8853-cb713536aaef admin admin] PATH_INFO: `/v3/projects/b99f064281da494bb78f6774e9fb7810` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:11.879584 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd116922-5554-40ec-8853-cb713536aaef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b99f064281da494bb78f6774e9fb7810)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:11.882134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd116922-5554-40ec-8853-cb713536aaef admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:11.944198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dd116922-5554-40ec-8853-cb713536aaef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b99f064281da494bb78f6774e9fb7810', 'request_id': 'req-dd116922-5554-40ec-8853-cb713536aaef'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:11.952340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dd116922-5554-40ec-8853-cb713536aaef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b99f064281da494bb78f6774e9fb7810', 'request_id': 'req-dd116922-5554-40ec-8853-cb713536aaef'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:11.971172 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dd116922-5554-40ec-8853-cb713536aaef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b99f064281da494bb78f6774e9fb7810', 'request_id': 'req-dd116922-5554-40ec-8853-cb713536aaef'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:11.986431 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ce3cb-a4dc-4c27-aa9b-f97dc644889c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:11.990823 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ce3cb-a4dc-4c27-aa9b-f97dc644889c service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:12.010715 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dd116922-5554-40ec-8853-cb713536aaef admin admin] The token cache is being invalidate because project b99f064281da494bb78f6774e9fb7810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:11:12.010715 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dd116922-5554-40ec-8853-cb713536aaef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:12.012421 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dd116922-5554-40ec-8853-cb713536aaef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:12.015282 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1276/2519] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:11:11 2022] DELETE /identity/v3/projects/b99f064281da494bb78f6774e9fb7810 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:11:12.020419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cfa6a-914b-4ef8-bfbd-b6732b0a373e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:12.020794 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cfa6a-914b-4ef8-bfbd-b6732b0a373e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:12.021188 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cfa6a-914b-4ef8-bfbd-b6732b0a373e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:12.022547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1244/2520] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:11:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:11:12.049493 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ef3cfa6a-914b-4ef8-bfbd-b6732b0a373e None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:11:12.050962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ef3cfa6a-914b-4ef8-bfbd-b6732b0a373e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:12.108765 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ce3cb-a4dc-4c27-aa9b-f97dc644889c service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:12.111471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c11ce3cb-a4dc-4c27-aa9b-f97dc644889c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:12.140631 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ce3cb-a4dc-4c27-aa9b-f97dc644889c service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:12.186256 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1277/2521] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:11:12.192665 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d0e31-1311-44c2-a307-ed75db1b9853 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:12.193091 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d0e31-1311-44c2-a307-ed75db1b9853 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:12.193364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d0e31-1311-44c2-a307-ed75db1b9853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:12.220657 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d47d0e31-1311-44c2-a307-ed75db1b9853 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:11:12.223556 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d47d0e31-1311-44c2-a307-ed75db1b9853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:12.235206 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1278/2522] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:11:12.240044 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d0e31-1311-44c2-a307-ed75db1b9853 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:12.251541 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d0e31-1311-44c2-a307-ed75db1b9853 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:12.261325 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def0d02-24de-4d59-8ce9-bfc25d6c77aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:12.262335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def0d02-24de-4d59-8ce9-bfc25d6c77aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:12.262696 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def0d02-24de-4d59-8ce9-bfc25d6c77aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:12.262938 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84924bd-cd6e-4d7c-8766-a62c8ffaaefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:12.263579 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def0d02-24de-4d59-8ce9-bfc25d6c77aa admin admin] PATH_INFO: `/v3/projects/73c9aba2bf5e4234adc08a2c9a09350b` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:12.263946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84924bd-cd6e-4d7c-8766-a62c8ffaaefd admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:12.264380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84924bd-cd6e-4d7c-8766-a62c8ffaaefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:12.264801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84924bd-cd6e-4d7c-8766-a62c8ffaaefd admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:12.265164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def0d02-24de-4d59-8ce9-bfc25d6c77aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=73c9aba2bf5e4234adc08a2c9a09350b)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:12.265865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84924bd-cd6e-4d7c-8766-a62c8ffaaefd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:11:12.266447 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84924bd-cd6e-4d7c-8766-a62c8ffaaefd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:12.267772 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4def0d02-24de-4d59-8ce9-bfc25d6c77aa admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:12.270772 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84924bd-cd6e-4d7c-8766-a62c8ffaaefd admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:12.286568 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1279/2523] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:11:12.291597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84924bd-cd6e-4d7c-8766-a62c8ffaaefd admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:12.305229 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84924bd-cd6e-4d7c-8766-a62c8ffaaefd admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:12.311763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ff803-c4ff-453f-9c5a-7105edc9ad69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:12.312685 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ff803-c4ff-453f-9c5a-7105edc9ad69 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:12.313123 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ff803-c4ff-453f-9c5a-7105edc9ad69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:12.313633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ff803-c4ff-453f-9c5a-7105edc9ad69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:12.314660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ff803-c4ff-453f-9c5a-7105edc9ad69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:12.317812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ff803-c4ff-453f-9c5a-7105edc9ad69 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:12.330610 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4def0d02-24de-4d59-8ce9-bfc25d6c77aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73c9aba2bf5e4234adc08a2c9a09350b', 'request_id': 'req-4def0d02-24de-4d59-8ce9-bfc25d6c77aa'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:12.340123 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4def0d02-24de-4d59-8ce9-bfc25d6c77aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73c9aba2bf5e4234adc08a2c9a09350b', 'request_id': 'req-4def0d02-24de-4d59-8ce9-bfc25d6c77aa'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:12.353213 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4def0d02-24de-4d59-8ce9-bfc25d6c77aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73c9aba2bf5e4234adc08a2c9a09350b', 'request_id': 'req-4def0d02-24de-4d59-8ce9-bfc25d6c77aa'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:12.358383 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1280/2524] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:11:12 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:11:12.364607 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ff803-c4ff-453f-9c5a-7105edc9ad69 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:12.371539 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4def0d02-24de-4d59-8ce9-bfc25d6c77aa admin admin] The token cache is being invalidate because project 73c9aba2bf5e4234adc08a2c9a09350b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:11:12.372352 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4def0d02-24de-4d59-8ce9-bfc25d6c77aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:12.373420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4def0d02-24de-4d59-8ce9-bfc25d6c77aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:12.376824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1245/2525] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:11:12 2022] DELETE /identity/v3/projects/73c9aba2bf5e4234adc08a2c9a09350b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:11:12.381533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def0d02-24de-4d59-8ce9-bfc25d6c77aa admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:12.383670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4def0d02-24de-4d59-8ce9-bfc25d6c77aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:12.433148 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:12.463404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:12.463821 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ff803-c4ff-453f-9c5a-7105edc9ad69 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:12.470182 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320ee94-1391-473b-a7a6-fa9787de2ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:12.470842 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320ee94-1391-473b-a7a6-fa9787de2ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:12.471171 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320ee94-1391-473b-a7a6-fa9787de2ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:12.472063 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320ee94-1391-473b-a7a6-fa9787de2ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:12.472781 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320ee94-1391-473b-a7a6-fa9787de2ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:12.474815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320ee94-1391-473b-a7a6-fa9787de2ff5 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:12.500868 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def0d02-24de-4d59-8ce9-bfc25d6c77aa admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:12.506131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1281/2526] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:11:12 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:11:12.509357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca73ee-60c2-4f40-a6ec-20b292ba54c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:12.510458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca73ee-60c2-4f40-a6ec-20b292ba54c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:12.510584 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320ee94-1391-473b-a7a6-fa9787de2ff5 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:12.510755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca73ee-60c2-4f40-a6ec-20b292ba54c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:12.511075 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca73ee-60c2-4f40-a6ec-20b292ba54c2 admin admin] PATH_INFO: `/v3/users/df1a8cfbc07e4976bbb04e89103a05ad` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:12.512222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3320ee94-1391-473b-a7a6-fa9787de2ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:12.513232 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca73ee-60c2-4f40-a6ec-20b292ba54c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df1a8cfbc07e4976bbb04e89103a05ad)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:12.515276 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca73ee-60c2-4f40-a6ec-20b292ba54c2 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:12.528314 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320ee94-1391-473b-a7a6-fa9787de2ff5 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:12.534541 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fa3e8-23e8-4035-b6a0-95d6e54fb4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:12.534962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fa3e8-23e8-4035-b6a0-95d6e54fb4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:12.535244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fa3e8-23e8-4035-b6a0-95d6e54fb4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:12.535505 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fa3e8-23e8-4035-b6a0-95d6e54fb4c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:12.536329 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fa3e8-23e8-4035-b6a0-95d6e54fb4c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:12.539034 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fa3e8-23e8-4035-b6a0-95d6e54fb4c2 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:12.552588 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1282/2527] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:11:12.557144 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fa3e8-23e8-4035-b6a0-95d6e54fb4c2 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:12.567729 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fa3e8-23e8-4035-b6a0-95d6e54fb4c2 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:12.572501 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d267a0-673b-4e32-80d6-c1f6f327bfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:12.573159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d267a0-673b-4e32-80d6-c1f6f327bfde admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:12.573447 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d267a0-673b-4e32-80d6-c1f6f327bfde admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:12.573576 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9dca73ee-60c2-4f40-a6ec-20b292ba54c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df1a8cfbc07e4976bbb04e89103a05ad'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:12.573750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d267a0-673b-4e32-80d6-c1f6f327bfde admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:12.574577 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d267a0-673b-4e32-80d6-c1f6f327bfde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:12.576266 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d267a0-673b-4e32-80d6-c1f6f327bfde admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:12.582944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9dca73ee-60c2-4f40-a6ec-20b292ba54c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df1a8cfbc07e4976bbb04e89103a05ad'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:12.593087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1283/2528] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:11:12.597244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d267a0-673b-4e32-80d6-c1f6f327bfde admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:12.604022 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9dca73ee-60c2-4f40-a6ec-20b292ba54c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df1a8cfbc07e4976bbb04e89103a05ad'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:12.608611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d267a0-673b-4e32-80d6-c1f6f327bfde admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:12.614458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9dca73ee-60c2-4f40-a6ec-20b292ba54c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df1a8cfbc07e4976bbb04e89103a05ad'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:12.615215 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-9dca73ee-60c2-4f40-a6ec-20b292ba54c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df1a8cfbc07e4976bbb04e89103a05ad'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:12.617429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26cc02-31dc-4c81-aca2-f194d646bb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:12.618839 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26cc02-31dc-4c81-aca2-f194d646bb0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:12.619093 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26cc02-31dc-4c81-aca2-f194d646bb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:12.619737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26cc02-31dc-4c81-aca2-f194d646bb0a admin admin] PATH_INFO: `/v3/projects/1a8fbea651d24ed1b02b677695da507c/users/cbfe64c1d6bf4adbb369b966f80f2acf/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:12.626422 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1246/2529] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:11:12 2022] DELETE /identity/v3/users/df1a8cfbc07e4976bbb04e89103a05ad => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:11:12.642976 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26cc02-31dc-4c81-aca2-f194d646bb0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8fbea651d24ed1b02b677695da507c, user_id=cbfe64c1d6bf4adbb369b966f80f2acf, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:12.646404 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a26cc02-31dc-4c81-aca2-f194d646bb0a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:12.664971 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1284/2530] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:11:12 2022] PUT /identity/v3/projects/1a8fbea651d24ed1b02b677695da507c/users/cbfe64c1d6bf4adbb369b966f80f2acf/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:11:12.678305 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81dda6-9177-4698-82a8-276da14649d3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:12.678672 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81dda6-9177-4698-82a8-276da14649d3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:12.679170 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81dda6-9177-4698-82a8-276da14649d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:12.711164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-bb81dda6-9177-4698-82a8-276da14649d3 None None] MFA Rules not processed for user `cbfe64c1d6bf4adbb369b966f80f2acf`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:11:12.712688 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bb81dda6-9177-4698-82a8-276da14649d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:12.810450 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1247/2531] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:11:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:11:12.811639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26cc02-31dc-4c81-aca2-f194d646bb0a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:12.813478 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4a26cc02-31dc-4c81-aca2-f194d646bb0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:12.891784 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26cc02-31dc-4c81-aca2-f194d646bb0a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:12.900224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168b7ab-b83c-4a74-95be-e3764d4a6906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:12.900916 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168b7ab-b83c-4a74-95be-e3764d4a6906 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:12.901197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168b7ab-b83c-4a74-95be-e3764d4a6906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:12.901652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168b7ab-b83c-4a74-95be-e3764d4a6906 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:12.902399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168b7ab-b83c-4a74-95be-e3764d4a6906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:12.904401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5168b7ab-b83c-4a74-95be-e3764d4a6906 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:12.948529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1285/2532] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:11:12 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:11:12.950087 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81dda6-9177-4698-82a8-276da14649d3 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:12.962815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168b7ab-b83c-4a74-95be-e3764d4a6906 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:12.963921 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81dda6-9177-4698-82a8-276da14649d3 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:12.965335 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5168b7ab-b83c-4a74-95be-e3764d4a6906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:13.025802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:13.038363 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41634fea-672a-48ac-b6ab-08629e45e9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:13.039660 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41634fea-672a-48ac-b6ab-08629e45e9c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:13.040458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41634fea-672a-48ac-b6ab-08629e45e9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:13.041073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41634fea-672a-48ac-b6ab-08629e45e9c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:13.043335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41634fea-672a-48ac-b6ab-08629e45e9c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:13.046516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41634fea-672a-48ac-b6ab-08629e45e9c1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:13.080855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1248/2533] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:11:12 2022] POST /identity/v3/users => generated 296 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:11:13.085375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41634fea-672a-48ac-b6ab-08629e45e9c1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:13.099963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168b7ab-b83c-4a74-95be-e3764d4a6906 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:13.103237 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41634fea-672a-48ac-b6ab-08629e45e9c1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:13.106444 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01586844-9437-454d-8a2f-3f52a3e31cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:13.107429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01586844-9437-454d-8a2f-3f52a3e31cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:13.107822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01586844-9437-454d-8a2f-3f52a3e31cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:13.108202 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01586844-9437-454d-8a2f-3f52a3e31cc7 admin admin] PATH_INFO: `/v3/projects/8d24f93c62594ca6848bf163cc486d5a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:13.109589 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01586844-9437-454d-8a2f-3f52a3e31cc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d24f93c62594ca6848bf163cc486d5a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:13.112774 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01586844-9437-454d-8a2f-3f52a3e31cc7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:13.117037 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd64ca9-435f-49a9-82d5-4042a00cddbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:13.117869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd64ca9-435f-49a9-82d5-4042a00cddbd admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:13.119094 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd64ca9-435f-49a9-82d5-4042a00cddbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:13.119604 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd64ca9-435f-49a9-82d5-4042a00cddbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:13.122946 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd64ca9-435f-49a9-82d5-4042a00cddbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:13.128496 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd64ca9-435f-49a9-82d5-4042a00cddbd admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:13.131549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:13.150705 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1249/2534] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:11:13.156078 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd64ca9-435f-49a9-82d5-4042a00cddbd admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:13.173473 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd64ca9-435f-49a9-82d5-4042a00cddbd admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:13.180383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c6107-048e-4692-8073-bb11ef9ed072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:13.181293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c6107-048e-4692-8073-bb11ef9ed072 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:13.181582 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c6107-048e-4692-8073-bb11ef9ed072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:13.181874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c6107-048e-4692-8073-bb11ef9ed072 admin admin] PATH_INFO: `/v3/projects/811b07a89a8441f6a975f90fa0c96487/users/6b069b21d94d496dafbffa3f5bbdcd06/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:13.200120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c6107-048e-4692-8073-bb11ef9ed072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=811b07a89a8441f6a975f90fa0c96487, user_id=6b069b21d94d496dafbffa3f5bbdcd06, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:13.202886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c6107-048e-4692-8073-bb11ef9ed072 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:13.207911 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-01586844-9437-454d-8a2f-3f52a3e31cc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d24f93c62594ca6848bf163cc486d5a', 'request_id': 'req-01586844-9437-454d-8a2f-3f52a3e31cc7'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:13.218646 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-01586844-9437-454d-8a2f-3f52a3e31cc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d24f93c62594ca6848bf163cc486d5a', 'request_id': 'req-01586844-9437-454d-8a2f-3f52a3e31cc7'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:13.224247 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1250/2535] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:11:13 2022] PUT /identity/v3/projects/811b07a89a8441f6a975f90fa0c96487/users/6b069b21d94d496dafbffa3f5bbdcd06/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:11:13.226037 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c6107-048e-4692-8073-bb11ef9ed072 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:13.231600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-01586844-9437-454d-8a2f-3f52a3e31cc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d24f93c62594ca6848bf163cc486d5a', 'request_id': 'req-01586844-9437-454d-8a2f-3f52a3e31cc7'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:13.257302 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-01586844-9437-454d-8a2f-3f52a3e31cc7 admin admin] The token cache is being invalidate because project 8d24f93c62594ca6848bf163cc486d5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:11:13.258022 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-01586844-9437-454d-8a2f-3f52a3e31cc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:13.259248 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-01586844-9437-454d-8a2f-3f52a3e31cc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:13.263141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1286/2536] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:11:12 2022] DELETE /identity/v3/projects/8d24f93c62594ca6848bf163cc486d5a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:11:13.272661 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d85aad-054a-468d-bed4-b186bef1ecdb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:13.273922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d85aad-054a-468d-bed4-b186bef1ecdb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:13.274449 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d85aad-054a-468d-bed4-b186bef1ecdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:13.299115 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c2d85aad-054a-468d-bed4-b186bef1ecdb None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:11:13.301648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c2d85aad-054a-468d-bed4-b186bef1ecdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:13.311074 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c6107-048e-4692-8073-bb11ef9ed072 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:13.311873 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1287/2537] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:11:13.320968 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42d1ea-bf95-41c9-b41c-4d441a705a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:13.321823 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42d1ea-bf95-41c9-b41c-4d441a705a6b admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:13.322217 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42d1ea-bf95-41c9-b41c-4d441a705a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:13.322593 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42d1ea-bf95-41c9-b41c-4d441a705a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:13.323462 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42d1ea-bf95-41c9-b41c-4d441a705a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:13.323949 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca238ab9-0356-4efc-8816-b63fe6a411d8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:13.324443 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca238ab9-0356-4efc-8816-b63fe6a411d8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:13.324807 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca238ab9-0356-4efc-8816-b63fe6a411d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:13.325630 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42d1ea-bf95-41c9-b41c-4d441a705a6b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:13.340957 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1251/2538] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:11:13.341860 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42d1ea-bf95-41c9-b41c-4d441a705a6b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:13.346942 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ba42d1ea-bf95-41c9-b41c-4d441a705a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:13.351798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ca238ab9-0356-4efc-8816-b63fe6a411d8 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:11:13.353604 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ca238ab9-0356-4efc-8816-b63fe6a411d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:13.364524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1288/2539] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:11:13.365495 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca238ab9-0356-4efc-8816-b63fe6a411d8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:13.366912 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ca238ab9-0356-4efc-8816-b63fe6a411d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:13.383947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca238ab9-0356-4efc-8816-b63fe6a411d8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:13.394745 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8db5f4-276c-4556-bfa6-35aeb202c26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:13.395760 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8db5f4-276c-4556-bfa6-35aeb202c26d admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:13.396046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8db5f4-276c-4556-bfa6-35aeb202c26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:13.396364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8db5f4-276c-4556-bfa6-35aeb202c26d admin admin] PATH_INFO: `/v3/projects/811b07a89a8441f6a975f90fa0c96487/users/6b069b21d94d496dafbffa3f5bbdcd06/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:13.400154 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8db5f4-276c-4556-bfa6-35aeb202c26d admin admin] RBAC: Authorizing `identity:create_grant(project_id=811b07a89a8441f6a975f90fa0c96487, user_id=6b069b21d94d496dafbffa3f5bbdcd06, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:13.404040 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8db5f4-276c-4556-bfa6-35aeb202c26d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:13.442550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1289/2540] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:11:13 2022] PUT /identity/v3/projects/811b07a89a8441f6a975f90fa0c96487/users/6b069b21d94d496dafbffa3f5bbdcd06/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:11:13.443782 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8db5f4-276c-4556-bfa6-35aeb202c26d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:13.468820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42d1ea-bf95-41c9-b41c-4d441a705a6b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:13.527970 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:13.539807 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8db5f4-276c-4556-bfa6-35aeb202c26d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:13.550196 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8f738-bcc6-4ea9-8145-be0678477091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:13.551307 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8f738-bcc6-4ea9-8145-be0678477091 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:13.551940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8f738-bcc6-4ea9-8145-be0678477091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:13.552053 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8f738-bcc6-4ea9-8145-be0678477091 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:13.553207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8f738-bcc6-4ea9-8145-be0678477091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:11:13.553704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8f738-bcc6-4ea9-8145-be0678477091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:13.555411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f8f738-bcc6-4ea9-8145-be0678477091 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:13.558557 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc868f-33fb-4b7e-aac0-eaea5f45dbbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:13.559224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc868f-33fb-4b7e-aac0-eaea5f45dbbd service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:13.559513 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc868f-33fb-4b7e-aac0-eaea5f45dbbd service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:13.559790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc868f-33fb-4b7e-aac0-eaea5f45dbbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:13.562114 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0acc868f-33fb-4b7e-aac0-eaea5f45dbbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:13.572227 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1290/2541] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:11:13.574426 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a3adc-5fe4-4b96-8089-a915517d4e8f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:13.574786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a3adc-5fe4-4b96-8089-a915517d4e8f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:13.575292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a3adc-5fe4-4b96-8089-a915517d4e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:13.576224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc868f-33fb-4b7e-aac0-eaea5f45dbbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:13.577833 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc868f-33fb-4b7e-aac0-eaea5f45dbbd service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:13.590521 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1252/2542] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:11:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:11:13.591504 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc868f-33fb-4b7e-aac0-eaea5f45dbbd service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:13.621799 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc868f-33fb-4b7e-aac0-eaea5f45dbbd service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:13.627768 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db635b1-08f0-4b8b-b770-a9e33ba31213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:13.629366 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db635b1-08f0-4b8b-b770-a9e33ba31213 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:13.630015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db635b1-08f0-4b8b-b770-a9e33ba31213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:13.630243 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d03a3adc-5fe4-4b96-8089-a915517d4e8f None None] MFA Rules not processed for user `6b069b21d94d496dafbffa3f5bbdcd06`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:11:13.630830 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db635b1-08f0-4b8b-b770-a9e33ba31213 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:13.632214 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d03a3adc-5fe4-4b96-8089-a915517d4e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:13.632495 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db635b1-08f0-4b8b-b770-a9e33ba31213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:13.634978 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db635b1-08f0-4b8b-b770-a9e33ba31213 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:13.677149 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1253/2543] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:11:13 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:11:13.678505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db635b1-08f0-4b8b-b770-a9e33ba31213 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:13.732812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:13.765864 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1291/2544] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:11:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:11:13.770591 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a3adc-5fe4-4b96-8089-a915517d4e8f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:13.772252 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d03a3adc-5fe4-4b96-8089-a915517d4e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:13.782729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db635b1-08f0-4b8b-b770-a9e33ba31213 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:13.789601 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc388f1-f198-45f9-83c8-76fc81e73253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:13.790539 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc388f1-f198-45f9-83c8-76fc81e73253 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:13.790830 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc388f1-f198-45f9-83c8-76fc81e73253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:13.791107 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc388f1-f198-45f9-83c8-76fc81e73253 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:13.791861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc388f1-f198-45f9-83c8-76fc81e73253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:13.794169 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc388f1-f198-45f9-83c8-76fc81e73253 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:13.828471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1254/2545] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:11:13 2022] POST /identity/v3/users => generated 283 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:11:13.843058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc388f1-f198-45f9-83c8-76fc81e73253 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:13.862617 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc388f1-f198-45f9-83c8-76fc81e73253 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:13.870046 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68139bdd-5a23-4a16-88ec-75bc06a52cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:13.870763 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68139bdd-5a23-4a16-88ec-75bc06a52cac admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:13.871049 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68139bdd-5a23-4a16-88ec-75bc06a52cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:13.871329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68139bdd-5a23-4a16-88ec-75bc06a52cac admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:13.872072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68139bdd-5a23-4a16-88ec-75bc06a52cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:13.873777 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68139bdd-5a23-4a16-88ec-75bc06a52cac admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:13.889700 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1255/2546] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:11:13.890960 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a3adc-5fe4-4b96-8089-a915517d4e8f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:13.894114 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68139bdd-5a23-4a16-88ec-75bc06a52cac admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:13.916161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68139bdd-5a23-4a16-88ec-75bc06a52cac admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:13.929966 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391b9b7-d328-45c1-a012-c2b8689a0119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:13.930813 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391b9b7-d328-45c1-a012-c2b8689a0119 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:13.931100 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391b9b7-d328-45c1-a012-c2b8689a0119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:13.931378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391b9b7-d328-45c1-a012-c2b8689a0119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:13.932108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391b9b7-d328-45c1-a012-c2b8689a0119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:13.933735 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391b9b7-d328-45c1-a012-c2b8689a0119 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:13.966615 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1256/2547] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:11:13.972153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391b9b7-d328-45c1-a012-c2b8689a0119 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:13.994333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391b9b7-d328-45c1-a012-c2b8689a0119 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:14.007110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd629425-4156-47da-9d7b-c04801bc3786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:14.008020 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd629425-4156-47da-9d7b-c04801bc3786 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:14.009948 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251a128-12be-4f7b-a1e2-998da7800264 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:14.010869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd629425-4156-47da-9d7b-c04801bc3786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:14.011145 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd629425-4156-47da-9d7b-c04801bc3786 admin admin] PATH_INFO: `/v3/projects/6d7c0e2527ef460bb4db4fba501eb3a6/users/191355b9b47742dbab25151c5f9ccdf4/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:14.012167 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251a128-12be-4f7b-a1e2-998da7800264 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:14.012461 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251a128-12be-4f7b-a1e2-998da7800264 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:14.012733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251a128-12be-4f7b-a1e2-998da7800264 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:14.049135 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd629425-4156-47da-9d7b-c04801bc3786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d7c0e2527ef460bb4db4fba501eb3a6, user_id=191355b9b47742dbab25151c5f9ccdf4, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:14.052163 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd629425-4156-47da-9d7b-c04801bc3786 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:14.097891 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1257/2548] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:11:13 2022] PUT /identity/v3/projects/6d7c0e2527ef460bb4db4fba501eb3a6/users/191355b9b47742dbab25151c5f9ccdf4/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:11:14.100005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225b6b3-cb0b-4265-a353-604fd429dfb5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:14.100377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225b6b3-cb0b-4265-a353-604fd429dfb5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:14.100664 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225b6b3-cb0b-4265-a353-604fd429dfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:14.178444 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d225b6b3-cb0b-4265-a353-604fd429dfb5 None None] MFA Rules not processed for user `191355b9b47742dbab25151c5f9ccdf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:11:14.180823 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d225b6b3-cb0b-4265-a353-604fd429dfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:14.205221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251a128-12be-4f7b-a1e2-998da7800264 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:14.208609 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251a128-12be-4f7b-a1e2-998da7800264 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:14.262246 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1292/2549] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:11:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:11:14.301729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:14.351838 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1258/2550] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:11:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:11:14.356769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251a128-12be-4f7b-a1e2-998da7800264 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:14.380387 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251a128-12be-4f7b-a1e2-998da7800264 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:14.518483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030cd8a-b39b-4acc-bff6-346f8bc54c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:14.522017 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030cd8a-b39b-4acc-bff6-346f8bc54c9e admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:14.522395 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030cd8a-b39b-4acc-bff6-346f8bc54c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:14.522690 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030cd8a-b39b-4acc-bff6-346f8bc54c9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:14.524684 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030cd8a-b39b-4acc-bff6-346f8bc54c9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:14.530570 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030cd8a-b39b-4acc-bff6-346f8bc54c9e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:14.548133 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:14.557775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225b6b3-cb0b-4265-a353-604fd429dfb5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:14.626482 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1293/2551] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:11:14 2022] POST /identity/v3/projects => generated 363 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:11:14.633480 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030cd8a-b39b-4acc-bff6-346f8bc54c9e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:14.761021 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225b6b3-cb0b-4265-a353-604fd429dfb5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:14.941419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030cd8a-b39b-4acc-bff6-346f8bc54c9e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:14.959697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71ff5d-e665-48cb-9b70-ab3be1fcc356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:14.960491 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71ff5d-e665-48cb-9b70-ab3be1fcc356 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:14.960939 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71ff5d-e665-48cb-9b70-ab3be1fcc356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:14.961272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71ff5d-e665-48cb-9b70-ab3be1fcc356 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:14.963589 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71ff5d-e665-48cb-9b70-ab3be1fcc356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:14.964209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74b03b-746d-4727-a589-efc842459eb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:14.964865 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74b03b-746d-4727-a589-efc842459eb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:14.965154 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74b03b-746d-4727-a589-efc842459eb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:14.965429 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74b03b-746d-4727-a589-efc842459eb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:14.966435 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71ff5d-e665-48cb-9b70-ab3be1fcc356 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:14.967671 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2c74b03b-746d-4727-a589-efc842459eb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:15.004005 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1294/2552] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:11:14 2022] POST /identity/v3/users => generated 288 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:11:15.009520 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71ff5d-e665-48cb-9b70-ab3be1fcc356 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:15.031058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71ff5d-e665-48cb-9b70-ab3be1fcc356 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:15.040041 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70fe31-6b94-4806-b617-6d4931259527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:15.041482 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70fe31-6b94-4806-b617-6d4931259527 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:15.042414 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70fe31-6b94-4806-b617-6d4931259527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:15.042914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70fe31-6b94-4806-b617-6d4931259527 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:15.043661 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70fe31-6b94-4806-b617-6d4931259527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:15.043815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74b03b-746d-4727-a589-efc842459eb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:15.045661 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74b03b-746d-4727-a589-efc842459eb2 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:15.050403 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70fe31-6b94-4806-b617-6d4931259527 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:15.059815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1259/2553] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:11:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:11:15.081359 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1295/2554] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:11:15.086564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74b03b-746d-4727-a589-efc842459eb2 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:15.109497 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74b03b-746d-4727-a589-efc842459eb2 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:15.116413 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde2d1d-c760-435f-8826-028e4a18202a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:15.117850 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde2d1d-c760-435f-8826-028e4a18202a admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:15.118317 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde2d1d-c760-435f-8826-028e4a18202a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:15.119023 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde2d1d-c760-435f-8826-028e4a18202a admin admin] PATH_INFO: `/v3/projects/858d54d7e40c46d5bc7934719f8a21fb/users/4aa9361742ed4a84b496db7e30e1b211/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:15.143762 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde2d1d-c760-435f-8826-028e4a18202a admin admin] RBAC: Authorizing `identity:create_grant(project_id=858d54d7e40c46d5bc7934719f8a21fb, user_id=4aa9361742ed4a84b496db7e30e1b211, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:15.146811 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde2d1d-c760-435f-8826-028e4a18202a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:15.170287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1260/2555] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:11:15 2022] PUT /identity/v3/projects/858d54d7e40c46d5bc7934719f8a21fb/users/4aa9361742ed4a84b496db7e30e1b211/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:11:15.171766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70fe31-6b94-4806-b617-6d4931259527 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:15.188700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70fe31-6b94-4806-b617-6d4931259527 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:15.390634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1277b-1bd8-4752-ac3a-927fd3e11a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:15.391334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1277b-1bd8-4752-ac3a-927fd3e11a44 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:15.391618 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1277b-1bd8-4752-ac3a-927fd3e11a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:15.392041 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1277b-1bd8-4752-ac3a-927fd3e11a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:15.392962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1277b-1bd8-4752-ac3a-927fd3e11a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:15.395791 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1277b-1bd8-4752-ac3a-927fd3e11a44 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:15.413604 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1296/2556] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:11:15.416277 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde2d1d-c760-435f-8826-028e4a18202a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:15.443933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde2d1d-c760-435f-8826-028e4a18202a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:15.467030 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d7fbe-bf6f-4340-8848-f033faab3808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:15.467970 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d7fbe-bf6f-4340-8848-f033faab3808 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:15.468257 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d7fbe-bf6f-4340-8848-f033faab3808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:15.468550 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d7fbe-bf6f-4340-8848-f033faab3808 admin admin] PATH_INFO: `/v3/projects/858d54d7e40c46d5bc7934719f8a21fb/users/4aa9361742ed4a84b496db7e30e1b211/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:15.472633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d7fbe-bf6f-4340-8848-f033faab3808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=858d54d7e40c46d5bc7934719f8a21fb, user_id=4aa9361742ed4a84b496db7e30e1b211, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:15.476022 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d7fbe-bf6f-4340-8848-f033faab3808 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:15.504339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1261/2557] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:11:15 2022] PUT /identity/v3/projects/858d54d7e40c46d5bc7934719f8a21fb/users/4aa9361742ed4a84b496db7e30e1b211/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:11:15.516458 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f0206-afb7-451d-8b5e-171f6600c70e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:15.516751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f0206-afb7-451d-8b5e-171f6600c70e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:15.517036 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f0206-afb7-451d-8b5e-171f6600c70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:15.567693 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-494f0206-afb7-451d-8b5e-171f6600c70e None None] MFA Rules not processed for user `4aa9361742ed4a84b496db7e30e1b211`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:11:15.569002 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-494f0206-afb7-451d-8b5e-171f6600c70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:15.633507 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:15.669742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1297/2558] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:11:15 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:11:15.672893 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d7fbe-bf6f-4340-8848-f033faab3808 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:15.687422 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f0206-afb7-451d-8b5e-171f6600c70e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:15.702948 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:15.784932 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f0206-afb7-451d-8b5e-171f6600c70e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:15.789169 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6465e-be2b-4c14-ac9e-25866f22f10f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:15.789847 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6465e-be2b-4c14-ac9e-25866f22f10f service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:15.790158 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6465e-be2b-4c14-ac9e-25866f22f10f service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:15.790440 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6465e-be2b-4c14-ac9e-25866f22f10f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:15.808775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d7fbe-bf6f-4340-8848-f033faab3808 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:15.811597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6465e-be2b-4c14-ac9e-25866f22f10f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:15.813490 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c6465e-be2b-4c14-ac9e-25866f22f10f service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:15.822816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1d2c4-a8b8-44fc-a16c-21a16ec5a5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:15.823658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1d2c4-a8b8-44fc-a16c-21a16ec5a5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:15.823943 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1d2c4-a8b8-44fc-a16c-21a16ec5a5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:15.824226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1d2c4-a8b8-44fc-a16c-21a16ec5a5b4 admin admin] PATH_INFO: `/v3/users/cbfe64c1d6bf4adbb369b966f80f2acf` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:15.825640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1d2c4-a8b8-44fc-a16c-21a16ec5a5b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbfe64c1d6bf4adbb369b966f80f2acf)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:15.828074 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1d2c4-a8b8-44fc-a16c-21a16ec5a5b4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:15.833523 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1298/2559] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:11:15 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:11:15.915256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-51c1d2c4-a8b8-44fc-a16c-21a16ec5a5b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbfe64c1d6bf4adbb369b966f80f2acf'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:15.923329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-51c1d2c4-a8b8-44fc-a16c-21a16ec5a5b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbfe64c1d6bf4adbb369b966f80f2acf'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:15.949034 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-51c1d2c4-a8b8-44fc-a16c-21a16ec5a5b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbfe64c1d6bf4adbb369b966f80f2acf'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:15.968516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-51c1d2c4-a8b8-44fc-a16c-21a16ec5a5b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbfe64c1d6bf4adbb369b966f80f2acf'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:15.969565 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6465e-be2b-4c14-ac9e-25866f22f10f service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:15.969764 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-51c1d2c4-a8b8-44fc-a16c-21a16ec5a5b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbfe64c1d6bf4adbb369b966f80f2acf'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:15.981845 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6465e-be2b-4c14-ac9e-25866f22f10f service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:15.982842 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1262/2560] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:11:15 2022] DELETE /identity/v3/users/cbfe64c1d6bf4adbb369b966f80f2acf => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:11:15.988949 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267a8cb-f8a9-4d64-8f82-c2c7ac536cfd None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:15.989473 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267a8cb-f8a9-4d64-8f82-c2c7ac536cfd None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:15.989772 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267a8cb-f8a9-4d64-8f82-c2c7ac536cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:16.024821 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9267a8cb-f8a9-4d64-8f82-c2c7ac536cfd None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:11:16.026136 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9267a8cb-f8a9-4d64-8f82-c2c7ac536cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:16.055500 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0b40a-59ba-4fa6-b1fb-0bd9002002fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:16.056171 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0b40a-59ba-4fa6-b1fb-0bd9002002fd service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:16.056463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0b40a-59ba-4fa6-b1fb-0bd9002002fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:16.060749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0b40a-59ba-4fa6-b1fb-0bd9002002fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:16.062934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-20c0b40a-59ba-4fa6-b1fb-0bd9002002fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:16.141626 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1263/2561] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:11:16.158724 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0b40a-59ba-4fa6-b1fb-0bd9002002fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:16.161361 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0b40a-59ba-4fa6-b1fb-0bd9002002fd service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:16.175714 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267a8cb-f8a9-4d64-8f82-c2c7ac536cfd None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:16.178453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9267a8cb-f8a9-4d64-8f82-c2c7ac536cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:16.179634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1299/2562] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:11:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:11:16.274898 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:16.327084 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267a8cb-f8a9-4d64-8f82-c2c7ac536cfd None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:16.331844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7924f-9edd-48f4-9b8a-3c59bf54e85c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:16.332880 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7924f-9edd-48f4-9b8a-3c59bf54e85c service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:16.333386 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7924f-9edd-48f4-9b8a-3c59bf54e85c service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:16.333775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7924f-9edd-48f4-9b8a-3c59bf54e85c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:16.364453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7924f-9edd-48f4-9b8a-3c59bf54e85c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:16.368351 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7924f-9edd-48f4-9b8a-3c59bf54e85c service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:16.403982 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1264/2563] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:11:17.442299 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0b40a-59ba-4fa6-b1fb-0bd9002002fd service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:17.444487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-20c0b40a-59ba-4fa6-b1fb-0bd9002002fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:17.459792 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0b40a-59ba-4fa6-b1fb-0bd9002002fd service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:17.466757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed663b4-36c2-43f0-8a99-af9be2565395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:17.467815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed663b4-36c2-43f0-8a99-af9be2565395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:17.468108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed663b4-36c2-43f0-8a99-af9be2565395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:17.468385 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed663b4-36c2-43f0-8a99-af9be2565395 admin admin] PATH_INFO: `/v3/projects/1a8fbea651d24ed1b02b677695da507c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:17.470368 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed663b4-36c2-43f0-8a99-af9be2565395 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a8fbea651d24ed1b02b677695da507c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:17.473531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed663b4-36c2-43f0-8a99-af9be2565395 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:17.531616 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:17.553596 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-aed663b4-36c2-43f0-8a99-af9be2565395 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a8fbea651d24ed1b02b677695da507c', 'request_id': 'req-aed663b4-36c2-43f0-8a99-af9be2565395'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:17.562976 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-aed663b4-36c2-43f0-8a99-af9be2565395 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a8fbea651d24ed1b02b677695da507c', 'request_id': 'req-aed663b4-36c2-43f0-8a99-af9be2565395'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:17.578248 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-aed663b4-36c2-43f0-8a99-af9be2565395 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a8fbea651d24ed1b02b677695da507c', 'request_id': 'req-aed663b4-36c2-43f0-8a99-af9be2565395'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:17.597626 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-aed663b4-36c2-43f0-8a99-af9be2565395 admin admin] The token cache is being invalidate because project 1a8fbea651d24ed1b02b677695da507c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:11:17.598325 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-aed663b4-36c2-43f0-8a99-af9be2565395 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:17.599228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-aed663b4-36c2-43f0-8a99-af9be2565395 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:17.601375 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1300/2564] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:11:17 2022] DELETE /identity/v3/projects/1a8fbea651d24ed1b02b677695da507c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:11:17.605216 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7924f-9edd-48f4-9b8a-3c59bf54e85c service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:17.626155 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7924f-9edd-48f4-9b8a-3c59bf54e85c service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:17.629919 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed663b4-36c2-43f0-8a99-af9be2565395 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:17.646188 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-aed663b4-36c2-43f0-8a99-af9be2565395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:17.714811 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332c469-6ade-4f95-a187-49b5af734a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:17.715714 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332c469-6ade-4f95-a187-49b5af734a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:17.715971 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332c469-6ade-4f95-a187-49b5af734a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:17.716268 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332c469-6ade-4f95-a187-49b5af734a5b admin admin] PATH_INFO: `/v3/users/6b069b21d94d496dafbffa3f5bbdcd06` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:17.717442 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332c469-6ade-4f95-a187-49b5af734a5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b069b21d94d496dafbffa3f5bbdcd06)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:17.719427 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332c469-6ade-4f95-a187-49b5af734a5b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:17.740280 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed663b4-36c2-43f0-8a99-af9be2565395 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:17.745161 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f228ad-639e-465f-bc81-4a18aa34e7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:17.746063 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f228ad-639e-465f-bc81-4a18aa34e7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:17.746370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f228ad-639e-465f-bc81-4a18aa34e7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:17.746648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f228ad-639e-465f-bc81-4a18aa34e7cb admin admin] PATH_INFO: `/v3/users/f63aac7e7e0a458b8469bf0fd251daab` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:17.748902 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f228ad-639e-465f-bc81-4a18aa34e7cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f63aac7e7e0a458b8469bf0fd251daab)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:17.751479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f228ad-639e-465f-bc81-4a18aa34e7cb admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:17.785972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e332c469-6ade-4f95-a187-49b5af734a5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b069b21d94d496dafbffa3f5bbdcd06'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:17.795092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e332c469-6ade-4f95-a187-49b5af734a5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b069b21d94d496dafbffa3f5bbdcd06'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:17.809662 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e332c469-6ade-4f95-a187-49b5af734a5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b069b21d94d496dafbffa3f5bbdcd06'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:17.821561 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e332c469-6ade-4f95-a187-49b5af734a5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b069b21d94d496dafbffa3f5bbdcd06'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:17.822251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e332c469-6ade-4f95-a187-49b5af734a5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b069b21d94d496dafbffa3f5bbdcd06'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:17.834507 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1265/2565] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:11:17 2022] DELETE /identity/v3/users/6b069b21d94d496dafbffa3f5bbdcd06 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:11:17.834826 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f0f228ad-639e-465f-bc81-4a18aa34e7cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f63aac7e7e0a458b8469bf0fd251daab'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:17.838884 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f0f228ad-639e-465f-bc81-4a18aa34e7cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f63aac7e7e0a458b8469bf0fd251daab'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:17.846976 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f0f228ad-639e-465f-bc81-4a18aa34e7cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f63aac7e7e0a458b8469bf0fd251daab'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:17.858061 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f0f228ad-639e-465f-bc81-4a18aa34e7cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f63aac7e7e0a458b8469bf0fd251daab'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:17.876686 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f0f228ad-639e-465f-bc81-4a18aa34e7cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f63aac7e7e0a458b8469bf0fd251daab'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:17.888330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1301/2566] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:11:17 2022] DELETE /identity/v3/users/f63aac7e7e0a458b8469bf0fd251daab => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:11:18.358713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332c469-6ade-4f95-a187-49b5af734a5b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:18.360209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e332c469-6ade-4f95-a187-49b5af734a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:18.376750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f228ad-639e-465f-bc81-4a18aa34e7cb admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:18.378984 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f0f228ad-639e-465f-bc81-4a18aa34e7cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:18.436939 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:18.463893 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f228ad-639e-465f-bc81-4a18aa34e7cb admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:18.472201 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c5d69-e4b2-4572-9481-9a3def135773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:18.474115 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c5d69-e4b2-4572-9481-9a3def135773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:18.474937 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:18.475753 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c5d69-e4b2-4572-9481-9a3def135773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:18.476203 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c5d69-e4b2-4572-9481-9a3def135773 admin admin] PATH_INFO: `/v3/projects/811b07a89a8441f6a975f90fa0c96487` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:18.477922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c5d69-e4b2-4572-9481-9a3def135773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=811b07a89a8441f6a975f90fa0c96487)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:18.480524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c5d69-e4b2-4572-9481-9a3def135773 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:18.492383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332c469-6ade-4f95-a187-49b5af734a5b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:18.497730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76155b26-41cb-48f2-9058-25a08454b830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:18.498679 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76155b26-41cb-48f2-9058-25a08454b830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:18.498965 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76155b26-41cb-48f2-9058-25a08454b830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:18.499244 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76155b26-41cb-48f2-9058-25a08454b830 admin admin] PATH_INFO: `/v3/projects/527ea619c82c44b88f135a6639191464` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:18.500494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76155b26-41cb-48f2-9058-25a08454b830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=527ea619c82c44b88f135a6639191464)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:18.503649 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76155b26-41cb-48f2-9058-25a08454b830 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:18.542940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8d1c5d69-e4b2-4572-9481-9a3def135773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '811b07a89a8441f6a975f90fa0c96487', 'request_id': 'req-8d1c5d69-e4b2-4572-9481-9a3def135773'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:18.552891 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8d1c5d69-e4b2-4572-9481-9a3def135773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '811b07a89a8441f6a975f90fa0c96487', 'request_id': 'req-8d1c5d69-e4b2-4572-9481-9a3def135773'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:18.564468 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8d1c5d69-e4b2-4572-9481-9a3def135773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '811b07a89a8441f6a975f90fa0c96487', 'request_id': 'req-8d1c5d69-e4b2-4572-9481-9a3def135773'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:18.567364 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-76155b26-41cb-48f2-9058-25a08454b830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '527ea619c82c44b88f135a6639191464', 'request_id': 'req-76155b26-41cb-48f2-9058-25a08454b830'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:18.576899 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-76155b26-41cb-48f2-9058-25a08454b830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '527ea619c82c44b88f135a6639191464', 'request_id': 'req-76155b26-41cb-48f2-9058-25a08454b830'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:18.577738 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8d1c5d69-e4b2-4572-9481-9a3def135773 admin admin] The token cache is being invalidate because project 811b07a89a8441f6a975f90fa0c96487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:11:18.578110 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8d1c5d69-e4b2-4572-9481-9a3def135773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:18.578785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8d1c5d69-e4b2-4572-9481-9a3def135773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:18.580585 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1302/2567] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:11:18 2022] DELETE /identity/v3/projects/811b07a89a8441f6a975f90fa0c96487 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:11:18.585339 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f44cfe-f7b1-4856-89c9-4f3c9b605932 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:18.585633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f44cfe-f7b1-4856-89c9-4f3c9b605932 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:18.585916 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f44cfe-f7b1-4856-89c9-4f3c9b605932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:18.586136 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-76155b26-41cb-48f2-9058-25a08454b830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '527ea619c82c44b88f135a6639191464', 'request_id': 'req-76155b26-41cb-48f2-9058-25a08454b830'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:18.605560 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-76155b26-41cb-48f2-9058-25a08454b830 admin admin] The token cache is being invalidate because project 527ea619c82c44b88f135a6639191464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:11:18.606290 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-76155b26-41cb-48f2-9058-25a08454b830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:18.606523 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-76155b26-41cb-48f2-9058-25a08454b830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:11:18.607496 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-15f44cfe-f7b1-4856-89c9-4f3c9b605932 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:11:18.608418 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1266/2568] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:11:18 2022] DELETE /identity/v3/projects/527ea619c82c44b88f135a6639191464 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:11:18.608687 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-15f44cfe-f7b1-4856-89c9-4f3c9b605932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:18.615933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4db9b9-c5c4-4bfb-bb54-708795b14d7d None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:18.616231 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4db9b9-c5c4-4bfb-bb54-708795b14d7d None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:18.616513 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4db9b9-c5c4-4bfb-bb54-708795b14d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:18.635514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-2d4db9b9-c5c4-4bfb-bb54-708795b14d7d None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:11:18.637001 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2d4db9b9-c5c4-4bfb-bb54-708795b14d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:18.708169 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1303/2569] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:11:18.716479 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57c4de-cc12-4a25-8422-a571a498402a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:18.716783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57c4de-cc12-4a25-8422-a571a498402a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:18.717070 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57c4de-cc12-4a25-8422-a571a498402a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:18.739533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-de57c4de-cc12-4a25-8422-a571a498402a None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:11:18.740786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-de57c4de-cc12-4a25-8422-a571a498402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:18.744951 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1267/2570] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:11:18.746502 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154f3b7-217a-4be4-9766-5e5e0794d297 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:18.746830 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154f3b7-217a-4be4-9766-5e5e0794d297 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:18.747106 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154f3b7-217a-4be4-9766-5e5e0794d297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:18.751930 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1304/2571] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:11:18.753364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733530a6-c30e-4c98-8bea-03f0692966f2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:18.753747 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733530a6-c30e-4c98-8bea-03f0692966f2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:18.754260 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733530a6-c30e-4c98-8bea-03f0692966f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:18.766562 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b154f3b7-217a-4be4-9766-5e5e0794d297 None None] MFA Rules not processed for user `7791b825f4274af19051fd0fd884274f`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:11:18.767790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b154f3b7-217a-4be4-9766-5e5e0794d297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:18.774668 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-733530a6-c30e-4c98-8bea-03f0692966f2 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:11:18.775894 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-733530a6-c30e-4c98-8bea-03f0692966f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:18.788401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1305/2572] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:11:18.788401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733530a6-c30e-4c98-8bea-03f0692966f2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:18.799315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733530a6-c30e-4c98-8bea-03f0692966f2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:18.804738 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700963a0-f63d-480c-a5fd-aa8809834cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:18.805388 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700963a0-f63d-480c-a5fd-aa8809834cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:18.805672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700963a0-f63d-480c-a5fd-aa8809834cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:18.805957 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700963a0-f63d-480c-a5fd-aa8809834cd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:18.806728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700963a0-f63d-480c-a5fd-aa8809834cd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:11:18.807039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700963a0-f63d-480c-a5fd-aa8809834cd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:18.808655 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700963a0-f63d-480c-a5fd-aa8809834cd5 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:18.824750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1306/2573] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:11:18.825627 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700963a0-f63d-480c-a5fd-aa8809834cd5 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:18.832566 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1268/2574] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:11:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:11:18.837399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154f3b7-217a-4be4-9766-5e5e0794d297 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:18.838225 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700963a0-f63d-480c-a5fd-aa8809834cd5 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:18.843294 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d7000-2589-47f7-a50a-478f7bcc9cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:18.844061 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d7000-2589-47f7-a50a-478f7bcc9cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:18.844420 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d7000-2589-47f7-a50a-478f7bcc9cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:18.844776 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d7000-2589-47f7-a50a-478f7bcc9cd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:18.845822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d7000-2589-47f7-a50a-478f7bcc9cd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:11:18.845994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d7000-2589-47f7-a50a-478f7bcc9cd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:18.848979 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d7000-2589-47f7-a50a-478f7bcc9cd9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:18.850628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154f3b7-217a-4be4-9766-5e5e0794d297 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:18.856476 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355dd6b-0f7a-489f-bf75-cbd1f2ccbb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:18.857640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355dd6b-0f7a-489f-bf75-cbd1f2ccbb0e admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:18.857640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355dd6b-0f7a-489f-bf75-cbd1f2ccbb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:18.857835 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355dd6b-0f7a-489f-bf75-cbd1f2ccbb0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:18.858437 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355dd6b-0f7a-489f-bf75-cbd1f2ccbb0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:18.860878 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355dd6b-0f7a-489f-bf75-cbd1f2ccbb0e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:18.868086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1307/2575] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:11:18.872127 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d7000-2589-47f7-a50a-478f7bcc9cd9 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:18.885282 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d7000-2589-47f7-a50a-478f7bcc9cd9 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:18.892412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3c90a-b39f-4da7-80d9-a1a4c25d9e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:18.892991 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3c90a-b39f-4da7-80d9-a1a4c25d9e7f admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:18.893871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3c90a-b39f-4da7-80d9-a1a4c25d9e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:18.894395 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df3c90a-b39f-4da7-80d9-a1a4c25d9e7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:18.895297 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3c90a-b39f-4da7-80d9-a1a4c25d9e7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:18.897297 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df3c90a-b39f-4da7-80d9-a1a4c25d9e7f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:18.905997 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1269/2576] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:11:18 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:11:18.911755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355dd6b-0f7a-489f-bf75-cbd1f2ccbb0e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:18.927319 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:18.930911 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1308/2577] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:11:18 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:11:18.935361 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3c90a-b39f-4da7-80d9-a1a4c25d9e7f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:18.951908 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:19.014464 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df3c90a-b39f-4da7-80d9-a1a4c25d9e7f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:19.021443 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355dd6b-0f7a-489f-bf75-cbd1f2ccbb0e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:19.022199 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613551f-601b-448f-94ea-e3bcbee6e0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:19.022863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613551f-601b-448f-94ea-e3bcbee6e0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:19.023150 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613551f-601b-448f-94ea-e3bcbee6e0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:19.023440 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613551f-601b-448f-94ea-e3bcbee6e0b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:19.024154 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613551f-601b-448f-94ea-e3bcbee6e0b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:19.026122 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613551f-601b-448f-94ea-e3bcbee6e0b0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:19.028355 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d607c4-9211-420f-b448-a92a1ba10fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:19.029042 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d607c4-9211-420f-b448-a92a1ba10fec admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:19.029332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d607c4-9211-420f-b448-a92a1ba10fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:19.029614 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d607c4-9211-420f-b448-a92a1ba10fec admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:19.030436 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d607c4-9211-420f-b448-a92a1ba10fec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:19.032742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d607c4-9211-420f-b448-a92a1ba10fec admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:19.053537 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1309/2578] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:11:18 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:11:19.057405 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613551f-601b-448f-94ea-e3bcbee6e0b0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:19.067073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1270/2579] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:11:18 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:11:19.072759 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613551f-601b-448f-94ea-e3bcbee6e0b0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:19.073439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d607c4-9211-420f-b448-a92a1ba10fec admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:19.081618 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68facba1-af5d-49e5-bdbf-6c8cb9a2b725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:19.082774 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68facba1-af5d-49e5-bdbf-6c8cb9a2b725 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:19.083069 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68facba1-af5d-49e5-bdbf-6c8cb9a2b725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:19.083349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68facba1-af5d-49e5-bdbf-6c8cb9a2b725 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:19.084101 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68facba1-af5d-49e5-bdbf-6c8cb9a2b725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:19.085735 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68facba1-af5d-49e5-bdbf-6c8cb9a2b725 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:19.088677 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d607c4-9211-420f-b448-a92a1ba10fec admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:19.096502 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778773c-4b86-44dd-99ab-1c12f937035d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:19.097610 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1310/2580] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:11:19.097964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778773c-4b86-44dd-99ab-1c12f937035d admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:19.098292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778773c-4b86-44dd-99ab-1c12f937035d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:19.098568 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778773c-4b86-44dd-99ab-1c12f937035d admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:19.099329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778773c-4b86-44dd-99ab-1c12f937035d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:19.102309 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778773c-4b86-44dd-99ab-1c12f937035d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:19.102507 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68facba1-af5d-49e5-bdbf-6c8cb9a2b725 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:19.117681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1271/2581] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:11:19.120670 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68facba1-af5d-49e5-bdbf-6c8cb9a2b725 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:19.121865 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778773c-4b86-44dd-99ab-1c12f937035d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:19.125736 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e8b04-a3b4-4b5e-a30c-9da70723ac90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:19.126445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e8b04-a3b4-4b5e-a30c-9da70723ac90 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:19.126739 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e8b04-a3b4-4b5e-a30c-9da70723ac90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:19.127272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e8b04-a3b4-4b5e-a30c-9da70723ac90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:19.128558 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e8b04-a3b4-4b5e-a30c-9da70723ac90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:19.130552 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e8b04-a3b4-4b5e-a30c-9da70723ac90 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:19.136212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778773c-4b86-44dd-99ab-1c12f937035d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:19.145376 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbd640-0f50-4a5a-9fa4-66ce4c87d345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:19.146135 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbd640-0f50-4a5a-9fa4-66ce4c87d345 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:19.146562 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbd640-0f50-4a5a-9fa4-66ce4c87d345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:19.146980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbd640-0f50-4a5a-9fa4-66ce4c87d345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:19.148379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbd640-0f50-4a5a-9fa4-66ce4c87d345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:19.150659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbd640-0f50-4a5a-9fa4-66ce4c87d345 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:19.157922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1311/2582] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 16:11:19.163944 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e8b04-a3b4-4b5e-a30c-9da70723ac90 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:19.165808 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1272/2583] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 16:11:19.170456 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbd640-0f50-4a5a-9fa4-66ce4c87d345 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:19.177692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e8b04-a3b4-4b5e-a30c-9da70723ac90 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:19.181602 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbd640-0f50-4a5a-9fa4-66ce4c87d345 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:19.182753 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf45774-27c2-4f50-a538-98ae9944c0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:19.183661 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf45774-27c2-4f50-a538-98ae9944c0d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:19.183950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf45774-27c2-4f50-a538-98ae9944c0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:19.184229 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf45774-27c2-4f50-a538-98ae9944c0d4 admin admin] PATH_INFO: `/v3/projects/69119da62f164d13b46f6611f87f84dd/users/bc8ef393f61e4a38a26de214eb602c1c/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:19.187012 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557637e-5d95-483b-86d6-623ba34a4fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:19.187981 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557637e-5d95-483b-86d6-623ba34a4fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:19.188275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557637e-5d95-483b-86d6-623ba34a4fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:19.188558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557637e-5d95-483b-86d6-623ba34a4fe3 admin admin] PATH_INFO: `/v3/projects/2be245b0bb754a81ac0ce241b2d0ce02/users/76469e66ba934aaf888f0fe1cf7d8b72/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:19.203467 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf45774-27c2-4f50-a538-98ae9944c0d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69119da62f164d13b46f6611f87f84dd, user_id=bc8ef393f61e4a38a26de214eb602c1c, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:19.207033 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf45774-27c2-4f50-a538-98ae9944c0d4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:19.210183 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557637e-5d95-483b-86d6-623ba34a4fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2be245b0bb754a81ac0ce241b2d0ce02, user_id=76469e66ba934aaf888f0fe1cf7d8b72, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:19.213181 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557637e-5d95-483b-86d6-623ba34a4fe3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:19.224627 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1312/2584] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:11:19 2022] PUT /identity/v3/projects/69119da62f164d13b46f6611f87f84dd/users/bc8ef393f61e4a38a26de214eb602c1c/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:11:19.234521 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1273/2585] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:11:19 2022] PUT /identity/v3/projects/2be245b0bb754a81ac0ce241b2d0ce02/users/76469e66ba934aaf888f0fe1cf7d8b72/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:11:19.235897 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113e2ba-918e-4f3a-a26a-b9017fba181b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:19.236218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113e2ba-918e-4f3a-a26a-b9017fba181b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:19.236471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113e2ba-918e-4f3a-a26a-b9017fba181b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:19.239681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557637e-5d95-483b-86d6-623ba34a4fe3 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:19.241391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2557637e-5d95-483b-86d6-623ba34a4fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:19.271817 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-9113e2ba-918e-4f3a-a26a-b9017fba181b None None] MFA Rules not processed for user `bc8ef393f61e4a38a26de214eb602c1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:11:19.273144 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9113e2ba-918e-4f3a-a26a-b9017fba181b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:19.313613 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557637e-5d95-483b-86d6-623ba34a4fe3 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:19.318742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1d701-c97a-455d-aa04-11455b66f342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:19.319410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1d701-c97a-455d-aa04-11455b66f342 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:19.319696 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1d701-c97a-455d-aa04-11455b66f342 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:19.319974 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1d701-c97a-455d-aa04-11455b66f342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:19.322158 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-94d1d701-c97a-455d-aa04-11455b66f342 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:19.336385 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1d701-c97a-455d-aa04-11455b66f342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:19.338391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1d701-c97a-455d-aa04-11455b66f342 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:19.348125 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1274/2586] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:11:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:11:19.349834 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe4daf-110f-443c-9f1f-a38c4c435687 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:19.350322 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe4daf-110f-443c-9f1f-a38c4c435687 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:19.350802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe4daf-110f-443c-9f1f-a38c4c435687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:19.374828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1313/2587] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:11:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:11:19.382173 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113e2ba-918e-4f3a-a26a-b9017fba181b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:19.389301 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-54fe4daf-110f-443c-9f1f-a38c4c435687 None None] MFA Rules not processed for user `76469e66ba934aaf888f0fe1cf7d8b72`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:11:19.392393 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-54fe4daf-110f-443c-9f1f-a38c4c435687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:19.448897 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:19.456442 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:19.479693 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113e2ba-918e-4f3a-a26a-b9017fba181b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:19.486938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1275/2588] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:11:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:11:19.492625 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c1614-d1c9-45e6-8f54-809411438e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:19.493325 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c1614-d1c9-45e6-8f54-809411438e92 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:19.493610 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c1614-d1c9-45e6-8f54-809411438e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:19.494038 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c1614-d1c9-45e6-8f54-809411438e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:19.494778 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c1614-d1c9-45e6-8f54-809411438e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:19.497053 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c1614-d1c9-45e6-8f54-809411438e92 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:19.505319 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe4daf-110f-443c-9f1f-a38c4c435687 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:19.508303 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-54fe4daf-110f-443c-9f1f-a38c4c435687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:19.528246 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1314/2589] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:11:19 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:11:19.532367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c1614-d1c9-45e6-8f54-809411438e92 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:19.574370 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe4daf-110f-443c-9f1f-a38c4c435687 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:19.608262 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c1614-d1c9-45e6-8f54-809411438e92 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:19.613120 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985bd37-cf64-4680-8d66-a3992f9f68bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:19.614136 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985bd37-cf64-4680-8d66-a3992f9f68bf admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:19.614136 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985bd37-cf64-4680-8d66-a3992f9f68bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:19.614536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985bd37-cf64-4680-8d66-a3992f9f68bf admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:19.615160 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985bd37-cf64-4680-8d66-a3992f9f68bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:19.617132 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985bd37-cf64-4680-8d66-a3992f9f68bf admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:19.634481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c13a5-d781-4290-a0e9-5f6dd52ed0c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:19.635148 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c13a5-d781-4290-a0e9-5f6dd52ed0c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:19.635457 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c13a5-d781-4290-a0e9-5f6dd52ed0c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:19.635810 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c13a5-d781-4290-a0e9-5f6dd52ed0c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:19.640038 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1315/2590] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:11:19 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:11:19.644594 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985bd37-cf64-4680-8d66-a3992f9f68bf admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:19.656569 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985bd37-cf64-4680-8d66-a3992f9f68bf admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:19.664671 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb1b72-43aa-4d46-8873-6e00150d6d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:19.665353 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb1b72-43aa-4d46-8873-6e00150d6d03 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:19.665643 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb1b72-43aa-4d46-8873-6e00150d6d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:19.665927 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb1b72-43aa-4d46-8873-6e00150d6d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:19.666926 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb1b72-43aa-4d46-8873-6e00150d6d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:19.669067 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb1b72-43aa-4d46-8873-6e00150d6d03 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:19.681572 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1316/2591] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:11:19.685641 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb1b72-43aa-4d46-8873-6e00150d6d03 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:19.697945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb1b72-43aa-4d46-8873-6e00150d6d03 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:19.703897 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40324757-ae9f-4ac8-b18d-fd90ac229d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:19.704789 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40324757-ae9f-4ac8-b18d-fd90ac229d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:19.705077 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40324757-ae9f-4ac8-b18d-fd90ac229d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:19.706119 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40324757-ae9f-4ac8-b18d-fd90ac229d38 admin admin] PATH_INFO: `/v3/projects/fbf8be97cd2a431c911229833970b2ce/users/d4e29bdbbc7b48c7909c569e63755bc8/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:19.719453 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c13a5-d781-4290-a0e9-5f6dd52ed0c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:19.721015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c13a5-d781-4290-a0e9-5f6dd52ed0c2 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:19.724299 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40324757-ae9f-4ac8-b18d-fd90ac229d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf8be97cd2a431c911229833970b2ce, user_id=d4e29bdbbc7b48c7909c569e63755bc8, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:19.727443 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40324757-ae9f-4ac8-b18d-fd90ac229d38 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:19.733908 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1276/2592] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:11:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:11:19.746225 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1317/2593] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:11:19 2022] PUT /identity/v3/projects/fbf8be97cd2a431c911229833970b2ce/users/d4e29bdbbc7b48c7909c569e63755bc8/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:11:19.750021 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c13a5-d781-4290-a0e9-5f6dd52ed0c2 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:19.750212 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40324757-ae9f-4ac8-b18d-fd90ac229d38 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:19.751659 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-005c13a5-d781-4290-a0e9-5f6dd52ed0c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:19.828604 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:19.839447 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40324757-ae9f-4ac8-b18d-fd90ac229d38 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:19.845603 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087d17e-83be-4a79-8271-7d8ab64d3203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:19.846452 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087d17e-83be-4a79-8271-7d8ab64d3203 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:19.846746 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087d17e-83be-4a79-8271-7d8ab64d3203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:19.847054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1087d17e-83be-4a79-8271-7d8ab64d3203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:19.847885 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087d17e-83be-4a79-8271-7d8ab64d3203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:19.848941 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c13a5-d781-4290-a0e9-5f6dd52ed0c2 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:19.849510 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1087d17e-83be-4a79-8271-7d8ab64d3203 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:19.864129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1318/2594] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:11:19.864962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087d17e-83be-4a79-8271-7d8ab64d3203 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:19.876005 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1087d17e-83be-4a79-8271-7d8ab64d3203 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:19.881536 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef805bdf-7ff1-4c6e-861c-319885576891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:19.882805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef805bdf-7ff1-4c6e-861c-319885576891 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:19.883165 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef805bdf-7ff1-4c6e-861c-319885576891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:19.883517 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef805bdf-7ff1-4c6e-861c-319885576891 admin admin] PATH_INFO: `/v3/projects/fbf8be97cd2a431c911229833970b2ce/users/d4e29bdbbc7b48c7909c569e63755bc8/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:19.885731 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef805bdf-7ff1-4c6e-861c-319885576891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf8be97cd2a431c911229833970b2ce, user_id=d4e29bdbbc7b48c7909c569e63755bc8, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:19.888424 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef805bdf-7ff1-4c6e-861c-319885576891 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:19.900845 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1319/2595] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:11:19 2022] PUT /identity/v3/projects/fbf8be97cd2a431c911229833970b2ce/users/d4e29bdbbc7b48c7909c569e63755bc8/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:11:19.912458 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5160d0-a24f-471b-bf65-209af74e55e3 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:19.912759 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5160d0-a24f-471b-bf65-209af74e55e3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:19.913038 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5160d0-a24f-471b-bf65-209af74e55e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:19.926097 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c329a-7208-43a7-ab87-c4b2d5269c1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:19.926906 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c329a-7208-43a7-ab87-c4b2d5269c1f service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:19.927404 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c329a-7208-43a7-ab87-c4b2d5269c1f service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:19.927893 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c329a-7208-43a7-ab87-c4b2d5269c1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:19.930226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2d7c329a-7208-43a7-ab87-c4b2d5269c1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:19.945605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c329a-7208-43a7-ab87-c4b2d5269c1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:19.946118 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:19.947172 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c329a-7208-43a7-ab87-c4b2d5269c1f service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:19.959715 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1277/2596] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:11:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:11:19.964759 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ce5160d0-a24f-471b-bf65-209af74e55e3 None None] MFA Rules not processed for user `d4e29bdbbc7b48c7909c569e63755bc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:11:19.967354 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ce5160d0-a24f-471b-bf65-209af74e55e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:20.091845 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1320/2597] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:11:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:11:20.239979 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c329a-7208-43a7-ab87-c4b2d5269c1f service placement] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:20.303726 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c329a-7208-43a7-ab87-c4b2d5269c1f service placement] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:20.354742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c05fc-a1f2-4d8e-9964-79639427f311 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:20.355391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c05fc-a1f2-4d8e-9964-79639427f311 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:20.355678 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c05fc-a1f2-4d8e-9964-79639427f311 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:20.355961 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c05fc-a1f2-4d8e-9964-79639427f311 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:20.367496 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c05fc-a1f2-4d8e-9964-79639427f311 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:20.368962 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c05fc-a1f2-4d8e-9964-79639427f311 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:20.380812 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1278/2598] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:11:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:11:20.485166 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5160d0-a24f-471b-bf65-209af74e55e3 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:20.498002 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5160d0-a24f-471b-bf65-209af74e55e3 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:20.502002 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60fdd0-cf9f-4aa4-b987-ef2212eb351a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:20.503575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60fdd0-cf9f-4aa4-b987-ef2212eb351a service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:20.503712 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60fdd0-cf9f-4aa4-b987-ef2212eb351a service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:20.504008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60fdd0-cf9f-4aa4-b987-ef2212eb351a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:20.570485 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60fdd0-cf9f-4aa4-b987-ef2212eb351a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:20.571944 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60fdd0-cf9f-4aa4-b987-ef2212eb351a service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:20.581332 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1321/2599] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:11:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:11:27.946122 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c05fc-a1f2-4d8e-9964-79639427f311 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:27.947742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-391c05fc-a1f2-4d8e-9964-79639427f311 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:27.998534 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:28.029914 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c05fc-a1f2-4d8e-9964-79639427f311 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:28.040035 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089253a-56cd-4d53-b74d-1a065f609c57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:28.041639 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089253a-56cd-4d53-b74d-1a065f609c57 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:28.041928 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089253a-56cd-4d53-b74d-1a065f609c57 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:28.042234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089253a-56cd-4d53-b74d-1a065f609c57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:28.044081 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b089253a-56cd-4d53-b74d-1a065f609c57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:28.057740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089253a-56cd-4d53-b74d-1a065f609c57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:28.059446 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089253a-56cd-4d53-b74d-1a065f609c57 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:28.070449 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1279/2600] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:11:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:11:30.576832 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=58 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:31.818534 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60fdd0-cf9f-4aa4-b987-ef2212eb351a service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:11:31.820951 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8c60fdd0-cf9f-4aa4-b987-ef2212eb351a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:31.844507 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60fdd0-cf9f-4aa4-b987-ef2212eb351a service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:11:31.855770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20977657-9d43-46ef-b91a-0f17a549cff0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:11:31.856430 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20977657-9d43-46ef-b91a-0f17a549cff0 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:11:31.856718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20977657-9d43-46ef-b91a-0f17a549cff0 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:11:31.857000 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20977657-9d43-46ef-b91a-0f17a549cff0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:11:31.858891 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-20977657-9d43-46ef-b91a-0f17a549cff0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:11:31.876552 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20977657-9d43-46ef-b91a-0f17a549cff0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:11:31.876886 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20977657-9d43-46ef-b91a-0f17a549cff0 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:11:31.892624 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1322/2601] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:11:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:11:38.065955 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=14 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:41.885982 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:08.335586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089253a-56cd-4d53-b74d-1a065f609c57 service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:08.345670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089253a-56cd-4d53-b74d-1a065f609c57 service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:08.349608 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630adce-fa8d-4dd3-9a8b-99c6d757043e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:08.350278 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630adce-fa8d-4dd3-9a8b-99c6d757043e service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:08.350569 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630adce-fa8d-4dd3-9a8b-99c6d757043e service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:08.350849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630adce-fa8d-4dd3-9a8b-99c6d757043e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:08.352648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b630adce-fa8d-4dd3-9a8b-99c6d757043e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:08.415925 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630adce-fa8d-4dd3-9a8b-99c6d757043e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:08.417328 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630adce-fa8d-4dd3-9a8b-99c6d757043e service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:08.427158 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1280/2602] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:12:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:12:11.795653 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20977657-9d43-46ef-b91a-0f17a549cff0 service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:12:11.864869 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20977657-9d43-46ef-b91a-0f17a549cff0 service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:12:11.869927 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec76a40-2e35-4da2-adfc-216c842d6a08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:12:11.870618 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec76a40-2e35-4da2-adfc-216c842d6a08 service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:12:11.870906 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec76a40-2e35-4da2-adfc-216c842d6a08 service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:12:11.871192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec76a40-2e35-4da2-adfc-216c842d6a08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:12:11.872980 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dec76a40-2e35-4da2-adfc-216c842d6a08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:12:11.885402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec76a40-2e35-4da2-adfc-216c842d6a08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:12:11.887031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec76a40-2e35-4da2-adfc-216c842d6a08 service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:12:11.897212 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1323/2603] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:12:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:12:18.423113 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=28 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:21.892733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=32 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:11.654710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b58b2f-b76a-4c9b-8ce9-a2fe301e0846 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:11.655803 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b58b2f-b76a-4c9b-8ce9-a2fe301e0846 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:11.656099 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b58b2f-b76a-4c9b-8ce9-a2fe301e0846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:11.686336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c1b58b2f-b76a-4c9b-8ce9-a2fe301e0846 None None] MFA Rules not processed for user `221d83c6dbb845fda216ea043b301c54`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:11.687642 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c1b58b2f-b76a-4c9b-8ce9-a2fe301e0846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:11.694885 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1281/2604] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:13:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:13:11.742101 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec76a40-2e35-4da2-adfc-216c842d6a08 service placement] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:11.744161 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dec76a40-2e35-4da2-adfc-216c842d6a08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:11.849758 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec76a40-2e35-4da2-adfc-216c842d6a08 service placement] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:11.853410 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8174bc6-a4cc-4ddf-9aa6-c58840ddca98 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14c582c1127142f8a4ebf64bb7b34516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:11.854051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8174bc6-a4cc-4ddf-9aa6-c58840ddca98 service glance] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:11.854366 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8174bc6-a4cc-4ddf-9aa6-c58840ddca98 service glance] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:11.854640 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8174bc6-a4cc-4ddf-9aa6-c58840ddca98 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:11.856432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a8174bc6-a4cc-4ddf-9aa6-c58840ddca98 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:11.869931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-a8174bc6-a4cc-4ddf-9aa6-c58840ddca98 service glance] Could not find project: afcd2ade25aa4862999924a5dcc01ea6.: keystone.exception.ProjectNotFound: Could not find project: afcd2ade25aa4862999924a5dcc01ea6. Jul 14 16:13:11.869931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 16:13:11.869931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 16:13:11.869931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 16:13:11.869931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 16:13:11.869931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 16:13:11.869931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 16:13:11.869931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 16:13:11.869931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 16:13:11.869931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 16:13:11.869931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 16:13:11.869931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 16:13:11.869931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jul 14 16:13:11.869931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jul 14 16:13:11.869931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 14 16:13:11.871274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 14 16:13:11.871274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 14 16:13:11.871274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 14 16:13:11.871274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 16:13:11.871274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 16:13:11.871274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Jul 14 16:13:11.871274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Jul 14 16:13:11.871274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 16:13:11.871274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 16:13:11.871274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 16:13:11.871274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 16:13:11.871274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 16:13:11.871274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 16:13:11.871274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 16:13:11.871274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 16:13:11.871274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 16:13:11.871274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 16:13:11.872365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 16:13:11.872365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 16:13:11.872365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 16:13:11.872365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 16:13:11.872365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Jul 14 16:13:11.872365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Jul 14 16:13:11.872365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Jul 14 16:13:11.872365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._validate_token_resources() Jul 14 16:13:11.872365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Jul 14 16:13:11.872365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Jul 14 16:13:11.872365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Jul 14 16:13:11.872365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Jul 14 16:13:11.872365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 16:13:11.872365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 16:13:11.872365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 16:13:11.872365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 16:13:11.872365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 16:13:11.873411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 16:13:11.873411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 16:13:11.873411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 14 16:13:11.873411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 16:13:11.873411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 14 16:13:11.873411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 16:13:11.873411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 16:13:11.873411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 16:13:11.873411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 14 16:13:11.873411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 16:13:11.873411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 14 16:13:11.873411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 16:13:11.873411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 16:13:11.873411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 16:13:11.873411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 16:13:11.873411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 16:13:11.873411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 16:13:11.875180 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: afcd2ade25aa4862999924a5dcc01ea6. Jul 14 16:13:11.875180 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 14 16:13:11.875180 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1324/2605] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:13:11 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 130 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 14 16:13:21.686802 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=6 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:21.861291 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=33 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:25.911600 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b58b2f-b76a-4c9b-8ce9-a2fe301e0846 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:26.010692 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b58b2f-b76a-4c9b-8ce9-a2fe301e0846 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:26.016247 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44f5dd-2b07-430b-b465-a3f313c79715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:26.017132 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44f5dd-2b07-430b-b465-a3f313c79715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:26.017416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44f5dd-2b07-430b-b465-a3f313c79715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:26.017691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44f5dd-2b07-430b-b465-a3f313c79715 admin admin] PATH_INFO: `/v3/users/76469e66ba934aaf888f0fe1cf7d8b72` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:26.018929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44f5dd-2b07-430b-b465-a3f313c79715 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76469e66ba934aaf888f0fe1cf7d8b72)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:26.020938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44f5dd-2b07-430b-b465-a3f313c79715 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:26.074807 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-fc44f5dd-2b07-430b-b465-a3f313c79715 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76469e66ba934aaf888f0fe1cf7d8b72'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:26.083637 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-fc44f5dd-2b07-430b-b465-a3f313c79715 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76469e66ba934aaf888f0fe1cf7d8b72'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:26.096599 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-fc44f5dd-2b07-430b-b465-a3f313c79715 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76469e66ba934aaf888f0fe1cf7d8b72'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:26.107076 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-fc44f5dd-2b07-430b-b465-a3f313c79715 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76469e66ba934aaf888f0fe1cf7d8b72'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:26.108490 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-fc44f5dd-2b07-430b-b465-a3f313c79715 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76469e66ba934aaf888f0fe1cf7d8b72'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:26.117018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1282/2606] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:13:25 2022] DELETE /identity/v3/users/76469e66ba934aaf888f0fe1cf7d8b72 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:13:26.121868 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b706f0c-5f9f-44b9-b994-5e1a9869aec4 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:26.122458 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b706f0c-5f9f-44b9-b994-5e1a9869aec4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:26.122556 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b706f0c-5f9f-44b9-b994-5e1a9869aec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:26.169159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7b706f0c-5f9f-44b9-b994-5e1a9869aec4 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:26.170842 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7b706f0c-5f9f-44b9-b994-5e1a9869aec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:26.232288 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1325/2607] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:13:26.243838 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44f5dd-2b07-430b-b465-a3f313c79715 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:26.245311 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-fc44f5dd-2b07-430b-b465-a3f313c79715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:26.304892 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44f5dd-2b07-430b-b465-a3f313c79715 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:26.308687 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a830a-acb7-44e8-a828-872c1ed9feb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:26.309328 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a830a-acb7-44e8-a828-872c1ed9feb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:26.309612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a830a-acb7-44e8-a828-872c1ed9feb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:26.309886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a830a-acb7-44e8-a828-872c1ed9feb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:26.320486 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a830a-acb7-44e8-a828-872c1ed9feb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:26.321962 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a830a-acb7-44e8-a828-872c1ed9feb1 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:26.333051 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1283/2608] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:13:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:13:26.631101 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b706f0c-5f9f-44b9-b994-5e1a9869aec4 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:26.632855 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7b706f0c-5f9f-44b9-b994-5e1a9869aec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:26.654934 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b706f0c-5f9f-44b9-b994-5e1a9869aec4 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:26.660814 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d5a59-b9b1-4a2c-a81b-ecb59979aec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:26.662020 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d5a59-b9b1-4a2c-a81b-ecb59979aec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:26.662340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d5a59-b9b1-4a2c-a81b-ecb59979aec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:26.662680 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d5a59-b9b1-4a2c-a81b-ecb59979aec6 admin admin] PATH_INFO: `/v3/projects/2be245b0bb754a81ac0ce241b2d0ce02` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:26.663938 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d5a59-b9b1-4a2c-a81b-ecb59979aec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2be245b0bb754a81ac0ce241b2d0ce02)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:26.665897 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d5a59-b9b1-4a2c-a81b-ecb59979aec6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:26.738382 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3b9d5a59-b9b1-4a2c-a81b-ecb59979aec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2be245b0bb754a81ac0ce241b2d0ce02', 'request_id': 'req-3b9d5a59-b9b1-4a2c-a81b-ecb59979aec6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:26.746375 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3b9d5a59-b9b1-4a2c-a81b-ecb59979aec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2be245b0bb754a81ac0ce241b2d0ce02', 'request_id': 'req-3b9d5a59-b9b1-4a2c-a81b-ecb59979aec6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:26.756651 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a830a-acb7-44e8-a828-872c1ed9feb1 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:26.758290 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b10a830a-acb7-44e8-a828-872c1ed9feb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:26.758728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3b9d5a59-b9b1-4a2c-a81b-ecb59979aec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2be245b0bb754a81ac0ce241b2d0ce02', 'request_id': 'req-3b9d5a59-b9b1-4a2c-a81b-ecb59979aec6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:26.769252 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:26.775336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3b9d5a59-b9b1-4a2c-a81b-ecb59979aec6 admin admin] The token cache is being invalidate because project 2be245b0bb754a81ac0ce241b2d0ce02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:13:26.775691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3b9d5a59-b9b1-4a2c-a81b-ecb59979aec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:26.775909 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a830a-acb7-44e8-a828-872c1ed9feb1 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:26.776431 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3b9d5a59-b9b1-4a2c-a81b-ecb59979aec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:26.778483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1326/2609] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:13:26 2022] DELETE /identity/v3/projects/2be245b0bb754a81ac0ce241b2d0ce02 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:13:26.785936 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655e458-7fe8-4e7d-8021-48a1855b5854 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:26.786866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655e458-7fe8-4e7d-8021-48a1855b5854 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:26.786866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655e458-7fe8-4e7d-8021-48a1855b5854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:26.853194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e47d75-9de5-4002-8ab8-fd5fcbb01050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:26.854309 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e47d75-9de5-4002-8ab8-fd5fcbb01050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:26.854854 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e47d75-9de5-4002-8ab8-fd5fcbb01050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:26.854854 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e47d75-9de5-4002-8ab8-fd5fcbb01050 admin admin] PATH_INFO: `/v3/users/191355b9b47742dbab25151c5f9ccdf4` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:26.856609 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e47d75-9de5-4002-8ab8-fd5fcbb01050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=191355b9b47742dbab25151c5f9ccdf4)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:26.859535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e47d75-9de5-4002-8ab8-fd5fcbb01050 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:26.863781 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-1655e458-7fe8-4e7d-8021-48a1855b5854 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:26.864993 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1655e458-7fe8-4e7d-8021-48a1855b5854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:26.876512 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1327/2610] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:13:26.884959 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4237dde-ba2e-4bc1-8f2b-117793f3df71 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:26.885651 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4237dde-ba2e-4bc1-8f2b-117793f3df71 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:26.886424 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4237dde-ba2e-4bc1-8f2b-117793f3df71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:26.907484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b4237dde-ba2e-4bc1-8f2b-117793f3df71 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:26.909265 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b4237dde-ba2e-4bc1-8f2b-117793f3df71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:26.922715 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1328/2611] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:13:26.923728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c2e47d75-9de5-4002-8ab8-fd5fcbb01050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '191355b9b47742dbab25151c5f9ccdf4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:26.924190 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4237dde-ba2e-4bc1-8f2b-117793f3df71 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:26.933787 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c2e47d75-9de5-4002-8ab8-fd5fcbb01050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '191355b9b47742dbab25151c5f9ccdf4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:26.933929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4237dde-ba2e-4bc1-8f2b-117793f3df71 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:26.940664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e26caf-e4c9-4c30-860b-9748f436e90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:26.941386 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e26caf-e4c9-4c30-860b-9748f436e90d admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:26.941679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e26caf-e4c9-4c30-860b-9748f436e90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:26.942195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e26caf-e4c9-4c30-860b-9748f436e90d admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:26.942938 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e26caf-e4c9-4c30-860b-9748f436e90d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:13:26.943593 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e26caf-e4c9-4c30-860b-9748f436e90d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:26.945003 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e26caf-e4c9-4c30-860b-9748f436e90d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:26.960932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c2e47d75-9de5-4002-8ab8-fd5fcbb01050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '191355b9b47742dbab25151c5f9ccdf4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:26.962422 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1329/2612] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:13:26.966660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e26caf-e4c9-4c30-860b-9748f436e90d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:26.974049 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c2e47d75-9de5-4002-8ab8-fd5fcbb01050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '191355b9b47742dbab25151c5f9ccdf4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:26.974835 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c2e47d75-9de5-4002-8ab8-fd5fcbb01050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '191355b9b47742dbab25151c5f9ccdf4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:26.983385 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1284/2613] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:13:26 2022] DELETE /identity/v3/users/191355b9b47742dbab25151c5f9ccdf4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:13:26.983590 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e26caf-e4c9-4c30-860b-9748f436e90d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:26.987774 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10577ea5-a67e-49e8-b378-4c07ccfa7547 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:26.988075 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10577ea5-a67e-49e8-b378-4c07ccfa7547 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:26.988385 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10577ea5-a67e-49e8-b378-4c07ccfa7547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:27.007617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:27.009795 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-10577ea5-a67e-49e8-b378-4c07ccfa7547 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:27.011130 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-10577ea5-a67e-49e8-b378-4c07ccfa7547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:27.068917 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea65289-78c7-4a4d-b6c7-8155e808bdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:27.069826 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea65289-78c7-4a4d-b6c7-8155e808bdd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:27.070218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea65289-78c7-4a4d-b6c7-8155e808bdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:27.070504 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea65289-78c7-4a4d-b6c7-8155e808bdd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:27.071820 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea65289-78c7-4a4d-b6c7-8155e808bdd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:27.074120 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea65289-78c7-4a4d-b6c7-8155e808bdd1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:27.090149 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1285/2614] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:13:27.099479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10577ea5-a67e-49e8-b378-4c07ccfa7547 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:27.101025 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-10577ea5-a67e-49e8-b378-4c07ccfa7547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:27.133128 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:27.135409 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1330/2615] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:13:26 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:13:27.139997 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea65289-78c7-4a4d-b6c7-8155e808bdd1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:27.141866 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dea65289-78c7-4a4d-b6c7-8155e808bdd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:27.172663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10577ea5-a67e-49e8-b378-4c07ccfa7547 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:27.222950 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea65289-78c7-4a4d-b6c7-8155e808bdd1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:27.228312 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00820b64-667b-4c2e-b911-9b3529f2c2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:27.228989 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00820b64-667b-4c2e-b911-9b3529f2c2da admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:27.229269 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00820b64-667b-4c2e-b911-9b3529f2c2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:27.229540 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00820b64-667b-4c2e-b911-9b3529f2c2da admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:27.229849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc58b9-a3b7-4fcf-82fd-61cf92b51aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:27.230293 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00820b64-667b-4c2e-b911-9b3529f2c2da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:27.230530 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc58b9-a3b7-4fcf-82fd-61cf92b51aca service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:27.230814 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc58b9-a3b7-4fcf-82fd-61cf92b51aca service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:27.231089 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc58b9-a3b7-4fcf-82fd-61cf92b51aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:27.232220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00820b64-667b-4c2e-b911-9b3529f2c2da admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:27.242240 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc58b9-a3b7-4fcf-82fd-61cf92b51aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:27.243691 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc58b9-a3b7-4fcf-82fd-61cf92b51aca service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:27.255579 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1286/2616] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:13:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:13:27.255792 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1331/2617] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:13:27 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:13:27.259749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc58b9-a3b7-4fcf-82fd-61cf92b51aca service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:27.270096 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc58b9-a3b7-4fcf-82fd-61cf92b51aca service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:27.275386 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa1cf2-f628-4995-8c98-5df323df6d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:27.276121 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa1cf2-f628-4995-8c98-5df323df6d1e admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:27.276461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa1cf2-f628-4995-8c98-5df323df6d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:27.276739 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa1cf2-f628-4995-8c98-5df323df6d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:27.277556 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa1cf2-f628-4995-8c98-5df323df6d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:27.279910 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa1cf2-f628-4995-8c98-5df323df6d1e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:27.291306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1287/2618] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:13:27.296261 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00820b64-667b-4c2e-b911-9b3529f2c2da admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:27.306657 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00820b64-667b-4c2e-b911-9b3529f2c2da admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:27.313078 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fa625-5fa7-47d9-b818-ad559d5dde36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:27.313815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fa625-5fa7-47d9-b818-ad559d5dde36 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:27.314141 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fa625-5fa7-47d9-b818-ad559d5dde36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:27.314422 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fa625-5fa7-47d9-b818-ad559d5dde36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:27.315157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fa625-5fa7-47d9-b818-ad559d5dde36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:27.316887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fa625-5fa7-47d9-b818-ad559d5dde36 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:27.330178 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1332/2619] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:13:27.332901 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa1cf2-f628-4995-8c98-5df323df6d1e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:27.343170 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa1cf2-f628-4995-8c98-5df323df6d1e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:27.349136 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee2bdc-f379-42ce-b3f9-314ea079043f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:27.350240 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee2bdc-f379-42ce-b3f9-314ea079043f admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:27.350568 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee2bdc-f379-42ce-b3f9-314ea079043f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:27.350848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee2bdc-f379-42ce-b3f9-314ea079043f admin admin] PATH_INFO: `/v3/projects/484ac628506b4579bb4423cdd8957688/users/8fb90913af24468cb2a63ba0afd8d7f9/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:27.369895 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee2bdc-f379-42ce-b3f9-314ea079043f admin admin] RBAC: Authorizing `identity:create_grant(project_id=484ac628506b4579bb4423cdd8957688, user_id=8fb90913af24468cb2a63ba0afd8d7f9, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:27.372608 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee2bdc-f379-42ce-b3f9-314ea079043f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:27.389544 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1288/2620] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:13:27 2022] PUT /identity/v3/projects/484ac628506b4579bb4423cdd8957688/users/8fb90913af24468cb2a63ba0afd8d7f9/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:13:27.395355 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec5185-1831-4b0d-8549-418f01a01ac7 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:27.395842 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec5185-1831-4b0d-8549-418f01a01ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:27.396244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec5185-1831-4b0d-8549-418f01a01ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:27.420319 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-0aec5185-1831-4b0d-8549-418f01a01ac7 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:27.421747 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0aec5185-1831-4b0d-8549-418f01a01ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:27.501468 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1333/2621] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:13:27.512169 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee2bdc-f379-42ce-b3f9-314ea079043f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:27.569151 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec5185-1831-4b0d-8549-418f01a01ac7 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:27.571253 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0aec5185-1831-4b0d-8549-418f01a01ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:27.588556 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec5185-1831-4b0d-8549-418f01a01ac7 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:27.594467 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6159c7-b5a5-4c54-8e52-be7573df7e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:27.595485 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6159c7-b5a5-4c54-8e52-be7573df7e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:27.595883 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6159c7-b5a5-4c54-8e52-be7573df7e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:27.596227 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6159c7-b5a5-4c54-8e52-be7573df7e59 admin admin] PATH_INFO: `/v3/projects/6d7c0e2527ef460bb4db4fba501eb3a6` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:27.597681 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6159c7-b5a5-4c54-8e52-be7573df7e59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d7c0e2527ef460bb4db4fba501eb3a6)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:27.599744 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6159c7-b5a5-4c54-8e52-be7573df7e59 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:27.601160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee2bdc-f379-42ce-b3f9-314ea079043f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:27.609810 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:27.626402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be853c79-a86f-4cbc-9f6a-4b375900f917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:27.627683 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be853c79-a86f-4cbc-9f6a-4b375900f917 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:27.627977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be853c79-a86f-4cbc-9f6a-4b375900f917 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:27.628313 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be853c79-a86f-4cbc-9f6a-4b375900f917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:27.642415 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be853c79-a86f-4cbc-9f6a-4b375900f917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:27.644107 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be853c79-a86f-4cbc-9f6a-4b375900f917 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:27.658209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1289/2622] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:13:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:13:27.680182 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5b6159c7-b5a5-4c54-8e52-be7573df7e59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d7c0e2527ef460bb4db4fba501eb3a6', 'request_id': 'req-5b6159c7-b5a5-4c54-8e52-be7573df7e59'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:27.689322 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5b6159c7-b5a5-4c54-8e52-be7573df7e59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d7c0e2527ef460bb4db4fba501eb3a6', 'request_id': 'req-5b6159c7-b5a5-4c54-8e52-be7573df7e59'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:27.701870 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5b6159c7-b5a5-4c54-8e52-be7573df7e59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d7c0e2527ef460bb4db4fba501eb3a6', 'request_id': 'req-5b6159c7-b5a5-4c54-8e52-be7573df7e59'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:27.715728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5b6159c7-b5a5-4c54-8e52-be7573df7e59 admin admin] The token cache is being invalidate because project 6d7c0e2527ef460bb4db4fba501eb3a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:13:27.716021 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5b6159c7-b5a5-4c54-8e52-be7573df7e59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:27.716813 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5b6159c7-b5a5-4c54-8e52-be7573df7e59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:27.719231 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1334/2623] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:13:27 2022] DELETE /identity/v3/projects/6d7c0e2527ef460bb4db4fba501eb3a6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:13:27.723029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be853c79-a86f-4cbc-9f6a-4b375900f917 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:27.734823 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be853c79-a86f-4cbc-9f6a-4b375900f917 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:27.787935 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:27.800617 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7059aeb-477f-4dd8-abbb-c194329f1ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:27.801508 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7059aeb-477f-4dd8-abbb-c194329f1ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:27.801795 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7059aeb-477f-4dd8-abbb-c194329f1ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:27.802648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7059aeb-477f-4dd8-abbb-c194329f1ebb admin admin] PATH_INFO: `/v3/users/4aa9361742ed4a84b496db7e30e1b211` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:27.803422 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7059aeb-477f-4dd8-abbb-c194329f1ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aa9361742ed4a84b496db7e30e1b211)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:27.807456 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7059aeb-477f-4dd8-abbb-c194329f1ebb admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:27.877052 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e7059aeb-477f-4dd8-abbb-c194329f1ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aa9361742ed4a84b496db7e30e1b211'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:27.885438 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e7059aeb-477f-4dd8-abbb-c194329f1ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aa9361742ed4a84b496db7e30e1b211'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:27.902869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e7059aeb-477f-4dd8-abbb-c194329f1ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aa9361742ed4a84b496db7e30e1b211'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:27.913999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e7059aeb-477f-4dd8-abbb-c194329f1ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aa9361742ed4a84b496db7e30e1b211'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:27.914906 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-e7059aeb-477f-4dd8-abbb-c194329f1ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aa9361742ed4a84b496db7e30e1b211'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:27.923759 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1290/2624] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:13:27 2022] DELETE /identity/v3/users/4aa9361742ed4a84b496db7e30e1b211 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:13:28.372563 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6159c7-b5a5-4c54-8e52-be7573df7e59 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:28.375988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5b6159c7-b5a5-4c54-8e52-be7573df7e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:28.400606 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6159c7-b5a5-4c54-8e52-be7573df7e59 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:28.461130 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7059aeb-477f-4dd8-abbb-c194329f1ebb admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:28.464296 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e7059aeb-477f-4dd8-abbb-c194329f1ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:28.515601 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48379c2d-0f88-412b-95de-3a6bb60beabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:28.516595 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48379c2d-0f88-412b-95de-3a6bb60beabb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:28.516883 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48379c2d-0f88-412b-95de-3a6bb60beabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:28.517220 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48379c2d-0f88-412b-95de-3a6bb60beabb admin admin] PATH_INFO: `/v3/projects/858d54d7e40c46d5bc7934719f8a21fb` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:28.518719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48379c2d-0f88-412b-95de-3a6bb60beabb admin admin] RBAC: Authorizing `identity:delete_project(project_id=858d54d7e40c46d5bc7934719f8a21fb)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:28.521199 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48379c2d-0f88-412b-95de-3a6bb60beabb admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:28.600461 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7059aeb-477f-4dd8-abbb-c194329f1ebb admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:28.611568 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-48379c2d-0f88-412b-95de-3a6bb60beabb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '858d54d7e40c46d5bc7934719f8a21fb', 'request_id': 'req-48379c2d-0f88-412b-95de-3a6bb60beabb'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:28.622751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-48379c2d-0f88-412b-95de-3a6bb60beabb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '858d54d7e40c46d5bc7934719f8a21fb', 'request_id': 'req-48379c2d-0f88-412b-95de-3a6bb60beabb'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:28.636597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-48379c2d-0f88-412b-95de-3a6bb60beabb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '858d54d7e40c46d5bc7934719f8a21fb', 'request_id': 'req-48379c2d-0f88-412b-95de-3a6bb60beabb'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:28.667306 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-48379c2d-0f88-412b-95de-3a6bb60beabb admin admin] The token cache is being invalidate because project 858d54d7e40c46d5bc7934719f8a21fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:13:28.667607 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-48379c2d-0f88-412b-95de-3a6bb60beabb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:28.668279 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-48379c2d-0f88-412b-95de-3a6bb60beabb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:28.671468 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1335/2625] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:13:28 2022] DELETE /identity/v3/projects/858d54d7e40c46d5bc7934719f8a21fb => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:13:28.676751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718e908-67de-4408-84fd-7ac6be6e2fb3 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:28.677045 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718e908-67de-4408-84fd-7ac6be6e2fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:28.677330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718e908-67de-4408-84fd-7ac6be6e2fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:28.704247 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4718e908-67de-4408-84fd-7ac6be6e2fb3 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:28.705928 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4718e908-67de-4408-84fd-7ac6be6e2fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:28.707500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c35d3f-f5ea-4cd4-bbfa-a181670482fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:28.709092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c35d3f-f5ea-4cd4-bbfa-a181670482fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:28.709375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c35d3f-f5ea-4cd4-bbfa-a181670482fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:28.709663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c35d3f-f5ea-4cd4-bbfa-a181670482fc admin admin] PATH_INFO: `/v3/users/bc8ef393f61e4a38a26de214eb602c1c` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:28.712237 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c35d3f-f5ea-4cd4-bbfa-a181670482fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc8ef393f61e4a38a26de214eb602c1c)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:28.715633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c35d3f-f5ea-4cd4-bbfa-a181670482fc admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:28.722204 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1336/2626] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:13:28.728207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbbc26-4613-4afb-b3e1-06be7c84cdbc None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:28.728679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbbc26-4613-4afb-b3e1-06be7c84cdbc None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:28.728973 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbbc26-4613-4afb-b3e1-06be7c84cdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:28.742182 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:28.759850 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d4bbbc26-4613-4afb-b3e1-06be7c84cdbc None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:28.760952 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d4bbbc26-4613-4afb-b3e1-06be7c84cdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:28.775214 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1337/2627] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:13:28.778762 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbbc26-4613-4afb-b3e1-06be7c84cdbc None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:28.794344 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c2c35d3f-f5ea-4cd4-bbfa-a181670482fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc8ef393f61e4a38a26de214eb602c1c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:28.796821 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbbc26-4613-4afb-b3e1-06be7c84cdbc None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:28.804755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c2c35d3f-f5ea-4cd4-bbfa-a181670482fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc8ef393f61e4a38a26de214eb602c1c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:28.808463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67413af-9fdc-44d4-86f5-2748d815513b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:28.809370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67413af-9fdc-44d4-86f5-2748d815513b admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:28.809583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67413af-9fdc-44d4-86f5-2748d815513b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:28.810261 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67413af-9fdc-44d4-86f5-2748d815513b admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:28.813525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67413af-9fdc-44d4-86f5-2748d815513b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:13:28.813874 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67413af-9fdc-44d4-86f5-2748d815513b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:28.815580 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67413af-9fdc-44d4-86f5-2748d815513b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:28.825032 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:28.837874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c2c35d3f-f5ea-4cd4-bbfa-a181670482fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc8ef393f61e4a38a26de214eb602c1c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:28.839940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1338/2628] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 16:13:28.845173 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67413af-9fdc-44d4-86f5-2748d815513b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:28.853995 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c2c35d3f-f5ea-4cd4-bbfa-a181670482fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc8ef393f61e4a38a26de214eb602c1c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:28.855005 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c2c35d3f-f5ea-4cd4-bbfa-a181670482fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc8ef393f61e4a38a26de214eb602c1c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:28.861942 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67413af-9fdc-44d4-86f5-2748d815513b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:28.862510 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1291/2629] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:13:28 2022] DELETE /identity/v3/users/bc8ef393f61e4a38a26de214eb602c1c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:13:28.866591 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a78dc-ec5d-4463-9d6e-9c1fd51a4ded None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:28.866895 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a78dc-ec5d-4463-9d6e-9c1fd51a4ded None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:28.867164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a78dc-ec5d-4463-9d6e-9c1fd51a4ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:28.893531 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-567a78dc-ec5d-4463-9d6e-9c1fd51a4ded None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:28.895121 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-567a78dc-ec5d-4463-9d6e-9c1fd51a4ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:28.954051 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832a3c6-7b70-488e-afaf-fa6a014923cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:28.955208 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832a3c6-7b70-488e-afaf-fa6a014923cf admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:28.955741 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832a3c6-7b70-488e-afaf-fa6a014923cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:28.956308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832a3c6-7b70-488e-afaf-fa6a014923cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:28.957513 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832a3c6-7b70-488e-afaf-fa6a014923cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:28.959901 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832a3c6-7b70-488e-afaf-fa6a014923cf admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:28.978019 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1292/2630] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:13:28.991107 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a78dc-ec5d-4463-9d6e-9c1fd51a4ded None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:28.993062 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-567a78dc-ec5d-4463-9d6e-9c1fd51a4ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:29.008723 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1339/2631] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:13:28 2022] POST /identity/v3/projects => generated 381 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:13:29.010019 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832a3c6-7b70-488e-afaf-fa6a014923cf admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:29.012827 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6832a3c6-7b70-488e-afaf-fa6a014923cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:29.073321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a78dc-ec5d-4463-9d6e-9c1fd51a4ded None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:29.106778 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832a3c6-7b70-488e-afaf-fa6a014923cf admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:29.115840 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd9f69-299e-4571-ba40-d61add18cc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:29.117916 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd9f69-299e-4571-ba40-d61add18cc59 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:29.118360 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd9f69-299e-4571-ba40-d61add18cc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:29.118750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd9f69-299e-4571-ba40-d61add18cc59 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:29.121383 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd9f69-299e-4571-ba40-d61add18cc59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:29.126015 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd9f69-299e-4571-ba40-d61add18cc59 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:29.135137 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55f477-f24c-47e4-a3d9-584cb05634d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:29.136372 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55f477-f24c-47e4-a3d9-584cb05634d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:29.136661 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55f477-f24c-47e4-a3d9-584cb05634d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:29.136943 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55f477-f24c-47e4-a3d9-584cb05634d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:29.147974 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:29.152312 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55f477-f24c-47e4-a3d9-584cb05634d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:29.154017 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55f477-f24c-47e4-a3d9-584cb05634d2 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:29.167552 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1340/2632] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:13:29 2022] POST /identity/v3/users => generated 291 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:13:29.168292 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1293/2633] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:13:29.173927 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd9f69-299e-4571-ba40-d61add18cc59 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:29.187720 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd9f69-299e-4571-ba40-d61add18cc59 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:29.193016 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed39178-071c-4d81-b21a-f755a6f35022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:29.193770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed39178-071c-4d81-b21a-f755a6f35022 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:29.194084 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed39178-071c-4d81-b21a-f755a6f35022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:29.194382 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed39178-071c-4d81-b21a-f755a6f35022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:29.195401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed39178-071c-4d81-b21a-f755a6f35022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:29.197180 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed39178-071c-4d81-b21a-f755a6f35022 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:29.210050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1341/2634] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:13:29.213923 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55f477-f24c-47e4-a3d9-584cb05634d2 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:29.224533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55f477-f24c-47e4-a3d9-584cb05634d2 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:29.233574 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c03006-4f1b-4546-8406-5bea5af5a312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:29.235744 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c03006-4f1b-4546-8406-5bea5af5a312 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:29.236281 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c03006-4f1b-4546-8406-5bea5af5a312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:29.236856 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c03006-4f1b-4546-8406-5bea5af5a312 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:29.238027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c03006-4f1b-4546-8406-5bea5af5a312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:29.240125 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c03006-4f1b-4546-8406-5bea5af5a312 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:29.255163 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1294/2635] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:13:29.259439 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed39178-071c-4d81-b21a-f755a6f35022 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:29.276193 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed39178-071c-4d81-b21a-f755a6f35022 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:29.285235 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697cdd0-6e74-475a-baab-da35536fe99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:29.287608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697cdd0-6e74-475a-baab-da35536fe99a admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:29.287608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697cdd0-6e74-475a-baab-da35536fe99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:29.287608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697cdd0-6e74-475a-baab-da35536fe99a admin admin] PATH_INFO: `/v3/projects/469bc5ceaf204eb4829b5687a398294a/users/d3913ddcade540f9936600b564f8ffd5/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:29.309751 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697cdd0-6e74-475a-baab-da35536fe99a admin admin] RBAC: Authorizing `identity:create_grant(project_id=469bc5ceaf204eb4829b5687a398294a, user_id=d3913ddcade540f9936600b564f8ffd5, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:29.316670 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697cdd0-6e74-475a-baab-da35536fe99a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:29.350315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1342/2636] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:13:29 2022] PUT /identity/v3/projects/469bc5ceaf204eb4829b5687a398294a/users/d3913ddcade540f9936600b564f8ffd5/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:13:29.362242 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0265a0-fbfc-4779-894b-cd9c9d33a6c9 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:29.363252 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0265a0-fbfc-4779-894b-cd9c9d33a6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:29.364299 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0265a0-fbfc-4779-894b-cd9c9d33a6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:29.422454 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-0e0265a0-fbfc-4779-894b-cd9c9d33a6c9 None None] MFA Rules not processed for user `d3913ddcade540f9936600b564f8ffd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:29.429191 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0e0265a0-fbfc-4779-894b-cd9c9d33a6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:29.543331 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1295/2637] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:13:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:13:29.548846 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697cdd0-6e74-475a-baab-da35536fe99a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:29.567434 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0265a0-fbfc-4779-894b-cd9c9d33a6c9 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:29.572034 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0e0265a0-fbfc-4779-894b-cd9c9d33a6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:29.647004 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:29.684353 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697cdd0-6e74-475a-baab-da35536fe99a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:29.702408 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e69c3-cff8-4a34-8bce-96094deb14e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:29.703110 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e69c3-cff8-4a34-8bce-96094deb14e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:29.703408 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e69c3-cff8-4a34-8bce-96094deb14e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:29.703691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e69c3-cff8-4a34-8bce-96094deb14e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:29.704531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e69c3-cff8-4a34-8bce-96094deb14e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:29.704661 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0265a0-fbfc-4779-894b-cd9c9d33a6c9 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:29.709752 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e69c3-cff8-4a34-8bce-96094deb14e6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:29.720798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec3dd2-083e-42ba-b71e-fb75e9cb91ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:29.720798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec3dd2-083e-42ba-b71e-fb75e9cb91ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:29.720798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec3dd2-083e-42ba-b71e-fb75e9cb91ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:29.720798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec3dd2-083e-42ba-b71e-fb75e9cb91ed admin admin] PATH_INFO: `/v3/projects/69119da62f164d13b46f6611f87f84dd` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:29.721254 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec3dd2-083e-42ba-b71e-fb75e9cb91ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=69119da62f164d13b46f6611f87f84dd)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:29.721254 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec3dd2-083e-42ba-b71e-fb75e9cb91ed admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:29.758909 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1343/2638] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:13:29 2022] POST /identity/v3/projects => generated 381 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:13:29.762971 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e69c3-cff8-4a34-8bce-96094deb14e6 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:29.793959 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-66ec3dd2-083e-42ba-b71e-fb75e9cb91ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69119da62f164d13b46f6611f87f84dd', 'request_id': 'req-66ec3dd2-083e-42ba-b71e-fb75e9cb91ed'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:29.804992 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-66ec3dd2-083e-42ba-b71e-fb75e9cb91ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69119da62f164d13b46f6611f87f84dd', 'request_id': 'req-66ec3dd2-083e-42ba-b71e-fb75e9cb91ed'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:29.814918 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-66ec3dd2-083e-42ba-b71e-fb75e9cb91ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69119da62f164d13b46f6611f87f84dd', 'request_id': 'req-66ec3dd2-083e-42ba-b71e-fb75e9cb91ed'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:29.838913 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-66ec3dd2-083e-42ba-b71e-fb75e9cb91ed admin admin] The token cache is being invalidate because project 69119da62f164d13b46f6611f87f84dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:13:29.839321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-66ec3dd2-083e-42ba-b71e-fb75e9cb91ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:29.840122 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-66ec3dd2-083e-42ba-b71e-fb75e9cb91ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:29.843495 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1296/2639] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:13:29 2022] DELETE /identity/v3/projects/69119da62f164d13b46f6611f87f84dd => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:13:29.847556 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec3dd2-083e-42ba-b71e-fb75e9cb91ed admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:29.849295 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-66ec3dd2-083e-42ba-b71e-fb75e9cb91ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:29.859608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e69c3-cff8-4a34-8bce-96094deb14e6 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:29.862723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:29.963243 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9aa48-2763-4a61-98f1-9b2255b9bf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:29.964167 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9aa48-2763-4a61-98f1-9b2255b9bf84 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:29.964524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9aa48-2763-4a61-98f1-9b2255b9bf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:29.965108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9aa48-2763-4a61-98f1-9b2255b9bf84 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:29.965672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9aa48-2763-4a61-98f1-9b2255b9bf84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:29.968203 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9aa48-2763-4a61-98f1-9b2255b9bf84 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:29.988976 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec3dd2-083e-42ba-b71e-fb75e9cb91ed admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:30.004924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20ab90-463b-4c6b-bcd2-d51b9e5f431e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:30.009181 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1344/2640] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:13:29 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:13:30.009354 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20ab90-463b-4c6b-bcd2-d51b9e5f431e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:30.009354 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20ab90-463b-4c6b-bcd2-d51b9e5f431e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:30.009354 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20ab90-463b-4c6b-bcd2-d51b9e5f431e admin admin] PATH_INFO: `/v3/users/d4e29bdbbc7b48c7909c569e63755bc8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:30.010452 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20ab90-463b-4c6b-bcd2-d51b9e5f431e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4e29bdbbc7b48c7909c569e63755bc8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:30.011643 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9aa48-2763-4a61-98f1-9b2255b9bf84 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:30.013931 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-73d9aa48-2763-4a61-98f1-9b2255b9bf84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:30.016902 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20ab90-463b-4c6b-bcd2-d51b9e5f431e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:30.032842 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9aa48-2763-4a61-98f1-9b2255b9bf84 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:30.038666 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e02e8a-ba64-4b4c-86cf-469e5a830da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:30.039351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e02e8a-ba64-4b4c-86cf-469e5a830da0 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:30.039635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e02e8a-ba64-4b4c-86cf-469e5a830da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:30.039911 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e02e8a-ba64-4b4c-86cf-469e5a830da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:30.040656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e02e8a-ba64-4b4c-86cf-469e5a830da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:30.042374 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e02e8a-ba64-4b4c-86cf-469e5a830da0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:30.063920 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1345/2641] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:13:30.065148 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e02e8a-ba64-4b4c-86cf-469e5a830da0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:30.081237 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e02e8a-ba64-4b4c-86cf-469e5a830da0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:30.087483 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097762ba-7a28-44e4-84f1-abd40f681217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:30.088564 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097762ba-7a28-44e4-84f1-abd40f681217 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:30.088926 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097762ba-7a28-44e4-84f1-abd40f681217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:30.089218 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097762ba-7a28-44e4-84f1-abd40f681217 admin admin] PATH_INFO: `/v3/projects/0229f6af75914601a357b93790b7a96b/users/721f23a108844c6998836a7271942c46/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:30.113392 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bc20ab90-463b-4c6b-bcd2-d51b9e5f431e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4e29bdbbc7b48c7909c569e63755bc8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:30.114267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097762ba-7a28-44e4-84f1-abd40f681217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0229f6af75914601a357b93790b7a96b, user_id=721f23a108844c6998836a7271942c46, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:30.120266 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097762ba-7a28-44e4-84f1-abd40f681217 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:30.125954 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bc20ab90-463b-4c6b-bcd2-d51b9e5f431e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4e29bdbbc7b48c7909c569e63755bc8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:30.139894 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1346/2642] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:13:30 2022] PUT /identity/v3/projects/0229f6af75914601a357b93790b7a96b/users/721f23a108844c6998836a7271942c46/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:13:30.144099 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097762ba-7a28-44e4-84f1-abd40f681217 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:30.156232 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bc20ab90-463b-4c6b-bcd2-d51b9e5f431e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4e29bdbbc7b48c7909c569e63755bc8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:30.168092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bc20ab90-463b-4c6b-bcd2-d51b9e5f431e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4e29bdbbc7b48c7909c569e63755bc8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:30.169535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-bc20ab90-463b-4c6b-bcd2-d51b9e5f431e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4e29bdbbc7b48c7909c569e63755bc8'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:30.182216 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1297/2643] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:13:29 2022] DELETE /identity/v3/users/d4e29bdbbc7b48c7909c569e63755bc8 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:13:30.195138 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:30.263397 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097762ba-7a28-44e4-84f1-abd40f681217 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:30.350550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd414e-11e2-406f-82c1-5bb957271a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:30.351244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd414e-11e2-406f-82c1-5bb957271a3c admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:30.351530 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd414e-11e2-406f-82c1-5bb957271a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:30.351810 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd414e-11e2-406f-82c1-5bb957271a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:30.352552 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd414e-11e2-406f-82c1-5bb957271a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:30.354244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd414e-11e2-406f-82c1-5bb957271a3c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:30.368706 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1347/2644] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 16:13:30.376984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20ab90-463b-4c6b-bcd2-d51b9e5f431e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:30.378488 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-bc20ab90-463b-4c6b-bcd2-d51b9e5f431e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:30.396336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20ab90-463b-4c6b-bcd2-d51b9e5f431e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:30.401243 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f73991-7825-4b42-b6a4-421952de739d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:30.402215 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f73991-7825-4b42-b6a4-421952de739d admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:30.402552 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f73991-7825-4b42-b6a4-421952de739d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:30.403058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f73991-7825-4b42-b6a4-421952de739d admin admin] PATH_INFO: `/v3/projects/0229f6af75914601a357b93790b7a96b/users/721f23a108844c6998836a7271942c46/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:30.405165 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f73991-7825-4b42-b6a4-421952de739d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0229f6af75914601a357b93790b7a96b, user_id=721f23a108844c6998836a7271942c46, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:30.408381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f73991-7825-4b42-b6a4-421952de739d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:30.428117 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1298/2645] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:13:30 2022] PUT /identity/v3/projects/0229f6af75914601a357b93790b7a96b/users/721f23a108844c6998836a7271942c46/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:13:30.440648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f4b48-d84b-47e8-b241-27515ca94c3d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:30.440648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f4b48-d84b-47e8-b241-27515ca94c3d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:30.440956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f4b48-d84b-47e8-b241-27515ca94c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:30.481187 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ea3f4b48-d84b-47e8-b241-27515ca94c3d None None] MFA Rules not processed for user `721f23a108844c6998836a7271942c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:30.482635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ea3f4b48-d84b-47e8-b241-27515ca94c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:30.629167 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1348/2646] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:13:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:13:30.643914 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f73991-7825-4b42-b6a4-421952de739d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:30.645785 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-06f73991-7825-4b42-b6a4-421952de739d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:30.728516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f73991-7825-4b42-b6a4-421952de739d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:30.734324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fefbbb-1717-47d7-b392-4b33cecba733 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:30.735460 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fefbbb-1717-47d7-b392-4b33cecba733 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:30.735893 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fefbbb-1717-47d7-b392-4b33cecba733 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:30.736152 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fefbbb-1717-47d7-b392-4b33cecba733 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:30.772844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fefbbb-1717-47d7-b392-4b33cecba733 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:30.776068 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fefbbb-1717-47d7-b392-4b33cecba733 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:30.779155 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f4b48-d84b-47e8-b241-27515ca94c3d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:30.782317 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ea3f4b48-d84b-47e8-b241-27515ca94c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:30.842436 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1299/2647] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:13:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:13:30.945769 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:30.976647 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f4b48-d84b-47e8-b241-27515ca94c3d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:30.988070 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7e453-1d29-4504-936f-27f6e1fbb387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:30.988970 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7e453-1d29-4504-936f-27f6e1fbb387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:30.989256 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7e453-1d29-4504-936f-27f6e1fbb387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:30.989578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7e453-1d29-4504-936f-27f6e1fbb387 admin admin] PATH_INFO: `/v3/projects/fbf8be97cd2a431c911229833970b2ce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:30.992295 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7e453-1d29-4504-936f-27f6e1fbb387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbf8be97cd2a431c911229833970b2ce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:30.992977 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7e453-1d29-4504-936f-27f6e1fbb387 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:31.082108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-97e7e453-1d29-4504-936f-27f6e1fbb387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf8be97cd2a431c911229833970b2ce', 'request_id': 'req-97e7e453-1d29-4504-936f-27f6e1fbb387'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:31.090383 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-97e7e453-1d29-4504-936f-27f6e1fbb387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf8be97cd2a431c911229833970b2ce', 'request_id': 'req-97e7e453-1d29-4504-936f-27f6e1fbb387'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:31.122601 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-97e7e453-1d29-4504-936f-27f6e1fbb387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf8be97cd2a431c911229833970b2ce', 'request_id': 'req-97e7e453-1d29-4504-936f-27f6e1fbb387'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:31.178702 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-97e7e453-1d29-4504-936f-27f6e1fbb387 admin admin] The token cache is being invalidate because project fbf8be97cd2a431c911229833970b2ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:13:31.180360 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-97e7e453-1d29-4504-936f-27f6e1fbb387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:31.181214 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-97e7e453-1d29-4504-936f-27f6e1fbb387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:31.187445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1349/2648] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:13:30 2022] DELETE /identity/v3/projects/fbf8be97cd2a431c911229833970b2ce => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:13:31.192503 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0577fa0-72b5-4544-b5f2-499946420ab7 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:31.193035 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0577fa0-72b5-4544-b5f2-499946420ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:31.193403 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0577fa0-72b5-4544-b5f2-499946420ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:31.266779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c0577fa0-72b5-4544-b5f2-499946420ab7 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:31.268311 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c0577fa0-72b5-4544-b5f2-499946420ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:31.281285 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:31.476105 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1300/2649] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:13:31.485358 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b6cf6-e7eb-49f5-9ab6-2a3e1a3bdce8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:31.485883 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b6cf6-e7eb-49f5-9ab6-2a3e1a3bdce8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:31.486408 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b6cf6-e7eb-49f5-9ab6-2a3e1a3bdce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:31.582910 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-771b6cf6-e7eb-49f5-9ab6-2a3e1a3bdce8 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:31.587776 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-771b6cf6-e7eb-49f5-9ab6-2a3e1a3bdce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:31.625633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1350/2650] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:13:31.631291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0577fa0-72b5-4544-b5f2-499946420ab7 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:31.645769 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0577fa0-72b5-4544-b5f2-499946420ab7 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:31.677435 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b6cf6-e7eb-49f5-9ab6-2a3e1a3bdce8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:31.678203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3c166-aaed-4bc0-af86-e6eb6447ad5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:31.678785 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3c166-aaed-4bc0-af86-e6eb6447ad5e admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:31.679075 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3c166-aaed-4bc0-af86-e6eb6447ad5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:31.679356 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3c166-aaed-4bc0-af86-e6eb6447ad5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:31.679606 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-771b6cf6-e7eb-49f5-9ab6-2a3e1a3bdce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:31.680104 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b3c166-aaed-4bc0-af86-e6eb6447ad5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:13:31.680417 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b3c166-aaed-4bc0-af86-e6eb6447ad5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:31.682083 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b3c166-aaed-4bc0-af86-e6eb6447ad5e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:31.713462 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1301/2651] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 16:13:31.719009 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3c166-aaed-4bc0-af86-e6eb6447ad5e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:31.720498 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b6cf6-e7eb-49f5-9ab6-2a3e1a3bdce8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:31.748757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94601407-cf19-463d-9cd5-c066d2027ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:31.750374 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94601407-cf19-463d-9cd5-c066d2027ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:31.750896 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94601407-cf19-463d-9cd5-c066d2027ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:31.751374 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94601407-cf19-463d-9cd5-c066d2027ea3 admin admin] PATH_INFO: `/v3/users/d3913ddcade540f9936600b564f8ffd5` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:31.751612 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3c166-aaed-4bc0-af86-e6eb6447ad5e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:31.755730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94601407-cf19-463d-9cd5-c066d2027ea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3913ddcade540f9936600b564f8ffd5)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:31.766179 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0102511-b907-426d-9ed4-37de866819d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:31.767410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0102511-b907-426d-9ed4-37de866819d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:31.767794 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94601407-cf19-463d-9cd5-c066d2027ea3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:31.767906 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0102511-b907-426d-9ed4-37de866819d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:31.768120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0102511-b907-426d-9ed4-37de866819d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:31.768877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0102511-b907-426d-9ed4-37de866819d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:31.771342 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0102511-b907-426d-9ed4-37de866819d7 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:31.815877 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1302/2652] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:13:31 2022] POST /identity/v3/projects => generated 363 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:13:31.819779 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0102511-b907-426d-9ed4-37de866819d7 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:31.909597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-94601407-cf19-463d-9cd5-c066d2027ea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3913ddcade540f9936600b564f8ffd5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:31.918809 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-94601407-cf19-463d-9cd5-c066d2027ea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3913ddcade540f9936600b564f8ffd5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:31.939927 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0102511-b907-426d-9ed4-37de866819d7 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:31.940184 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-94601407-cf19-463d-9cd5-c066d2027ea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3913ddcade540f9936600b564f8ffd5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:31.945839 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5470e-be14-498f-a67e-0e5dd122c337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:31.946845 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5470e-be14-498f-a67e-0e5dd122c337 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:31.947145 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5470e-be14-498f-a67e-0e5dd122c337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:31.947436 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb5470e-be14-498f-a67e-0e5dd122c337 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:31.948133 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5470e-be14-498f-a67e-0e5dd122c337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:31.950337 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb5470e-be14-498f-a67e-0e5dd122c337 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:31.963609 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-94601407-cf19-463d-9cd5-c066d2027ea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3913ddcade540f9936600b564f8ffd5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:31.981336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1303/2653] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:13:31 2022] POST /identity/v3/users => generated 282 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:13:31.986667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5470e-be14-498f-a67e-0e5dd122c337 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:31.988867 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0eb5470e-be14-498f-a67e-0e5dd122c337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:32.005915 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-94601407-cf19-463d-9cd5-c066d2027ea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3913ddcade540f9936600b564f8ffd5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:32.006258 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb5470e-be14-498f-a67e-0e5dd122c337 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:32.017345 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0053b8f-1ef1-4562-a759-a8f5e979bfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:32.018145 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0053b8f-1ef1-4562-a759-a8f5e979bfab admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:32.018516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0053b8f-1ef1-4562-a759-a8f5e979bfab admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:32.019009 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0053b8f-1ef1-4562-a759-a8f5e979bfab admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:32.020316 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0053b8f-1ef1-4562-a759-a8f5e979bfab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:32.023793 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1351/2654] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:13:31 2022] DELETE /identity/v3/users/d3913ddcade540f9936600b564f8ffd5 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:13:32.023940 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0053b8f-1ef1-4562-a759-a8f5e979bfab admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:32.030387 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb6101-24c3-482c-87c8-5a6a9f2c51d0 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:32.031045 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb6101-24c3-482c-87c8-5a6a9f2c51d0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:32.031394 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb6101-24c3-482c-87c8-5a6a9f2c51d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:32.038183 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1304/2655] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:13:32.042120 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0053b8f-1ef1-4562-a759-a8f5e979bfab admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:32.055864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0053b8f-1ef1-4562-a759-a8f5e979bfab admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:32.072250 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d9bb6101-24c3-482c-87c8-5a6a9f2c51d0 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:32.074586 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d9bb6101-24c3-482c-87c8-5a6a9f2c51d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:32.122146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:32.137381 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd11e88-7bac-40da-9c65-ce2ac20c4be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:32.140094 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd11e88-7bac-40da-9c65-ce2ac20c4be6 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:32.140698 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd11e88-7bac-40da-9c65-ce2ac20c4be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:32.141249 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd11e88-7bac-40da-9c65-ce2ac20c4be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:32.142874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd11e88-7bac-40da-9c65-ce2ac20c4be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:32.146435 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd11e88-7bac-40da-9c65-ce2ac20c4be6 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:32.151797 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:32.168037 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1305/2656] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:13:32.173791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd11e88-7bac-40da-9c65-ce2ac20c4be6 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:32.177145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1352/2657] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:13:32.187521 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb6101-24c3-482c-87c8-5a6a9f2c51d0 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:32.189693 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d9bb6101-24c3-482c-87c8-5a6a9f2c51d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:32.197149 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd11e88-7bac-40da-9c65-ce2ac20c4be6 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:32.204047 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c5c5e-ea85-4c3b-9346-ab0456d06b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:32.205677 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c5c5e-ea85-4c3b-9346-ab0456d06b12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:32.205969 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c5c5e-ea85-4c3b-9346-ab0456d06b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:32.206336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c5c5e-ea85-4c3b-9346-ab0456d06b12 admin admin] PATH_INFO: `/v3/projects/a1588e5b1ee648e3bbac09382c14ad16/users/6855691c266b459f8389fc90df25238d/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:32.236568 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c5c5e-ea85-4c3b-9346-ab0456d06b12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1588e5b1ee648e3bbac09382c14ad16, user_id=6855691c266b459f8389fc90df25238d, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:32.239945 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c5c5e-ea85-4c3b-9346-ab0456d06b12 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:32.261070 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1306/2658] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:13:32 2022] PUT /identity/v3/projects/a1588e5b1ee648e3bbac09382c14ad16/users/6855691c266b459f8389fc90df25238d/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:13:32.308834 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb6101-24c3-482c-87c8-5a6a9f2c51d0 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:32.338591 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b81b08-fc5a-4d01-b682-1f519f0c4fe6 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:32.339042 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b81b08-fc5a-4d01-b682-1f519f0c4fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:32.339189 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b81b08-fc5a-4d01-b682-1f519f0c4fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:32.396569 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-f5b81b08-fc5a-4d01-b682-1f519f0c4fe6 None None] MFA Rules not processed for user `6855691c266b459f8389fc90df25238d`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:32.398160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f5b81b08-fc5a-4d01-b682-1f519f0c4fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:32.443715 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d8639-0c1f-488b-b334-7fae7e3cf4a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:32.444647 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d8639-0c1f-488b-b334-7fae7e3cf4a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:32.445120 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d8639-0c1f-488b-b334-7fae7e3cf4a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:32.445550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d8639-0c1f-488b-b334-7fae7e3cf4a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:32.544606 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1307/2659] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:13:32 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:13:32.549179 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b81b08-fc5a-4d01-b682-1f519f0c4fe6 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:32.552819 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d8639-0c1f-488b-b334-7fae7e3cf4a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:32.554766 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8d8639-0c1f-488b-b334-7fae7e3cf4a4 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:32.570550 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b81b08-fc5a-4d01-b682-1f519f0c4fe6 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:32.583658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcbaf0-994c-43ab-8a40-c20680ca219c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:32.583658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcbaf0-994c-43ab-8a40-c20680ca219c admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:32.584689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcbaf0-994c-43ab-8a40-c20680ca219c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:32.584689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcbaf0-994c-43ab-8a40-c20680ca219c admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:32.585616 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcbaf0-994c-43ab-8a40-c20680ca219c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:32.587880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1353/2660] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:13:32.592498 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcbaf0-994c-43ab-8a40-c20680ca219c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:32.650952 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1308/2661] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:13:32 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:13:32.655871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d8639-0c1f-488b-b334-7fae7e3cf4a4 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:32.669998 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d8639-0c1f-488b-b334-7fae7e3cf4a4 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:32.746095 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:32.755947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f56d6-9260-456a-87d6-00d4dd0765c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:32.757106 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f56d6-9260-456a-87d6-00d4dd0765c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:32.757525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f56d6-9260-456a-87d6-00d4dd0765c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:32.757909 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f56d6-9260-456a-87d6-00d4dd0765c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:32.758781 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f56d6-9260-456a-87d6-00d4dd0765c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:32.762439 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093f56d6-9260-456a-87d6-00d4dd0765c3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:32.798790 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1354/2662] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:13:32 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:13:32.802425 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcbaf0-994c-43ab-8a40-c20680ca219c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:32.820193 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcbaf0-994c-43ab-8a40-c20680ca219c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:32.832958 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa778c-f654-41bb-a401-03055c38b7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:32.833851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa778c-f654-41bb-a401-03055c38b7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:32.834337 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa778c-f654-41bb-a401-03055c38b7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:32.834810 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa778c-f654-41bb-a401-03055c38b7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:32.835578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa778c-f654-41bb-a401-03055c38b7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:32.839340 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa778c-f654-41bb-a401-03055c38b7b3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:32.876945 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1309/2663] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:13:32.881301 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f56d6-9260-456a-87d6-00d4dd0765c3 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:32.896140 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f56d6-9260-456a-87d6-00d4dd0765c3 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:32.918740 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd790fd2-1222-4fe0-8e75-634fd0dd9600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:32.920228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd790fd2-1222-4fe0-8e75-634fd0dd9600 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:32.920451 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd790fd2-1222-4fe0-8e75-634fd0dd9600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:32.920728 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd790fd2-1222-4fe0-8e75-634fd0dd9600 admin admin] PATH_INFO: `/v3/projects/be3aa54a5d524d95a18ab1bbc56e5c7b/users/ea7b7391d07e40cd894326e8409b421d/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:32.962663 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd790fd2-1222-4fe0-8e75-634fd0dd9600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be3aa54a5d524d95a18ab1bbc56e5c7b, user_id=ea7b7391d07e40cd894326e8409b421d, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:32.971024 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd790fd2-1222-4fe0-8e75-634fd0dd9600 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:33.003268 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1355/2664] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:13:32 2022] PUT /identity/v3/projects/be3aa54a5d524d95a18ab1bbc56e5c7b/users/ea7b7391d07e40cd894326e8409b421d/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:13:33.005343 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa778c-f654-41bb-a401-03055c38b7b3 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:33.020466 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa778c-f654-41bb-a401-03055c38b7b3 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:33.094454 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd790fd2-1222-4fe0-8e75-634fd0dd9600 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:33.096922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cd790fd2-1222-4fe0-8e75-634fd0dd9600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:33.141980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95485d6-f300-4d50-9621-2062fe150d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:33.144187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95485d6-f300-4d50-9621-2062fe150d57 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:33.144480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95485d6-f300-4d50-9621-2062fe150d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:33.144758 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95485d6-f300-4d50-9621-2062fe150d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:33.146448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95485d6-f300-4d50-9621-2062fe150d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:33.149473 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95485d6-f300-4d50-9621-2062fe150d57 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:33.168409 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1310/2665] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:13:33.172208 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95485d6-f300-4d50-9621-2062fe150d57 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:33.188465 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95485d6-f300-4d50-9621-2062fe150d57 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:33.197076 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf650a43-8557-47c8-831f-9240e090175f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:33.198391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf650a43-8557-47c8-831f-9240e090175f admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:33.198941 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf650a43-8557-47c8-831f-9240e090175f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:33.199098 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf650a43-8557-47c8-831f-9240e090175f admin admin] PATH_INFO: `/v3/projects/be3aa54a5d524d95a18ab1bbc56e5c7b/users/ea7b7391d07e40cd894326e8409b421d/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:33.202924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf650a43-8557-47c8-831f-9240e090175f admin admin] RBAC: Authorizing `identity:create_grant(project_id=be3aa54a5d524d95a18ab1bbc56e5c7b, user_id=ea7b7391d07e40cd894326e8409b421d, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:33.211494 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf650a43-8557-47c8-831f-9240e090175f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:33.223352 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1311/2666] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:13:33 2022] PUT /identity/v3/projects/be3aa54a5d524d95a18ab1bbc56e5c7b/users/ea7b7391d07e40cd894326e8409b421d/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:13:33.230366 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd790fd2-1222-4fe0-8e75-634fd0dd9600 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:33.234679 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534bb1b-db64-421b-a8c6-313bf7b33581 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:33.235026 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534bb1b-db64-421b-a8c6-313bf7b33581 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:33.235325 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534bb1b-db64-421b-a8c6-313bf7b33581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:33.262658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:33.274887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-0534bb1b-db64-421b-a8c6-313bf7b33581 None None] MFA Rules not processed for user `ea7b7391d07e40cd894326e8409b421d`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:33.276255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0534bb1b-db64-421b-a8c6-313bf7b33581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:33.334783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1167ea-5d01-4792-815e-b5b24b9751da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:33.336148 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1167ea-5d01-4792-815e-b5b24b9751da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:33.336594 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1167ea-5d01-4792-815e-b5b24b9751da admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:33.337028 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1167ea-5d01-4792-815e-b5b24b9751da admin admin] PATH_INFO: `/v3/projects/469bc5ceaf204eb4829b5687a398294a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:33.340553 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1167ea-5d01-4792-815e-b5b24b9751da admin admin] RBAC: Authorizing `identity:delete_project(project_id=469bc5ceaf204eb4829b5687a398294a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:33.342805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1167ea-5d01-4792-815e-b5b24b9751da admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:33.361821 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1312/2667] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:13:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:13:33.373747 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534bb1b-db64-421b-a8c6-313bf7b33581 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:33.375627 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-0534bb1b-db64-421b-a8c6-313bf7b33581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:33.417568 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5f1167ea-5d01-4792-815e-b5b24b9751da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '469bc5ceaf204eb4829b5687a398294a', 'request_id': 'req-5f1167ea-5d01-4792-815e-b5b24b9751da'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:33.426537 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5f1167ea-5d01-4792-815e-b5b24b9751da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '469bc5ceaf204eb4829b5687a398294a', 'request_id': 'req-5f1167ea-5d01-4792-815e-b5b24b9751da'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:33.437529 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5f1167ea-5d01-4792-815e-b5b24b9751da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '469bc5ceaf204eb4829b5687a398294a', 'request_id': 'req-5f1167ea-5d01-4792-815e-b5b24b9751da'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:33.448383 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:33.457559 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5f1167ea-5d01-4792-815e-b5b24b9751da admin admin] The token cache is being invalidate because project 469bc5ceaf204eb4829b5687a398294a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:13:33.458368 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5f1167ea-5d01-4792-815e-b5b24b9751da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:33.459488 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5f1167ea-5d01-4792-815e-b5b24b9751da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:33.461753 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1356/2668] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:13:33 2022] DELETE /identity/v3/projects/469bc5ceaf204eb4829b5687a398294a => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:13:33.466241 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1167ea-5d01-4792-815e-b5b24b9751da admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:33.468845 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5f1167ea-5d01-4792-815e-b5b24b9751da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:33.482007 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534bb1b-db64-421b-a8c6-313bf7b33581 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:33.587348 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1167ea-5d01-4792-815e-b5b24b9751da admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:33.604061 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b083cb-1758-40e4-a6ae-06b425ec4b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:33.605390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b083cb-1758-40e4-a6ae-06b425ec4b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:33.605715 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b083cb-1758-40e4-a6ae-06b425ec4b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:33.607736 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b083cb-1758-40e4-a6ae-06b425ec4b29 admin admin] PATH_INFO: `/v3/users/721f23a108844c6998836a7271942c46` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:33.609457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b083cb-1758-40e4-a6ae-06b425ec4b29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=721f23a108844c6998836a7271942c46)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:33.612609 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b083cb-1758-40e4-a6ae-06b425ec4b29 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:33.633126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47632790-9194-415d-bd16-2508a272cec0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:33.634113 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47632790-9194-415d-bd16-2508a272cec0 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:33.634113 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47632790-9194-415d-bd16-2508a272cec0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:33.634336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47632790-9194-415d-bd16-2508a272cec0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:33.636791 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-47632790-9194-415d-bd16-2508a272cec0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:33.712240 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-27b083cb-1758-40e4-a6ae-06b425ec4b29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '721f23a108844c6998836a7271942c46'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:33.713066 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-27b083cb-1758-40e4-a6ae-06b425ec4b29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '721f23a108844c6998836a7271942c46'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:33.731805 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-27b083cb-1758-40e4-a6ae-06b425ec4b29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '721f23a108844c6998836a7271942c46'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:33.751199 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-27b083cb-1758-40e4-a6ae-06b425ec4b29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '721f23a108844c6998836a7271942c46'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:33.779311 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-27b083cb-1758-40e4-a6ae-06b425ec4b29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '721f23a108844c6998836a7271942c46'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:33.794397 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1357/2669] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:13:33 2022] DELETE /identity/v3/users/721f23a108844c6998836a7271942c46 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:13:33.814745 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47632790-9194-415d-bd16-2508a272cec0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:33.815945 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47632790-9194-415d-bd16-2508a272cec0 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:33.822109 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:33.842285 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1313/2670] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:13:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:13:33.920632 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd3403-c0e0-4d1b-8476-6e02dad8b40a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:33.920927 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd3403-c0e0-4d1b-8476-6e02dad8b40a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:33.921280 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd3403-c0e0-4d1b-8476-6e02dad8b40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:33.951851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47632790-9194-415d-bd16-2508a272cec0 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:33.953438 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-47632790-9194-415d-bd16-2508a272cec0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:33.969918 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47632790-9194-415d-bd16-2508a272cec0 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:33.991829 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e9cd3403-c0e0-4d1b-8476-6e02dad8b40a None None] MFA Rules not processed for user `8fb90913af24468cb2a63ba0afd8d7f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:33.993093 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e9cd3403-c0e0-4d1b-8476-6e02dad8b40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:34.077657 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7419a-d454-4214-a7fa-39bf69546867 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:34.078406 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7419a-d454-4214-a7fa-39bf69546867 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:34.078825 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7419a-d454-4214-a7fa-39bf69546867 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:34.079324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7419a-d454-4214-a7fa-39bf69546867 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:34.081634 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-54e7419a-d454-4214-a7fa-39bf69546867 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:34.130108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1358/2671] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:13:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:13:34.161232 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd3403-c0e0-4d1b-8476-6e02dad8b40a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:34.165724 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e9cd3403-c0e0-4d1b-8476-6e02dad8b40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:34.182559 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:34.204518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7419a-d454-4214-a7fa-39bf69546867 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:34.207280 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7419a-d454-4214-a7fa-39bf69546867 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:34.221563 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1314/2672] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:13:33 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:13:34.302200 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd3403-c0e0-4d1b-8476-6e02dad8b40a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:34.311880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb41c8-e925-4b03-9fb5-9e44eadf0536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:34.313111 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb41c8-e925-4b03-9fb5-9e44eadf0536 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:34.313505 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb41c8-e925-4b03-9fb5-9e44eadf0536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:34.313854 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb41c8-e925-4b03-9fb5-9e44eadf0536 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:34.314690 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb41c8-e925-4b03-9fb5-9e44eadf0536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:34.316756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb41c8-e925-4b03-9fb5-9e44eadf0536 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:34.385902 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7419a-d454-4214-a7fa-39bf69546867 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:34.391682 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-54e7419a-d454-4214-a7fa-39bf69546867 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:34.392078 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1359/2673] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:13:34 2022] POST /identity/v3/projects => generated 385 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:13:34.393707 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb41c8-e925-4b03-9fb5-9e44eadf0536 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:34.500143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7419a-d454-4214-a7fa-39bf69546867 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:34.567196 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb41c8-e925-4b03-9fb5-9e44eadf0536 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:34.572956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af73f7-7d4d-4ce8-b401-24219442ec90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:34.573672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af73f7-7d4d-4ce8-b401-24219442ec90 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:34.573951 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af73f7-7d4d-4ce8-b401-24219442ec90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:34.574309 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af73f7-7d4d-4ce8-b401-24219442ec90 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:34.575073 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af73f7-7d4d-4ce8-b401-24219442ec90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:34.578012 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af73f7-7d4d-4ce8-b401-24219442ec90 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:34.597599 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a52be-6221-4d1a-abf2-7a4e9b2d9d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:34.598543 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a52be-6221-4d1a-abf2-7a4e9b2d9d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:34.598831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a52be-6221-4d1a-abf2-7a4e9b2d9d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:34.599121 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a52be-6221-4d1a-abf2-7a4e9b2d9d86 admin admin] PATH_INFO: `/v3/projects/0229f6af75914601a357b93790b7a96b` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:34.600358 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a52be-6221-4d1a-abf2-7a4e9b2d9d86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0229f6af75914601a357b93790b7a96b)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:34.602701 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a52be-6221-4d1a-abf2-7a4e9b2d9d86 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:34.602845 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1360/2674] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:13:34 2022] POST /identity/v3/users => generated 299 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:13:34.607031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af73f7-7d4d-4ce8-b401-24219442ec90 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:34.620292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af73f7-7d4d-4ce8-b401-24219442ec90 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:34.627204 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f43ad4-ff51-4222-babf-b4c76731eb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:34.627876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f43ad4-ff51-4222-babf-b4c76731eb74 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:34.628330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f43ad4-ff51-4222-babf-b4c76731eb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:34.628611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f43ad4-ff51-4222-babf-b4c76731eb74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:34.629695 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f43ad4-ff51-4222-babf-b4c76731eb74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:34.631367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f43ad4-ff51-4222-babf-b4c76731eb74 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:34.648390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1361/2675] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 16:13:34.652449 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f43ad4-ff51-4222-babf-b4c76731eb74 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:34.664453 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f43ad4-ff51-4222-babf-b4c76731eb74 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:34.672992 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ed6a52be-6221-4d1a-abf2-7a4e9b2d9d86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0229f6af75914601a357b93790b7a96b', 'request_id': 'req-ed6a52be-6221-4d1a-abf2-7a4e9b2d9d86'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:34.681345 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ed6a52be-6221-4d1a-abf2-7a4e9b2d9d86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0229f6af75914601a357b93790b7a96b', 'request_id': 'req-ed6a52be-6221-4d1a-abf2-7a4e9b2d9d86'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:34.683896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:34.691682 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ed6a52be-6221-4d1a-abf2-7a4e9b2d9d86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0229f6af75914601a357b93790b7a96b', 'request_id': 'req-ed6a52be-6221-4d1a-abf2-7a4e9b2d9d86'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:34.707309 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ed6a52be-6221-4d1a-abf2-7a4e9b2d9d86 admin admin] The token cache is being invalidate because project 0229f6af75914601a357b93790b7a96b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:13:34.707309 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ed6a52be-6221-4d1a-abf2-7a4e9b2d9d86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:34.708117 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ed6a52be-6221-4d1a-abf2-7a4e9b2d9d86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:13:34.714693 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1315/2676] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:13:34 2022] DELETE /identity/v3/projects/0229f6af75914601a357b93790b7a96b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:13:34.718281 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2b51e-3947-4c39-8432-c8c71981b457 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:34.718568 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2b51e-3947-4c39-8432-c8c71981b457 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:34.718844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2b51e-3947-4c39-8432-c8c71981b457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:34.739949 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-afe2b51e-3947-4c39-8432-c8c71981b457 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:34.740794 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8836169-32bc-4f71-b2f1-7df3956de658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:34.741234 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-afe2b51e-3947-4c39-8432-c8c71981b457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:34.741692 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8836169-32bc-4f71-b2f1-7df3956de658 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:34.741972 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8836169-32bc-4f71-b2f1-7df3956de658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:34.742290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8836169-32bc-4f71-b2f1-7df3956de658 admin admin] PATH_INFO: `/v3/projects/53fee8192b154fb3a1867f6b429b9db2/users/2e9ad1a73978407ba6d65c00a677a5d6/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:34.752372 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1316/2677] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:13:34.761718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8836169-32bc-4f71-b2f1-7df3956de658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53fee8192b154fb3a1867f6b429b9db2, user_id=2e9ad1a73978407ba6d65c00a677a5d6, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:34.762295 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a33588-39a6-4f8b-a9f3-e18dce4769fe None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:34.762295 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a33588-39a6-4f8b-a9f3-e18dce4769fe None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:34.762464 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a33588-39a6-4f8b-a9f3-e18dce4769fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:34.764712 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8836169-32bc-4f71-b2f1-7df3956de658 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:34.767217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:34.782889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1362/2678] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:13:34 2022] PUT /identity/v3/projects/53fee8192b154fb3a1867f6b429b9db2/users/2e9ad1a73978407ba6d65c00a677a5d6/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:13:34.784195 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-20a33588-39a6-4f8b-a9f3-e18dce4769fe None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:34.785444 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-20a33588-39a6-4f8b-a9f3-e18dce4769fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:34.786879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8836169-32bc-4f71-b2f1-7df3956de658 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:34.788548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f8836169-32bc-4f71-b2f1-7df3956de658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:34.855417 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1317/2679] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:13:34.861258 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a33588-39a6-4f8b-a9f3-e18dce4769fe None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:34.867562 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8836169-32bc-4f71-b2f1-7df3956de658 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:34.871514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a33588-39a6-4f8b-a9f3-e18dce4769fe None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:34.872677 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59161a24-feaa-4280-aa4c-5ebbba71ff0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:34.873916 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59161a24-feaa-4280-aa4c-5ebbba71ff0f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:34.874278 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59161a24-feaa-4280-aa4c-5ebbba71ff0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:34.874628 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59161a24-feaa-4280-aa4c-5ebbba71ff0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:34.875759 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59161a24-feaa-4280-aa4c-5ebbba71ff0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:34.877377 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59161a24-feaa-4280-aa4c-5ebbba71ff0f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:34.878211 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7a1f7-451c-40f9-996d-4fc78186fa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:34.879114 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7a1f7-451c-40f9-996d-4fc78186fa05 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:34.880324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7a1f7-451c-40f9-996d-4fc78186fa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:34.880603 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7a1f7-451c-40f9-996d-4fc78186fa05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:34.881338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c7a1f7-451c-40f9-996d-4fc78186fa05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:13:34.881648 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c7a1f7-451c-40f9-996d-4fc78186fa05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:34.883288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c7a1f7-451c-40f9-996d-4fc78186fa05 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:34.890424 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1363/2680] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 16:13:34.894798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59161a24-feaa-4280-aa4c-5ebbba71ff0f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:34.902353 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1318/2681] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 16:13:34.903665 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7a1f7-451c-40f9-996d-4fc78186fa05 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:34.905884 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59161a24-feaa-4280-aa4c-5ebbba71ff0f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:34.910921 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765a315-33ae-455e-8e24-1e24103c1cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:34.911815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765a315-33ae-455e-8e24-1e24103c1cec admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:34.912374 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765a315-33ae-455e-8e24-1e24103c1cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:34.912548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765a315-33ae-455e-8e24-1e24103c1cec admin admin] PATH_INFO: `/v3/projects/53fee8192b154fb3a1867f6b429b9db2/users/2e9ad1a73978407ba6d65c00a677a5d6/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:34.914597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765a315-33ae-455e-8e24-1e24103c1cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=53fee8192b154fb3a1867f6b429b9db2, user_id=2e9ad1a73978407ba6d65c00a677a5d6, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:34.915321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7a1f7-451c-40f9-996d-4fc78186fa05 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:34.917259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1765a315-33ae-455e-8e24-1e24103c1cec admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:34.920661 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4a232-a217-4957-8d90-c7d898caff04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:34.920996 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4a232-a217-4957-8d90-c7d898caff04 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:34.921293 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4a232-a217-4957-8d90-c7d898caff04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:34.921668 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4a232-a217-4957-8d90-c7d898caff04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:34.922655 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4a232-a217-4957-8d90-c7d898caff04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:34.924771 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4a232-a217-4957-8d90-c7d898caff04 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:34.930167 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1364/2682] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:13:34 2022] PUT /identity/v3/projects/53fee8192b154fb3a1867f6b429b9db2/users/2e9ad1a73978407ba6d65c00a677a5d6/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:13:34.970564 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1319/2683] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:13:34 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:13:34.974977 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765a315-33ae-455e-8e24-1e24103c1cec admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:35.064970 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765a315-33ae-455e-8e24-1e24103c1cec admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:35.160521 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e728427-07a9-4ab3-a467-baed5c888244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:35.161332 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e728427-07a9-4ab3-a467-baed5c888244 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:35.161699 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e728427-07a9-4ab3-a467-baed5c888244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:35.162089 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e728427-07a9-4ab3-a467-baed5c888244 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:35.162943 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e728427-07a9-4ab3-a467-baed5c888244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:35.166400 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e728427-07a9-4ab3-a467-baed5c888244 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:35.200953 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1365/2684] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:13:34 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:13:35.206385 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4a232-a217-4957-8d90-c7d898caff04 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:35.217309 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4a232-a217-4957-8d90-c7d898caff04 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:35.222553 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea96256-31bf-4cbc-b530-0239812f9b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:35.223402 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea96256-31bf-4cbc-b530-0239812f9b51 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:35.223692 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea96256-31bf-4cbc-b530-0239812f9b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:35.223977 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea96256-31bf-4cbc-b530-0239812f9b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:35.224718 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea96256-31bf-4cbc-b530-0239812f9b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:35.226413 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea96256-31bf-4cbc-b530-0239812f9b51 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:35.253968 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1320/2685] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:13:35.255512 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e728427-07a9-4ab3-a467-baed5c888244 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:35.272588 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e728427-07a9-4ab3-a467-baed5c888244 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:35.282292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efa91c-a416-44d4-9e20-cc7e44a87f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:35.283094 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efa91c-a416-44d4-9e20-cc7e44a87f65 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:35.283436 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efa91c-a416-44d4-9e20-cc7e44a87f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:35.283810 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efa91c-a416-44d4-9e20-cc7e44a87f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:35.284455 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6efa91c-a416-44d4-9e20-cc7e44a87f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:35.286132 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6efa91c-a416-44d4-9e20-cc7e44a87f65 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:35.299140 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1366/2686] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:13:35.303018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea96256-31bf-4cbc-b530-0239812f9b51 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:35.316697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea96256-31bf-4cbc-b530-0239812f9b51 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:35.328357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9682d-c50d-415f-81e9-d6d815167d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:35.329607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9682d-c50d-415f-81e9-d6d815167d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:35.330350 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9682d-c50d-415f-81e9-d6d815167d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:35.330816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9682d-c50d-415f-81e9-d6d815167d94 admin admin] PATH_INFO: `/v3/projects/14f1faa3206943a7b16246c6b2f45a61/users/928a38abc9b6492695e4b51d27b7851b/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:35.353478 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9682d-c50d-415f-81e9-d6d815167d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f1faa3206943a7b16246c6b2f45a61, user_id=928a38abc9b6492695e4b51d27b7851b, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:35.358347 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9682d-c50d-415f-81e9-d6d815167d94 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:35.378614 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1321/2687] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:13:35 2022] PUT /identity/v3/projects/14f1faa3206943a7b16246c6b2f45a61/users/928a38abc9b6492695e4b51d27b7851b/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:13:35.389197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d30c4d-37e5-4a1c-a3ab-6df0bbbc4f03 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:35.389915 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d30c4d-37e5-4a1c-a3ab-6df0bbbc4f03 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:35.390005 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d30c4d-37e5-4a1c-a3ab-6df0bbbc4f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:35.401631 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:35.439989 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a8d30c4d-37e5-4a1c-a3ab-6df0bbbc4f03 None None] MFA Rules not processed for user `928a38abc9b6492695e4b51d27b7851b`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:35.441272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a8d30c4d-37e5-4a1c-a3ab-6df0bbbc4f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:35.585726 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1367/2688] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:13:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:13:35.600743 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9682d-c50d-415f-81e9-d6d815167d94 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:35.603901 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-76d9682d-c50d-415f-81e9-d6d815167d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:35.696533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9682d-c50d-415f-81e9-d6d815167d94 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:35.703899 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8651272-3953-42b1-a52b-955312c3c39e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:35.705001 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8651272-3953-42b1-a52b-955312c3c39e service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:35.705516 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8651272-3953-42b1-a52b-955312c3c39e service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:35.706016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8651272-3953-42b1-a52b-955312c3c39e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:35.717307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8651272-3953-42b1-a52b-955312c3c39e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:35.718946 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8651272-3953-42b1-a52b-955312c3c39e service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:35.731471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1322/2689] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:13:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:13:41.036560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2275e3-9319-4b04-b55a-e7926ceda289 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:41.037114 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2275e3-9319-4b04-b55a-e7926ceda289 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:41.037365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2275e3-9319-4b04-b55a-e7926ceda289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:41.071514 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-9f2275e3-9319-4b04-b55a-e7926ceda289 None None] MFA Rules not processed for user `2e9ad1a73978407ba6d65c00a677a5d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:41.072994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9f2275e3-9319-4b04-b55a-e7926ceda289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:41.161495 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1368/2690] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:13:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:13:41.175159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8651272-3953-42b1-a52b-955312c3c39e service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:41.176765 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f8651272-3953-42b1-a52b-955312c3c39e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:41.199022 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:41.262338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8651272-3953-42b1-a52b-955312c3c39e service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:41.266930 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4abc1-afbf-4c3e-96e3-c6ee0432f571 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14c582c1127142f8a4ebf64bb7b34516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:41.267709 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4abc1-afbf-4c3e-96e3-c6ee0432f571 service glance] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:41.268068 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4abc1-afbf-4c3e-96e3-c6ee0432f571 service glance] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:41.268428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4abc1-afbf-4c3e-96e3-c6ee0432f571 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:41.270837 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-06e4abc1-afbf-4c3e-96e3-c6ee0432f571 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:41.349697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4abc1-afbf-4c3e-96e3-c6ee0432f571 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:41.351857 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4abc1-afbf-4c3e-96e3-c6ee0432f571 service glance] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:41.364161 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1323/2691] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:13:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:13:41.483226 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf51edb-3f0d-426e-bcff-001029b4b31a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:41.483565 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf51edb-3f0d-426e-bcff-001029b4b31a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:41.483928 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf51edb-3f0d-426e-bcff-001029b4b31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:41.566662 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3bf51edb-3f0d-426e-bcff-001029b4b31a None None] MFA Rules not processed for user `8103402ac83c4b4191a3ec4d55038e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:41.568128 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3bf51edb-3f0d-426e-bcff-001029b4b31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:41.629962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:41.656915 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1369/2692] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jul 14 16:13:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:13:41.708693 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4abc1-afbf-4c3e-96e3-c6ee0432f571 service glance] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:41.710242 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-06e4abc1-afbf-4c3e-96e3-c6ee0432f571 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:41.845811 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4abc1-afbf-4c3e-96e3-c6ee0432f571 service glance] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:41.852000 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0635c-1c56-4642-b20b-0942bacb3b45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edbbc94ca71c42c0aac562c8c2ec83db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:41.852660 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0635c-1c56-4642-b20b-0942bacb3b45 service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:41.852949 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0635c-1c56-4642-b20b-0942bacb3b45 service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:41.853237 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0635c-1c56-4642-b20b-0942bacb3b45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:41.864400 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0635c-1c56-4642-b20b-0942bacb3b45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:41.866056 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0635c-1c56-4642-b20b-0942bacb3b45 service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:41.876418 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1324/2693] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jul 14 16:13:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:13:51.485158 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e05fff-677b-4851-8485-ffdf2ab7535c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:51.485940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e05fff-677b-4851-8485-ffdf2ab7535c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:51.485940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e05fff-677b-4851-8485-ffdf2ab7535c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:51.504386 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a4e05fff-677b-4851-8485-ffdf2ab7535c None None] MFA Rules not processed for user `8fb90913af24468cb2a63ba0afd8d7f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:13:51.505591 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a4e05fff-677b-4851-8485-ffdf2ab7535c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:51.512454 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1370/2694] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:13:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:13:51.784585 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0635c-1c56-4642-b20b-0942bacb3b45 service swift] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:13:51.786196 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f3f0635c-1c56-4642-b20b-0942bacb3b45 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:51.834713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:51.852501 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0635c-1c56-4642-b20b-0942bacb3b45 service swift] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:13:51.856244 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91f35e-a4fe-4d62-bb4a-a736287368dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:13:51.856928 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91f35e-a4fe-4d62-bb4a-a736287368dd service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:13:51.857215 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91f35e-a4fe-4d62-bb4a-a736287368dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:13:51.857489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91f35e-a4fe-4d62-bb4a-a736287368dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:13:51.859487 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cf91f35e-a4fe-4d62-bb4a-a736287368dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:13:51.869287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91f35e-a4fe-4d62-bb4a-a736287368dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:13:51.870742 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91f35e-a4fe-4d62-bb4a-a736287368dd service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:13:51.880126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1325/2695] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:13:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:14:00.511073 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39518ef-9d9c-486b-8de2-8dfec7fe2382 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:00.511851 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39518ef-9d9c-486b-8de2-8dfec7fe2382 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:00.512628 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39518ef-9d9c-486b-8de2-8dfec7fe2382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:00.532161 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b39518ef-9d9c-486b-8de2-8dfec7fe2382 None None] MFA Rules not processed for user `8103402ac83c4b4191a3ec4d55038e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:00.533456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b39518ef-9d9c-486b-8de2-8dfec7fe2382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:00.540922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1371/2696] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jul 14 16:14:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:00.555178 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91f35e-a4fe-4d62-bb4a-a736287368dd service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:00.568865 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91f35e-a4fe-4d62-bb4a-a736287368dd service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:00.577597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76534f-f2b9-4a0e-932e-47b791fa9946 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edbbc94ca71c42c0aac562c8c2ec83db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:00.578971 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76534f-f2b9-4a0e-932e-47b791fa9946 service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:00.579479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76534f-f2b9-4a0e-932e-47b791fa9946 service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:00.580471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76534f-f2b9-4a0e-932e-47b791fa9946 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:00.591845 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76534f-f2b9-4a0e-932e-47b791fa9946 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:00.594278 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76534f-f2b9-4a0e-932e-47b791fa9946 service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:00.605178 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1326/2697] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jul 14 16:14:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:14:07.411003 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39518ef-9d9c-486b-8de2-8dfec7fe2382 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:07.412499 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b39518ef-9d9c-486b-8de2-8dfec7fe2382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:07.494013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39518ef-9d9c-486b-8de2-8dfec7fe2382 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:07.500831 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80279b93-ea84-4075-9633-cd6d42a2364b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:07.501490 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80279b93-ea84-4075-9633-cd6d42a2364b service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:07.501780 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80279b93-ea84-4075-9633-cd6d42a2364b service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:07.502127 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80279b93-ea84-4075-9633-cd6d42a2364b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:07.504221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-80279b93-ea84-4075-9633-cd6d42a2364b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:07.565337 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80279b93-ea84-4075-9633-cd6d42a2364b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:07.566978 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80279b93-ea84-4075-9633-cd6d42a2364b service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:07.576061 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1372/2698] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:14:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:14:10.602571 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=16 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:17.571734 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=71 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:17.650914 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76534f-f2b9-4a0e-932e-47b791fa9946 service swift] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:17.652522 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6a76534f-f2b9-4a0e-932e-47b791fa9946 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:17.741358 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76534f-f2b9-4a0e-932e-47b791fa9946 service swift] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:17.758918 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b72985-0592-48a4-9c77-89bf4b182a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:17.766527 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b72985-0592-48a4-9c77-89bf4b182a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:17.766527 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b72985-0592-48a4-9c77-89bf4b182a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:17.766527 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b72985-0592-48a4-9c77-89bf4b182a0e admin admin] PATH_INFO: `/v3/users/6855691c266b459f8389fc90df25238d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:17.773670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b72985-0592-48a4-9c77-89bf4b182a0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6855691c266b459f8389fc90df25238d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:17.775898 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b72985-0592-48a4-9c77-89bf4b182a0e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:17.829887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-97b72985-0592-48a4-9c77-89bf4b182a0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6855691c266b459f8389fc90df25238d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:17.836799 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-97b72985-0592-48a4-9c77-89bf4b182a0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6855691c266b459f8389fc90df25238d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:17.851715 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-97b72985-0592-48a4-9c77-89bf4b182a0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6855691c266b459f8389fc90df25238d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:17.861689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-97b72985-0592-48a4-9c77-89bf4b182a0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6855691c266b459f8389fc90df25238d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:17.862364 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-97b72985-0592-48a4-9c77-89bf4b182a0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6855691c266b459f8389fc90df25238d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:17.869166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1327/2699] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:14:17 2022] DELETE /identity/v3/users/6855691c266b459f8389fc90df25238d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:17.875253 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c8b62-5bc2-4544-9a97-322d7e506957 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:17.876120 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c8b62-5bc2-4544-9a97-322d7e506957 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:17.876704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c8b62-5bc2-4544-9a97-322d7e506957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:17.898469 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-961c8b62-5bc2-4544-9a97-322d7e506957 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:17.899440 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-961c8b62-5bc2-4544-9a97-322d7e506957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:17.971631 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1373/2700] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:17.982035 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b72985-0592-48a4-9c77-89bf4b182a0e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:17.984165 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-97b72985-0592-48a4-9c77-89bf4b182a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:18.049669 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b72985-0592-48a4-9c77-89bf4b182a0e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:18.053613 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebbcd9-7193-4c33-bcfe-a145d62a9ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:18.054339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebbcd9-7193-4c33-bcfe-a145d62a9ace service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:18.054611 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebbcd9-7193-4c33-bcfe-a145d62a9ace service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:18.054868 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebbcd9-7193-4c33-bcfe-a145d62a9ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:18.066868 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebbcd9-7193-4c33-bcfe-a145d62a9ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:18.068547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebbcd9-7193-4c33-bcfe-a145d62a9ace service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:18.080548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1328/2701] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:14:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:14:18.454437 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c8b62-5bc2-4544-9a97-322d7e506957 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:18.456070 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-961c8b62-5bc2-4544-9a97-322d7e506957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:18.476722 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c8b62-5bc2-4544-9a97-322d7e506957 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:18.482330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd81f78-b583-4640-85db-983b8b613d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:18.483326 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd81f78-b583-4640-85db-983b8b613d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:18.483648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd81f78-b583-4640-85db-983b8b613d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:18.484005 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd81f78-b583-4640-85db-983b8b613d77 admin admin] PATH_INFO: `/v3/projects/a1588e5b1ee648e3bbac09382c14ad16` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:18.485297 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd81f78-b583-4640-85db-983b8b613d77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1588e5b1ee648e3bbac09382c14ad16)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:18.487384 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd81f78-b583-4640-85db-983b8b613d77 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:18.599195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-bcd81f78-b583-4640-85db-983b8b613d77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1588e5b1ee648e3bbac09382c14ad16', 'request_id': 'req-bcd81f78-b583-4640-85db-983b8b613d77'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:18.616471 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-bcd81f78-b583-4640-85db-983b8b613d77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1588e5b1ee648e3bbac09382c14ad16', 'request_id': 'req-bcd81f78-b583-4640-85db-983b8b613d77'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:18.641257 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-bcd81f78-b583-4640-85db-983b8b613d77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1588e5b1ee648e3bbac09382c14ad16', 'request_id': 'req-bcd81f78-b583-4640-85db-983b8b613d77'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:18.664574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-bcd81f78-b583-4640-85db-983b8b613d77 admin admin] The token cache is being invalidate because project a1588e5b1ee648e3bbac09382c14ad16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:14:18.665073 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-bcd81f78-b583-4640-85db-983b8b613d77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:18.665936 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-bcd81f78-b583-4640-85db-983b8b613d77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:18.668024 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1374/2702] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:14:18 2022] DELETE /identity/v3/projects/a1588e5b1ee648e3bbac09382c14ad16 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:18.672800 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebbcd9-7193-4c33-bcfe-a145d62a9ace service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:18.684869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebbcd9-7193-4c33-bcfe-a145d62a9ace service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:18.717929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:18.784951 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e15c6-c710-43ac-b032-93f254c4f688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:18.785849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e15c6-c710-43ac-b032-93f254c4f688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:18.786260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e15c6-c710-43ac-b032-93f254c4f688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:18.786425 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e15c6-c710-43ac-b032-93f254c4f688 admin admin] PATH_INFO: `/v3/users/ea7b7391d07e40cd894326e8409b421d` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:18.787914 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e15c6-c710-43ac-b032-93f254c4f688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea7b7391d07e40cd894326e8409b421d)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:18.792268 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e15c6-c710-43ac-b032-93f254c4f688 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:18.873968 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-495e15c6-c710-43ac-b032-93f254c4f688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea7b7391d07e40cd894326e8409b421d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:18.884146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-495e15c6-c710-43ac-b032-93f254c4f688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea7b7391d07e40cd894326e8409b421d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:18.904006 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-495e15c6-c710-43ac-b032-93f254c4f688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea7b7391d07e40cd894326e8409b421d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:18.919582 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-495e15c6-c710-43ac-b032-93f254c4f688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea7b7391d07e40cd894326e8409b421d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:18.920599 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-495e15c6-c710-43ac-b032-93f254c4f688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea7b7391d07e40cd894326e8409b421d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:18.929526 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1329/2703] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:14:18 2022] DELETE /identity/v3/users/ea7b7391d07e40cd894326e8409b421d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:19.306956 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd81f78-b583-4640-85db-983b8b613d77 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:19.308506 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-bcd81f78-b583-4640-85db-983b8b613d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:19.324359 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd81f78-b583-4640-85db-983b8b613d77 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:19.397855 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc8746-d52c-4546-b722-2278b8a99119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:19.398927 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc8746-d52c-4546-b722-2278b8a99119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:19.399433 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc8746-d52c-4546-b722-2278b8a99119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:19.400424 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc8746-d52c-4546-b722-2278b8a99119 admin admin] PATH_INFO: `/v3/projects/be3aa54a5d524d95a18ab1bbc56e5c7b` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:19.401725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc8746-d52c-4546-b722-2278b8a99119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be3aa54a5d524d95a18ab1bbc56e5c7b)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:19.404195 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bc8746-d52c-4546-b722-2278b8a99119 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:19.439273 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:19.457145 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-23bc8746-d52c-4546-b722-2278b8a99119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be3aa54a5d524d95a18ab1bbc56e5c7b', 'request_id': 'req-23bc8746-d52c-4546-b722-2278b8a99119'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:19.462914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-23bc8746-d52c-4546-b722-2278b8a99119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be3aa54a5d524d95a18ab1bbc56e5c7b', 'request_id': 'req-23bc8746-d52c-4546-b722-2278b8a99119'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:19.471520 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-23bc8746-d52c-4546-b722-2278b8a99119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be3aa54a5d524d95a18ab1bbc56e5c7b', 'request_id': 'req-23bc8746-d52c-4546-b722-2278b8a99119'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:19.483545 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-23bc8746-d52c-4546-b722-2278b8a99119 admin admin] The token cache is being invalidate because project be3aa54a5d524d95a18ab1bbc56e5c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:14:19.483826 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-23bc8746-d52c-4546-b722-2278b8a99119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:19.484498 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-23bc8746-d52c-4546-b722-2278b8a99119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:19.486036 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1375/2704] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:14:19 2022] DELETE /identity/v3/projects/be3aa54a5d524d95a18ab1bbc56e5c7b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:19.491072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe30f8-001d-45ed-9b1a-9c5ab725db2c None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:19.491307 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe30f8-001d-45ed-9b1a-9c5ab725db2c None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:19.491622 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe30f8-001d-45ed-9b1a-9c5ab725db2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:19.513140 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-befe30f8-001d-45ed-9b1a-9c5ab725db2c None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:19.514464 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-befe30f8-001d-45ed-9b1a-9c5ab725db2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:19.601912 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1330/2705] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:19.610711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceec4f1-a886-4768-8e4c-5ef5ce4f4fcf None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:19.611312 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceec4f1-a886-4768-8e4c-5ef5ce4f4fcf None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:19.611312 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceec4f1-a886-4768-8e4c-5ef5ce4f4fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:19.630357 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-eceec4f1-a886-4768-8e4c-5ef5ce4f4fcf None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:19.631563 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-eceec4f1-a886-4768-8e4c-5ef5ce4f4fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:19.639556 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1376/2706] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:19.644268 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe30f8-001d-45ed-9b1a-9c5ab725db2c None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:19.655339 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe30f8-001d-45ed-9b1a-9c5ab725db2c None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:19.660049 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac17f4-3269-4418-8360-046f370a157e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:19.660713 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac17f4-3269-4418-8360-046f370a157e admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:19.660997 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac17f4-3269-4418-8360-046f370a157e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:19.661273 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac17f4-3269-4418-8360-046f370a157e admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:19.662029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac17f4-3269-4418-8360-046f370a157e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:14:19.662372 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac17f4-3269-4418-8360-046f370a157e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:19.663989 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac17f4-3269-4418-8360-046f370a157e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:19.677792 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1331/2707] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:14:19.681822 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceec4f1-a886-4768-8e4c-5ef5ce4f4fcf None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:19.692645 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceec4f1-a886-4768-8e4c-5ef5ce4f4fcf None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:19.697524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0abe7-d098-412d-956b-4a0a402902f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:19.698532 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0abe7-d098-412d-956b-4a0a402902f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:19.698850 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0abe7-d098-412d-956b-4a0a402902f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:19.699131 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0abe7-d098-412d-956b-4a0a402902f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:19.701015 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0abe7-d098-412d-956b-4a0a402902f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:19.704538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0abe7-d098-412d-956b-4a0a402902f1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:19.739013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1377/2708] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:14:19 2022] POST /identity/v3/projects => generated 367 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:14:19.743490 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac17f4-3269-4418-8360-046f370a157e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:19.755020 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac17f4-3269-4418-8360-046f370a157e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:19.791765 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:19.840952 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6956a9-8dfb-409d-96d5-3d8f5a6967ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:19.841683 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6956a9-8dfb-409d-96d5-3d8f5a6967ca admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:19.841938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6956a9-8dfb-409d-96d5-3d8f5a6967ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:19.842264 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6956a9-8dfb-409d-96d5-3d8f5a6967ca admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:19.843575 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6956a9-8dfb-409d-96d5-3d8f5a6967ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:19.845984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6956a9-8dfb-409d-96d5-3d8f5a6967ca admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:19.879799 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1332/2709] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:14:19 2022] POST /identity/v3/users => generated 284 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:14:19.881137 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0abe7-d098-412d-956b-4a0a402902f1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:19.893966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0abe7-d098-412d-956b-4a0a402902f1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:19.898887 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc1a3e-8f87-4a1a-9c96-041941d92884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:19.899636 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc1a3e-8f87-4a1a-9c96-041941d92884 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:19.900030 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc1a3e-8f87-4a1a-9c96-041941d92884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:19.900375 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc1a3e-8f87-4a1a-9c96-041941d92884 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:19.901272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc1a3e-8f87-4a1a-9c96-041941d92884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:19.903290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc1a3e-8f87-4a1a-9c96-041941d92884 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:19.915711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1378/2710] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:14:19.920915 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6956a9-8dfb-409d-96d5-3d8f5a6967ca admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:19.934519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6956a9-8dfb-409d-96d5-3d8f5a6967ca admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:19.939729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b7178-ccec-4fbf-9e51-8fafc80cee18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:19.940400 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b7178-ccec-4fbf-9e51-8fafc80cee18 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:19.940684 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b7178-ccec-4fbf-9e51-8fafc80cee18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:19.940962 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b7178-ccec-4fbf-9e51-8fafc80cee18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:19.941694 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b7178-ccec-4fbf-9e51-8fafc80cee18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:19.945329 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b7178-ccec-4fbf-9e51-8fafc80cee18 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:19.960390 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1333/2711] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 16:14:19.964625 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc1a3e-8f87-4a1a-9c96-041941d92884 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:19.975920 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc1a3e-8f87-4a1a-9c96-041941d92884 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:19.980977 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554eea2-8841-4d1f-8b5f-03fe4a878146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:19.981869 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554eea2-8841-4d1f-8b5f-03fe4a878146 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:19.982177 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554eea2-8841-4d1f-8b5f-03fe4a878146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:19.982459 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554eea2-8841-4d1f-8b5f-03fe4a878146 admin admin] PATH_INFO: `/v3/projects/ab7a1be076344538a97f491df7c65902/users/12994145305841a8a221412aeddb4aac/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:19.997889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554eea2-8841-4d1f-8b5f-03fe4a878146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7a1be076344538a97f491df7c65902, user_id=12994145305841a8a221412aeddb4aac, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:20.000688 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554eea2-8841-4d1f-8b5f-03fe4a878146 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:20.014664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1379/2712] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:14:19 2022] PUT /identity/v3/projects/ab7a1be076344538a97f491df7c65902/users/12994145305841a8a221412aeddb4aac/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:20.025129 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8159341-daa6-4df5-9adf-01160e553610 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:20.025423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8159341-daa6-4df5-9adf-01160e553610 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:20.025711 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8159341-daa6-4df5-9adf-01160e553610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:20.054764 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a8159341-daa6-4df5-9adf-01160e553610 None None] MFA Rules not processed for user `12994145305841a8a221412aeddb4aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:20.056004 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a8159341-daa6-4df5-9adf-01160e553610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:20.132066 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1334/2713] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:14:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:20.136598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554eea2-8841-4d1f-8b5f-03fe4a878146 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:20.205385 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554eea2-8841-4d1f-8b5f-03fe4a878146 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:20.210525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cd4b0-1462-4a31-95b6-562060c3ec41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:20.211187 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cd4b0-1462-4a31-95b6-562060c3ec41 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:20.211474 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cd4b0-1462-4a31-95b6-562060c3ec41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:20.211750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cd4b0-1462-4a31-95b6-562060c3ec41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:20.212499 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cd4b0-1462-4a31-95b6-562060c3ec41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:20.214531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cd4b0-1462-4a31-95b6-562060c3ec41 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:20.240278 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1380/2714] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:14:20 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:14:20.244362 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8159341-daa6-4df5-9adf-01160e553610 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:20.258212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8159341-daa6-4df5-9adf-01160e553610 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:20.317275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4fc2db-10b2-4a86-9e87-6f5c344bb822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:20.317945 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fc2db-10b2-4a86-9e87-6f5c344bb822 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:20.318278 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fc2db-10b2-4a86-9e87-6f5c344bb822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:20.318557 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fc2db-10b2-4a86-9e87-6f5c344bb822 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:20.319252 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4fc2db-10b2-4a86-9e87-6f5c344bb822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:20.321178 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4fc2db-10b2-4a86-9e87-6f5c344bb822 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:20.342115 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1335/2715] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:14:20 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:14:20.345841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cd4b0-1462-4a31-95b6-562060c3ec41 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:20.357406 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cd4b0-1462-4a31-95b6-562060c3ec41 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:20.362044 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc118f01-2bea-4cc6-9a2f-d486346a8bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:20.362738 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc118f01-2bea-4cc6-9a2f-d486346a8bbe admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:20.363010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc118f01-2bea-4cc6-9a2f-d486346a8bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:20.363283 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc118f01-2bea-4cc6-9a2f-d486346a8bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:20.364003 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc118f01-2bea-4cc6-9a2f-d486346a8bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:20.365596 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc118f01-2bea-4cc6-9a2f-d486346a8bbe admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:20.377593 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1381/2716] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:14:20.382324 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4fc2db-10b2-4a86-9e87-6f5c344bb822 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:20.392483 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4fc2db-10b2-4a86-9e87-6f5c344bb822 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:20.397191 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3520c-1cdb-4bde-b26f-1fa93a0400ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:20.398095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3520c-1cdb-4bde-b26f-1fa93a0400ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:20.398387 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3520c-1cdb-4bde-b26f-1fa93a0400ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:20.398663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3520c-1cdb-4bde-b26f-1fa93a0400ea admin admin] PATH_INFO: `/v3/projects/0f15b8d8329f408b954f18813c23ffa4/users/17bbe77fa72f45a1bd262af25365c17e/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:20.414058 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3520c-1cdb-4bde-b26f-1fa93a0400ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f15b8d8329f408b954f18813c23ffa4, user_id=17bbe77fa72f45a1bd262af25365c17e, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:20.416788 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a3520c-1cdb-4bde-b26f-1fa93a0400ea admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:20.433441 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1336/2717] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:14:20 2022] PUT /identity/v3/projects/0f15b8d8329f408b954f18813c23ffa4/users/17bbe77fa72f45a1bd262af25365c17e/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:20.438338 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc118f01-2bea-4cc6-9a2f-d486346a8bbe admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:20.448259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc118f01-2bea-4cc6-9a2f-d486346a8bbe admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:20.469225 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:20.508803 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40046f0d-a0a7-4b0a-b855-6050f04a418d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:20.509389 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40046f0d-a0a7-4b0a-b855-6050f04a418d admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:20.509669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40046f0d-a0a7-4b0a-b855-6050f04a418d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:20.509945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40046f0d-a0a7-4b0a-b855-6050f04a418d admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:20.510701 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40046f0d-a0a7-4b0a-b855-6050f04a418d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:20.512300 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40046f0d-a0a7-4b0a-b855-6050f04a418d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:20.522687 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1382/2718] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:14:20.526911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3520c-1cdb-4bde-b26f-1fa93a0400ea admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:20.532904 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:20.539273 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3520c-1cdb-4bde-b26f-1fa93a0400ea admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:20.544955 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9a577-0668-4d30-8f03-28b92be87aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:20.545922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9a577-0668-4d30-8f03-28b92be87aef admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:20.546248 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9a577-0668-4d30-8f03-28b92be87aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:20.546428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9a577-0668-4d30-8f03-28b92be87aef admin admin] PATH_INFO: `/v3/projects/0f15b8d8329f408b954f18813c23ffa4/users/17bbe77fa72f45a1bd262af25365c17e/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:20.548442 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9a577-0668-4d30-8f03-28b92be87aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f15b8d8329f408b954f18813c23ffa4, user_id=17bbe77fa72f45a1bd262af25365c17e, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:20.551135 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9a577-0668-4d30-8f03-28b92be87aef admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:20.562368 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1337/2719] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:14:20 2022] PUT /identity/v3/projects/0f15b8d8329f408b954f18813c23ffa4/users/17bbe77fa72f45a1bd262af25365c17e/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:20.573691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58b6d0-2a23-4f13-8392-a659ca1706e3 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:20.573988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58b6d0-2a23-4f13-8392-a659ca1706e3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:20.574307 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58b6d0-2a23-4f13-8392-a659ca1706e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:20.602017 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-9b58b6d0-2a23-4f13-8392-a659ca1706e3 None None] MFA Rules not processed for user `17bbe77fa72f45a1bd262af25365c17e`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:20.603285 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9b58b6d0-2a23-4f13-8392-a659ca1706e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:20.673428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1383/2720] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:14:20 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:20.684864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9a577-0668-4d30-8f03-28b92be87aef admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:20.686756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-e4f9a577-0668-4d30-8f03-28b92be87aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:20.748875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9a577-0668-4d30-8f03-28b92be87aef admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:20.752884 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad33bd5-3573-4493-9d30-87d52826c592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:20.753696 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad33bd5-3573-4493-9d30-87d52826c592 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:20.753987 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad33bd5-3573-4493-9d30-87d52826c592 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:20.754482 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad33bd5-3573-4493-9d30-87d52826c592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:20.764886 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad33bd5-3573-4493-9d30-87d52826c592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:20.766871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad33bd5-3573-4493-9d30-87d52826c592 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:20.778893 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1338/2721] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:14:20 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:14:20.829816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58b6d0-2a23-4f13-8392-a659ca1706e3 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:20.831435 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9b58b6d0-2a23-4f13-8392-a659ca1706e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:20.844076 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58b6d0-2a23-4f13-8392-a659ca1706e3 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:20.847663 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d105281-f7aa-4c36-a0e0-b67b1461fef3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:20.848309 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d105281-f7aa-4c36-a0e0-b67b1461fef3 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:20.848595 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d105281-f7aa-4c36-a0e0-b67b1461fef3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:20.848867 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d105281-f7aa-4c36-a0e0-b67b1461fef3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:20.915155 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d105281-f7aa-4c36-a0e0-b67b1461fef3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:20.916661 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d105281-f7aa-4c36-a0e0-b67b1461fef3 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:20.926841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1384/2722] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:14:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:14:24.441002 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad33bd5-3573-4493-9d30-87d52826c592 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:24.506048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad33bd5-3573-4493-9d30-87d52826c592 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:24.510866 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532185ef-7b88-4c0a-b13a-f80fc4fac3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:24.511864 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532185ef-7b88-4c0a-b13a-f80fc4fac3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:24.512812 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532185ef-7b88-4c0a-b13a-f80fc4fac3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:24.513212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532185ef-7b88-4c0a-b13a-f80fc4fac3e3 admin admin] PATH_INFO: `/v3/users/12994145305841a8a221412aeddb4aac` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:24.514604 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532185ef-7b88-4c0a-b13a-f80fc4fac3e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12994145305841a8a221412aeddb4aac)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:24.516544 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532185ef-7b88-4c0a-b13a-f80fc4fac3e3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:24.569336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-532185ef-7b88-4c0a-b13a-f80fc4fac3e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12994145305841a8a221412aeddb4aac'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:24.577170 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-532185ef-7b88-4c0a-b13a-f80fc4fac3e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12994145305841a8a221412aeddb4aac'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:24.590599 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-532185ef-7b88-4c0a-b13a-f80fc4fac3e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12994145305841a8a221412aeddb4aac'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:24.598577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-532185ef-7b88-4c0a-b13a-f80fc4fac3e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12994145305841a8a221412aeddb4aac'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:24.599306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-532185ef-7b88-4c0a-b13a-f80fc4fac3e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12994145305841a8a221412aeddb4aac'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:24.606472 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1339/2723] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:14:24 2022] DELETE /identity/v3/users/12994145305841a8a221412aeddb4aac => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:24.611511 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c919-69d6-4081-8139-4327bef4555e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:24.612409 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c919-69d6-4081-8139-4327bef4555e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:24.612698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1c919-69d6-4081-8139-4327bef4555e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:24.633641 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e0d1c919-69d6-4081-8139-4327bef4555e None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:24.634904 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e0d1c919-69d6-4081-8139-4327bef4555e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:24.677924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:24.698755 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1385/2724] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:24.708988 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532185ef-7b88-4c0a-b13a-f80fc4fac3e3 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:24.710504 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-532185ef-7b88-4c0a-b13a-f80fc4fac3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:24.725097 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:24.772948 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532185ef-7b88-4c0a-b13a-f80fc4fac3e3 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:24.776844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e230b32-9e87-48c2-86a5-2eb1578177fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:24.777520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e230b32-9e87-48c2-86a5-2eb1578177fa service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:24.777803 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e230b32-9e87-48c2-86a5-2eb1578177fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:24.778095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e230b32-9e87-48c2-86a5-2eb1578177fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:24.788407 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e230b32-9e87-48c2-86a5-2eb1578177fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:24.789855 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e230b32-9e87-48c2-86a5-2eb1578177fa service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:24.802111 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1340/2725] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:14:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:14:25.177239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1c919-69d6-4081-8139-4327bef4555e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:25.178706 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e0d1c919-69d6-4081-8139-4327bef4555e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:25.193021 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1c919-69d6-4081-8139-4327bef4555e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:25.197589 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fed2f-4ed6-467b-a21b-fe84206c17dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:25.198500 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fed2f-4ed6-467b-a21b-fe84206c17dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:25.198782 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fed2f-4ed6-467b-a21b-fe84206c17dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:25.199053 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fed2f-4ed6-467b-a21b-fe84206c17dd admin admin] PATH_INFO: `/v3/projects/ab7a1be076344538a97f491df7c65902` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:25.200332 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fed2f-4ed6-467b-a21b-fe84206c17dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab7a1be076344538a97f491df7c65902)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:25.202469 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fed2f-4ed6-467b-a21b-fe84206c17dd admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:25.253824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8b5fed2f-4ed6-467b-a21b-fe84206c17dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab7a1be076344538a97f491df7c65902', 'request_id': 'req-8b5fed2f-4ed6-467b-a21b-fe84206c17dd'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.259499 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8b5fed2f-4ed6-467b-a21b-fe84206c17dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab7a1be076344538a97f491df7c65902', 'request_id': 'req-8b5fed2f-4ed6-467b-a21b-fe84206c17dd'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.266597 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8b5fed2f-4ed6-467b-a21b-fe84206c17dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab7a1be076344538a97f491df7c65902', 'request_id': 'req-8b5fed2f-4ed6-467b-a21b-fe84206c17dd'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.278764 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8b5fed2f-4ed6-467b-a21b-fe84206c17dd admin admin] The token cache is being invalidate because project ab7a1be076344538a97f491df7c65902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:14:25.279053 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8b5fed2f-4ed6-467b-a21b-fe84206c17dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.279710 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8b5fed2f-4ed6-467b-a21b-fe84206c17dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.281259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1386/2726] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:14:25 2022] DELETE /identity/v3/projects/ab7a1be076344538a97f491df7c65902 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:25.286176 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e230b32-9e87-48c2-86a5-2eb1578177fa service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:25.297462 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e230b32-9e87-48c2-86a5-2eb1578177fa service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:25.358847 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2003e7-4b43-42ce-b35c-f2f7973b8973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:25.359710 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2003e7-4b43-42ce-b35c-f2f7973b8973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:25.359993 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2003e7-4b43-42ce-b35c-f2f7973b8973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:25.360270 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2003e7-4b43-42ce-b35c-f2f7973b8973 admin admin] PATH_INFO: `/v3/users/17bbe77fa72f45a1bd262af25365c17e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:25.361447 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2003e7-4b43-42ce-b35c-f2f7973b8973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17bbe77fa72f45a1bd262af25365c17e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:25.363418 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2003e7-4b43-42ce-b35c-f2f7973b8973 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:25.410434 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5e2003e7-4b43-42ce-b35c-f2f7973b8973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17bbe77fa72f45a1bd262af25365c17e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.417712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5e2003e7-4b43-42ce-b35c-f2f7973b8973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17bbe77fa72f45a1bd262af25365c17e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.431664 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5e2003e7-4b43-42ce-b35c-f2f7973b8973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17bbe77fa72f45a1bd262af25365c17e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.440002 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5e2003e7-4b43-42ce-b35c-f2f7973b8973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17bbe77fa72f45a1bd262af25365c17e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.440678 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-5e2003e7-4b43-42ce-b35c-f2f7973b8973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17bbe77fa72f45a1bd262af25365c17e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.446755 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1341/2727] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:14:25 2022] DELETE /identity/v3/users/17bbe77fa72f45a1bd262af25365c17e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:25.727862 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fed2f-4ed6-467b-a21b-fe84206c17dd admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:25.729753 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8b5fed2f-4ed6-467b-a21b-fe84206c17dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:25.746828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fed2f-4ed6-467b-a21b-fe84206c17dd admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:25.818056 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb673c-e780-4681-8919-96647ff94f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:25.818884 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb673c-e780-4681-8919-96647ff94f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:25.819173 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb673c-e780-4681-8919-96647ff94f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:25.819454 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb673c-e780-4681-8919-96647ff94f27 admin admin] PATH_INFO: `/v3/projects/0f15b8d8329f408b954f18813c23ffa4` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:25.820672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb673c-e780-4681-8919-96647ff94f27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f15b8d8329f408b954f18813c23ffa4)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:25.822628 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb673c-e780-4681-8919-96647ff94f27 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:25.872077 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8bbb673c-e780-4681-8919-96647ff94f27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f15b8d8329f408b954f18813c23ffa4', 'request_id': 'req-8bbb673c-e780-4681-8919-96647ff94f27'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.878114 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8bbb673c-e780-4681-8919-96647ff94f27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f15b8d8329f408b954f18813c23ffa4', 'request_id': 'req-8bbb673c-e780-4681-8919-96647ff94f27'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.886458 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8bbb673c-e780-4681-8919-96647ff94f27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f15b8d8329f408b954f18813c23ffa4', 'request_id': 'req-8bbb673c-e780-4681-8919-96647ff94f27'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.895285 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:25.900438 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8bbb673c-e780-4681-8919-96647ff94f27 admin admin] The token cache is being invalidate because project 0f15b8d8329f408b954f18813c23ffa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:14:25.901487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8bbb673c-e780-4681-8919-96647ff94f27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.905191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8bbb673c-e780-4681-8919-96647ff94f27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:25.905191 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1387/2728] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:14:25 2022] DELETE /identity/v3/projects/0f15b8d8329f408b954f18813c23ffa4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:14:25.911950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821611e-1aa7-4a35-b6f5-db7e6bd1765e None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:25.912730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821611e-1aa7-4a35-b6f5-db7e6bd1765e None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:25.913043 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821611e-1aa7-4a35-b6f5-db7e6bd1765e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:25.934603 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c821611e-1aa7-4a35-b6f5-db7e6bd1765e None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:25.936221 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c821611e-1aa7-4a35-b6f5-db7e6bd1765e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:25.969842 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:26.003048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1342/2729] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:26.011171 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e43c9-2538-4fd3-aace-ea359bd73705 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.011556 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e43c9-2538-4fd3-aace-ea359bd73705 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.012883 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e43c9-2538-4fd3-aace-ea359bd73705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.035397 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-753e43c9-2538-4fd3-aace-ea359bd73705 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:26.036648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-753e43c9-2538-4fd3-aace-ea359bd73705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:26.045594 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1388/2730] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:26.049808 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821611e-1aa7-4a35-b6f5-db7e6bd1765e None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:26.062395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821611e-1aa7-4a35-b6f5-db7e6bd1765e None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:26.066870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d088b-d63a-4482-ae7b-d169d579a830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:26.067829 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d088b-d63a-4482-ae7b-d169d579a830 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.068382 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d088b-d63a-4482-ae7b-d169d579a830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.068641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d088b-d63a-4482-ae7b-d169d579a830 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.069386 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d088b-d63a-4482-ae7b-d169d579a830 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:14:26.069696 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d088b-d63a-4482-ae7b-d169d579a830 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:26.071400 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d088b-d63a-4482-ae7b-d169d579a830 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:26.086482 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1343/2731] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:14:26.090055 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e43c9-2538-4fd3-aace-ea359bd73705 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:26.100347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e43c9-2538-4fd3-aace-ea359bd73705 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:26.106650 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76584f-e168-4ba3-bc0c-c60155b8efee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:26.107169 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76584f-e168-4ba3-bc0c-c60155b8efee admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.107466 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76584f-e168-4ba3-bc0c-c60155b8efee admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.107778 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76584f-e168-4ba3-bc0c-c60155b8efee admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.108686 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76584f-e168-4ba3-bc0c-c60155b8efee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:26.111428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a76584f-e168-4ba3-bc0c-c60155b8efee admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:26.143085 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1389/2732] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:14:26 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:14:26.147428 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d088b-d63a-4482-ae7b-d169d579a830 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:26.158906 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d088b-d63a-4482-ae7b-d169d579a830 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:26.218433 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019edb9f-d2ed-414d-a4e8-3b53a135e4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:26.219147 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019edb9f-d2ed-414d-a4e8-3b53a135e4c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.219462 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019edb9f-d2ed-414d-a4e8-3b53a135e4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.219743 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019edb9f-d2ed-414d-a4e8-3b53a135e4c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.220443 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019edb9f-d2ed-414d-a4e8-3b53a135e4c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:26.222607 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019edb9f-d2ed-414d-a4e8-3b53a135e4c0 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:26.243432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1344/2733] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:14:26 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:14:26.248622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76584f-e168-4ba3-bc0c-c60155b8efee admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:26.259245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76584f-e168-4ba3-bc0c-c60155b8efee admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:26.265927 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7385f3-cc3e-412d-a728-ab09c5f71f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:26.265927 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7385f3-cc3e-412d-a728-ab09c5f71f51 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.266558 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7385f3-cc3e-412d-a728-ab09c5f71f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.266776 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7385f3-cc3e-412d-a728-ab09c5f71f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.267599 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7385f3-cc3e-412d-a728-ab09c5f71f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:26.269958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7385f3-cc3e-412d-a728-ab09c5f71f51 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:26.281592 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1390/2734] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:14:26.286000 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019edb9f-d2ed-414d-a4e8-3b53a135e4c0 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:26.297347 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019edb9f-d2ed-414d-a4e8-3b53a135e4c0 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:26.303547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d4235-5961-4fbd-8873-c5de72a2efd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:26.304237 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d4235-5961-4fbd-8873-c5de72a2efd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.304524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d4235-5961-4fbd-8873-c5de72a2efd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.304801 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d4235-5961-4fbd-8873-c5de72a2efd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.305554 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d4235-5961-4fbd-8873-c5de72a2efd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:26.307252 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d4235-5961-4fbd-8873-c5de72a2efd4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:26.320158 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1345/2735] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:14:26.324689 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7385f3-cc3e-412d-a728-ab09c5f71f51 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:26.334852 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7385f3-cc3e-412d-a728-ab09c5f71f51 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:26.339604 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663d503-c7d2-4c0e-8613-190624a85796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:26.341061 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663d503-c7d2-4c0e-8613-190624a85796 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.341344 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663d503-c7d2-4c0e-8613-190624a85796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.341623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663d503-c7d2-4c0e-8613-190624a85796 admin admin] PATH_INFO: `/v3/projects/694490cd2cdc4adab82d646815a35cc7/users/2043d1a644b44e55b2e5742bbe04e4cb/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.357077 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663d503-c7d2-4c0e-8613-190624a85796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=694490cd2cdc4adab82d646815a35cc7, user_id=2043d1a644b44e55b2e5742bbe04e4cb, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:26.359852 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663d503-c7d2-4c0e-8613-190624a85796 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:26.373935 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1391/2736] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:14:26 2022] PUT /identity/v3/projects/694490cd2cdc4adab82d646815a35cc7/users/2043d1a644b44e55b2e5742bbe04e4cb/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:26.384673 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07771fd-8efb-4623-8ba2-eca3ce0bf72b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.384968 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07771fd-8efb-4623-8ba2-eca3ce0bf72b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.385257 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07771fd-8efb-4623-8ba2-eca3ce0bf72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.411756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b07771fd-8efb-4623-8ba2-eca3ce0bf72b None None] MFA Rules not processed for user `2043d1a644b44e55b2e5742bbe04e4cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:26.412979 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b07771fd-8efb-4623-8ba2-eca3ce0bf72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:26.481008 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1346/2737] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:14:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:26.485694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663d503-c7d2-4c0e-8613-190624a85796 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:26.551475 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663d503-c7d2-4c0e-8613-190624a85796 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:26.556281 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59a621-bab0-4bde-aa42-7e2bc6e28314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:26.556946 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59a621-bab0-4bde-aa42-7e2bc6e28314 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.557235 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59a621-bab0-4bde-aa42-7e2bc6e28314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.557516 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59a621-bab0-4bde-aa42-7e2bc6e28314 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.558259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59a621-bab0-4bde-aa42-7e2bc6e28314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:26.560538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59a621-bab0-4bde-aa42-7e2bc6e28314 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:26.587636 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1392/2738] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:14:26 2022] POST /identity/v3/projects => generated 389 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:14:26.592851 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07771fd-8efb-4623-8ba2-eca3ce0bf72b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:26.603433 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07771fd-8efb-4623-8ba2-eca3ce0bf72b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:26.635781 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:26.667385 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aff323-c3c6-4914-bfdf-1b06baa46643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:26.668640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aff323-c3c6-4914-bfdf-1b06baa46643 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.668928 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aff323-c3c6-4914-bfdf-1b06baa46643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.669285 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aff323-c3c6-4914-bfdf-1b06baa46643 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.670123 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aff323-c3c6-4914-bfdf-1b06baa46643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:26.672022 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aff323-c3c6-4914-bfdf-1b06baa46643 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:26.692096 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1347/2739] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:14:26 2022] POST /identity/v3/users => generated 301 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:14:26.696244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59a621-bab0-4bde-aa42-7e2bc6e28314 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:26.707226 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59a621-bab0-4bde-aa42-7e2bc6e28314 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:26.711919 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e662b-b18c-453d-87f5-70ccedba9170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:26.712571 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e662b-b18c-453d-87f5-70ccedba9170 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.712853 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e662b-b18c-453d-87f5-70ccedba9170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.713127 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e662b-b18c-453d-87f5-70ccedba9170 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.713847 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e662b-b18c-453d-87f5-70ccedba9170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:26.716009 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e662b-b18c-453d-87f5-70ccedba9170 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:26.726781 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1393/2740] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:14:26.732185 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aff323-c3c6-4914-bfdf-1b06baa46643 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:26.742446 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aff323-c3c6-4914-bfdf-1b06baa46643 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:26.747922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e4630-7ea0-41f6-99ac-49c61489798f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:26.748813 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e4630-7ea0-41f6-99ac-49c61489798f admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.749094 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e4630-7ea0-41f6-99ac-49c61489798f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.749370 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e4630-7ea0-41f6-99ac-49c61489798f admin admin] PATH_INFO: `/v3/projects/6ef6ad8f19024e2cb7afdf6822ed7ac9/users/721b805fa7fe4bff9239b3c20e4b4e09/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.765340 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e4630-7ea0-41f6-99ac-49c61489798f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef6ad8f19024e2cb7afdf6822ed7ac9, user_id=721b805fa7fe4bff9239b3c20e4b4e09, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:26.768102 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e4630-7ea0-41f6-99ac-49c61489798f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:26.781423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1348/2741] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:14:26 2022] PUT /identity/v3/projects/6ef6ad8f19024e2cb7afdf6822ed7ac9/users/721b805fa7fe4bff9239b3c20e4b4e09/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:26.785408 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e662b-b18c-453d-87f5-70ccedba9170 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:26.796025 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e662b-b18c-453d-87f5-70ccedba9170 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:26.853159 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98c291-0c1a-450a-a712-223443f5b928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:26.853733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98c291-0c1a-450a-a712-223443f5b928 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.854041 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98c291-0c1a-450a-a712-223443f5b928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.854351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98c291-0c1a-450a-a712-223443f5b928 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.855066 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98c291-0c1a-450a-a712-223443f5b928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:26.857370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98c291-0c1a-450a-a712-223443f5b928 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:26.867179 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1394/2742] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:14:26.873697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e4630-7ea0-41f6-99ac-49c61489798f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:26.885985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e4630-7ea0-41f6-99ac-49c61489798f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:26.890929 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dba518-0f37-4e31-bc03-b302310d35c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:26.891814 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dba518-0f37-4e31-bc03-b302310d35c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.892126 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dba518-0f37-4e31-bc03-b302310d35c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.892400 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dba518-0f37-4e31-bc03-b302310d35c7 admin admin] PATH_INFO: `/v3/projects/6ef6ad8f19024e2cb7afdf6822ed7ac9/users/721b805fa7fe4bff9239b3c20e4b4e09/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.894588 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dba518-0f37-4e31-bc03-b302310d35c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef6ad8f19024e2cb7afdf6822ed7ac9, user_id=721b805fa7fe4bff9239b3c20e4b4e09, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:26.897251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dba518-0f37-4e31-bc03-b302310d35c7 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:26.908110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1349/2743] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:14:26 2022] PUT /identity/v3/projects/6ef6ad8f19024e2cb7afdf6822ed7ac9/users/721b805fa7fe4bff9239b3c20e4b4e09/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:26.920067 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b07ea-fe04-4a3b-99b5-2f309d602790 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:26.920370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b07ea-fe04-4a3b-99b5-2f309d602790 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:26.920660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b07ea-fe04-4a3b-99b5-2f309d602790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:26.927580 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:26.949257 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c97b07ea-fe04-4a3b-99b5-2f309d602790 None None] MFA Rules not processed for user `721b805fa7fe4bff9239b3c20e4b4e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:26.950600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c97b07ea-fe04-4a3b-99b5-2f309d602790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:27.023458 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1395/2744] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:14:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:27.034978 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dba518-0f37-4e31-bc03-b302310d35c7 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:27.036747 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-f1dba518-0f37-4e31-bc03-b302310d35c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:27.097599 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dba518-0f37-4e31-bc03-b302310d35c7 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:27.101372 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fe6b7-a6db-45ed-956d-8fb6a7f79a6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:27.102016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fe6b7-a6db-45ed-956d-8fb6a7f79a6d service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:27.102327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fe6b7-a6db-45ed-956d-8fb6a7f79a6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:27.102600 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fe6b7-a6db-45ed-956d-8fb6a7f79a6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:27.112728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fe6b7-a6db-45ed-956d-8fb6a7f79a6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:27.114150 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fe6b7-a6db-45ed-956d-8fb6a7f79a6d service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:27.124813 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1350/2745] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:14:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:14:27.264859 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b07ea-fe04-4a3b-99b5-2f309d602790 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:27.339455 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b07ea-fe04-4a3b-99b5-2f309d602790 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:27.344434 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dbfd4-8077-4766-83d5-4366477039fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:27.345313 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dbfd4-8077-4766-83d5-4366477039fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:27.345604 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dbfd4-8077-4766-83d5-4366477039fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:27.345886 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016dbfd4-8077-4766-83d5-4366477039fa admin admin] PATH_INFO: `/v3/users/2043d1a644b44e55b2e5742bbe04e4cb` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:27.347123 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016dbfd4-8077-4766-83d5-4366477039fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=2043d1a644b44e55b2e5742bbe04e4cb)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:27.349058 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016dbfd4-8077-4766-83d5-4366477039fa admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:27.400056 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-016dbfd4-8077-4766-83d5-4366477039fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2043d1a644b44e55b2e5742bbe04e4cb'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:27.400602 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-016dbfd4-8077-4766-83d5-4366477039fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2043d1a644b44e55b2e5742bbe04e4cb'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:27.407546 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-016dbfd4-8077-4766-83d5-4366477039fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2043d1a644b44e55b2e5742bbe04e4cb'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:27.414948 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-016dbfd4-8077-4766-83d5-4366477039fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2043d1a644b44e55b2e5742bbe04e4cb'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:27.428870 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-016dbfd4-8077-4766-83d5-4366477039fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2043d1a644b44e55b2e5742bbe04e4cb'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:27.436608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1396/2746] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:14:27 2022] DELETE /identity/v3/users/2043d1a644b44e55b2e5742bbe04e4cb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:27.440989 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210f373-1dd2-4d61-86b8-01941f6e848b None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:27.441273 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210f373-1dd2-4d61-86b8-01941f6e848b None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:27.441554 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210f373-1dd2-4d61-86b8-01941f6e848b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:27.460057 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-b210f373-1dd2-4d61-86b8-01941f6e848b None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:27.461283 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b210f373-1dd2-4d61-86b8-01941f6e848b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:27.521676 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1351/2747] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:27.532573 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dbfd4-8077-4766-83d5-4366477039fa admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:27.534016 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-016dbfd4-8077-4766-83d5-4366477039fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:27.546468 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:27.597082 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016dbfd4-8077-4766-83d5-4366477039fa admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:27.600717 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9921ed-0594-4180-8f3c-559ea60d80ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:27.601424 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9921ed-0594-4180-8f3c-559ea60d80ec service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:27.601730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9921ed-0594-4180-8f3c-559ea60d80ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:27.602005 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9921ed-0594-4180-8f3c-559ea60d80ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:27.611876 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9921ed-0594-4180-8f3c-559ea60d80ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:27.613305 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9921ed-0594-4180-8f3c-559ea60d80ec service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:27.622990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1397/2748] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:14:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:14:27.895563 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210f373-1dd2-4d61-86b8-01941f6e848b None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:27.897249 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b210f373-1dd2-4d61-86b8-01941f6e848b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:27.911267 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210f373-1dd2-4d61-86b8-01941f6e848b None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:27.916306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d89aae-3ab9-4cc1-a76d-750d28f9be4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:27.917450 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d89aae-3ab9-4cc1-a76d-750d28f9be4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:27.917737 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d89aae-3ab9-4cc1-a76d-750d28f9be4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:27.918641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d89aae-3ab9-4cc1-a76d-750d28f9be4d admin admin] PATH_INFO: `/v3/projects/694490cd2cdc4adab82d646815a35cc7` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:27.919891 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d89aae-3ab9-4cc1-a76d-750d28f9be4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=694490cd2cdc4adab82d646815a35cc7)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:27.921816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d89aae-3ab9-4cc1-a76d-750d28f9be4d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:27.944373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:27.973080 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c3d89aae-3ab9-4cc1-a76d-750d28f9be4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '694490cd2cdc4adab82d646815a35cc7', 'request_id': 'req-c3d89aae-3ab9-4cc1-a76d-750d28f9be4d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:27.979922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c3d89aae-3ab9-4cc1-a76d-750d28f9be4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '694490cd2cdc4adab82d646815a35cc7', 'request_id': 'req-c3d89aae-3ab9-4cc1-a76d-750d28f9be4d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:27.986843 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c3d89aae-3ab9-4cc1-a76d-750d28f9be4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '694490cd2cdc4adab82d646815a35cc7', 'request_id': 'req-c3d89aae-3ab9-4cc1-a76d-750d28f9be4d'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:28.000590 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c3d89aae-3ab9-4cc1-a76d-750d28f9be4d admin admin] The token cache is being invalidate because project 694490cd2cdc4adab82d646815a35cc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:14:28.000883 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c3d89aae-3ab9-4cc1-a76d-750d28f9be4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:28.001520 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c3d89aae-3ab9-4cc1-a76d-750d28f9be4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:28.003578 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1352/2749] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:14:27 2022] DELETE /identity/v3/projects/694490cd2cdc4adab82d646815a35cc7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:28.007387 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9921ed-0594-4180-8f3c-559ea60d80ec service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:28.018014 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9921ed-0594-4180-8f3c-559ea60d80ec service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:28.088768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bfe00-8afb-4e58-b374-f0263b7a771f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:28.090458 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bfe00-8afb-4e58-b374-f0263b7a771f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:28.090826 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bfe00-8afb-4e58-b374-f0263b7a771f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:28.091340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bfe00-8afb-4e58-b374-f0263b7a771f admin admin] PATH_INFO: `/v3/users/721b805fa7fe4bff9239b3c20e4b4e09` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:28.093239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3bfe00-8afb-4e58-b374-f0263b7a771f admin admin] RBAC: Authorizing `identity:delete_user(user_id=721b805fa7fe4bff9239b3c20e4b4e09)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:28.095345 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3bfe00-8afb-4e58-b374-f0263b7a771f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:28.164798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ec3bfe00-8afb-4e58-b374-f0263b7a771f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '721b805fa7fe4bff9239b3c20e4b4e09'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:28.165990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ec3bfe00-8afb-4e58-b374-f0263b7a771f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '721b805fa7fe4bff9239b3c20e4b4e09'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:28.175244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ec3bfe00-8afb-4e58-b374-f0263b7a771f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '721b805fa7fe4bff9239b3c20e4b4e09'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:28.186332 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ec3bfe00-8afb-4e58-b374-f0263b7a771f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '721b805fa7fe4bff9239b3c20e4b4e09'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:28.206435 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ec3bfe00-8afb-4e58-b374-f0263b7a771f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '721b805fa7fe4bff9239b3c20e4b4e09'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:28.214113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1398/2750] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:14:28 2022] DELETE /identity/v3/users/721b805fa7fe4bff9239b3c20e4b4e09 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:28.803964 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d89aae-3ab9-4cc1-a76d-750d28f9be4d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:28.806772 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c3d89aae-3ab9-4cc1-a76d-750d28f9be4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:28.849482 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d89aae-3ab9-4cc1-a76d-750d28f9be4d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:28.933144 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8eb3b3-c30a-4453-b943-6af49e991749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:28.933144 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8eb3b3-c30a-4453-b943-6af49e991749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:28.933489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8eb3b3-c30a-4453-b943-6af49e991749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:28.933655 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8eb3b3-c30a-4453-b943-6af49e991749 admin admin] PATH_INFO: `/v3/projects/6ef6ad8f19024e2cb7afdf6822ed7ac9` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:28.935238 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8eb3b3-c30a-4453-b943-6af49e991749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef6ad8f19024e2cb7afdf6822ed7ac9)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:28.937443 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8eb3b3-c30a-4453-b943-6af49e991749 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:28.997133 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0e8eb3b3-c30a-4453-b943-6af49e991749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef6ad8f19024e2cb7afdf6822ed7ac9', 'request_id': 'req-0e8eb3b3-c30a-4453-b943-6af49e991749'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:29.006915 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0e8eb3b3-c30a-4453-b943-6af49e991749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef6ad8f19024e2cb7afdf6822ed7ac9', 'request_id': 'req-0e8eb3b3-c30a-4453-b943-6af49e991749'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:29.015411 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0e8eb3b3-c30a-4453-b943-6af49e991749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef6ad8f19024e2cb7afdf6822ed7ac9', 'request_id': 'req-0e8eb3b3-c30a-4453-b943-6af49e991749'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:29.034354 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0e8eb3b3-c30a-4453-b943-6af49e991749 admin admin] The token cache is being invalidate because project 6ef6ad8f19024e2cb7afdf6822ed7ac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:14:29.034677 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0e8eb3b3-c30a-4453-b943-6af49e991749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:29.035423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-0e8eb3b3-c30a-4453-b943-6af49e991749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:29.038169 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1353/2751] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:14:28 2022] DELETE /identity/v3/projects/6ef6ad8f19024e2cb7afdf6822ed7ac9 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:29.042493 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74601f85-6ce0-4fc7-b8e9-72f3e0029cda None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:29.043571 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74601f85-6ce0-4fc7-b8e9-72f3e0029cda None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:29.043664 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74601f85-6ce0-4fc7-b8e9-72f3e0029cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:29.070138 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-74601f85-6ce0-4fc7-b8e9-72f3e0029cda None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:29.071428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-74601f85-6ce0-4fc7-b8e9-72f3e0029cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:29.117223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:29.171266 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1399/2752] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:29.173399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0500ae-bf9f-48c6-bda4-8e46785167b2 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:29.173696 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0500ae-bf9f-48c6-bda4-8e46785167b2 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:29.173973 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0500ae-bf9f-48c6-bda4-8e46785167b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:29.193466 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-5c0500ae-bf9f-48c6-bda4-8e46785167b2 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:29.194727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5c0500ae-bf9f-48c6-bda4-8e46785167b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:29.203984 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1354/2753] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:29.208244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74601f85-6ce0-4fc7-b8e9-72f3e0029cda None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:29.220389 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74601f85-6ce0-4fc7-b8e9-72f3e0029cda None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:29.225289 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7406076-0122-4b92-86e8-1dabd65d43ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:29.225994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7406076-0122-4b92-86e8-1dabd65d43ab admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:29.226313 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7406076-0122-4b92-86e8-1dabd65d43ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:29.226642 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7406076-0122-4b92-86e8-1dabd65d43ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:29.227379 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7406076-0122-4b92-86e8-1dabd65d43ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:14:29.227715 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7406076-0122-4b92-86e8-1dabd65d43ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:29.229368 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7406076-0122-4b92-86e8-1dabd65d43ab admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:29.242924 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1400/2754] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:14:29.248255 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0500ae-bf9f-48c6-bda4-8e46785167b2 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:29.258664 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0500ae-bf9f-48c6-bda4-8e46785167b2 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:29.263602 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c6112-78e5-4d9c-884d-516737b0f090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:29.264217 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c6112-78e5-4d9c-884d-516737b0f090 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:29.264500 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c6112-78e5-4d9c-884d-516737b0f090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:29.264777 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c6112-78e5-4d9c-884d-516737b0f090 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:29.265470 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c6112-78e5-4d9c-884d-516737b0f090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:29.267431 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7c6112-78e5-4d9c-884d-516737b0f090 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:29.299250 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1355/2755] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:14:29 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:14:29.303289 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7406076-0122-4b92-86e8-1dabd65d43ab admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:29.318323 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7406076-0122-4b92-86e8-1dabd65d43ab admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:29.386376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfce027-262d-427e-ac24-4361c61d8d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:29.387409 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfce027-262d-427e-ac24-4361c61d8d6a admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:29.387810 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfce027-262d-427e-ac24-4361c61d8d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:29.388982 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfce027-262d-427e-ac24-4361c61d8d6a admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:29.389611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfce027-262d-427e-ac24-4361c61d8d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:29.391658 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfce027-262d-427e-ac24-4361c61d8d6a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:29.416300 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1401/2756] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:14:29 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:14:29.425225 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c6112-78e5-4d9c-884d-516737b0f090 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:29.437961 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c6112-78e5-4d9c-884d-516737b0f090 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:29.443170 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92ae02-086c-43af-bfef-54234400ff36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:29.443953 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92ae02-086c-43af-bfef-54234400ff36 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:29.444313 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92ae02-086c-43af-bfef-54234400ff36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:29.444665 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92ae02-086c-43af-bfef-54234400ff36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:29.445492 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b92ae02-086c-43af-bfef-54234400ff36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:29.447219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b92ae02-086c-43af-bfef-54234400ff36 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:29.450253 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:29.465924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1356/2757] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:14:29.466130 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfce027-262d-427e-ac24-4361c61d8d6a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:29.485549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfce027-262d-427e-ac24-4361c61d8d6a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:29.490963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f75570-8508-4b29-86ee-bd28dbf626a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:29.491718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f75570-8508-4b29-86ee-bd28dbf626a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:29.492067 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f75570-8508-4b29-86ee-bd28dbf626a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:29.492440 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f75570-8508-4b29-86ee-bd28dbf626a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:29.493254 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f75570-8508-4b29-86ee-bd28dbf626a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:29.494976 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f75570-8508-4b29-86ee-bd28dbf626a5 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:29.508779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1402/2758] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 16:14:29.513306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92ae02-086c-43af-bfef-54234400ff36 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:29.523585 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92ae02-086c-43af-bfef-54234400ff36 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:29.530181 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6aded-2390-4612-b453-68d92acbab9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:29.531122 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6aded-2390-4612-b453-68d92acbab9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:29.531515 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6aded-2390-4612-b453-68d92acbab9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:29.531918 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6aded-2390-4612-b453-68d92acbab9b admin admin] PATH_INFO: `/v3/projects/c8a9c61af1634730bffd94759f02358f/users/6f29b4d80e5c44aabbc4aa8cc8fbd7d7/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:29.548596 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6aded-2390-4612-b453-68d92acbab9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a9c61af1634730bffd94759f02358f, user_id=6f29b4d80e5c44aabbc4aa8cc8fbd7d7, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:29.551244 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6aded-2390-4612-b453-68d92acbab9b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:29.566762 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1357/2759] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:14:29 2022] PUT /identity/v3/projects/c8a9c61af1634730bffd94759f02358f/users/6f29b4d80e5c44aabbc4aa8cc8fbd7d7/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:29.577365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890852f-4e8d-4fc9-a2c1-76f25cc5f1d8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:29.577691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890852f-4e8d-4fc9-a2c1-76f25cc5f1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:29.577994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890852f-4e8d-4fc9-a2c1-76f25cc5f1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:29.608070 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e890852f-4e8d-4fc9-a2c1-76f25cc5f1d8 None None] MFA Rules not processed for user `6f29b4d80e5c44aabbc4aa8cc8fbd7d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:29.609292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e890852f-4e8d-4fc9-a2c1-76f25cc5f1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:29.687306 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1403/2760] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:14:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:29.698662 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6aded-2390-4612-b453-68d92acbab9b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:29.705676 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6ba6aded-2390-4612-b453-68d92acbab9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:29.855884 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6aded-2390-4612-b453-68d92acbab9b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:29.860024 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd1218-dc63-45d4-a64b-a2ac69c70161 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14c582c1127142f8a4ebf64bb7b34516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:29.860681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd1218-dc63-45d4-a64b-a2ac69c70161 service glance] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:29.860967 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd1218-dc63-45d4-a64b-a2ac69c70161 service glance] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:29.861239 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd1218-dc63-45d4-a64b-a2ac69c70161 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:29.877114 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd1218-dc63-45d4-a64b-a2ac69c70161 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:29.879022 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd1218-dc63-45d4-a64b-a2ac69c70161 service glance] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:29.889688 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1358/2761] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:14:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:14:33.730669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890852f-4e8d-4fc9-a2c1-76f25cc5f1d8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:33.733376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e890852f-4e8d-4fc9-a2c1-76f25cc5f1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:33.769326 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:33.810396 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890852f-4e8d-4fc9-a2c1-76f25cc5f1d8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:33.814999 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30659f63-8208-4b11-ac5d-60264e494fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:33.815874 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30659f63-8208-4b11-ac5d-60264e494fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:33.816155 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30659f63-8208-4b11-ac5d-60264e494fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:33.816434 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30659f63-8208-4b11-ac5d-60264e494fe8 admin admin] PATH_INFO: `/v3/users/928a38abc9b6492695e4b51d27b7851b` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:33.817889 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30659f63-8208-4b11-ac5d-60264e494fe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=928a38abc9b6492695e4b51d27b7851b)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:33.819855 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30659f63-8208-4b11-ac5d-60264e494fe8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:33.873149 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-30659f63-8208-4b11-ac5d-60264e494fe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '928a38abc9b6492695e4b51d27b7851b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:33.873770 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-30659f63-8208-4b11-ac5d-60264e494fe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '928a38abc9b6492695e4b51d27b7851b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:33.882376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-30659f63-8208-4b11-ac5d-60264e494fe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '928a38abc9b6492695e4b51d27b7851b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:33.890703 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-30659f63-8208-4b11-ac5d-60264e494fe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '928a38abc9b6492695e4b51d27b7851b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:33.904732 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-30659f63-8208-4b11-ac5d-60264e494fe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '928a38abc9b6492695e4b51d27b7851b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:33.912072 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1404/2762] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:14:33 2022] DELETE /identity/v3/users/928a38abc9b6492695e4b51d27b7851b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:33.916547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f40d8-41a5-48aa-bc41-0ac971ca27a1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:33.917016 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f40d8-41a5-48aa-bc41-0ac971ca27a1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:33.917148 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f40d8-41a5-48aa-bc41-0ac971ca27a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:33.936351 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-065f40d8-41a5-48aa-bc41-0ac971ca27a1 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:14:33.937574 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-065f40d8-41a5-48aa-bc41-0ac971ca27a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:34.002353 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1359/2763] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:14:34.014721 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30659f63-8208-4b11-ac5d-60264e494fe8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:34.016197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-30659f63-8208-4b11-ac5d-60264e494fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:34.081066 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30659f63-8208-4b11-ac5d-60264e494fe8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:34.084718 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf675f-11ac-4c0a-b329-e64584a0e0b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:34.085375 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf675f-11ac-4c0a-b329-e64584a0e0b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:34.085659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf675f-11ac-4c0a-b329-e64584a0e0b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:34.085935 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf675f-11ac-4c0a-b329-e64584a0e0b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:34.096779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf675f-11ac-4c0a-b329-e64584a0e0b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:34.098278 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf675f-11ac-4c0a-b329-e64584a0e0b7 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:34.111402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1405/2764] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:14:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:14:34.668682 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f40d8-41a5-48aa-bc41-0ac971ca27a1 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:14:34.670127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-065f40d8-41a5-48aa-bc41-0ac971ca27a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:14:34.682546 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f40d8-41a5-48aa-bc41-0ac971ca27a1 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:14:34.688065 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8d983-1588-4c16-af29-0a6d6c22a187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:14:34.688868 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8d983-1588-4c16-af29-0a6d6c22a187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:14:34.689152 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8d983-1588-4c16-af29-0a6d6c22a187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:14:34.689426 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8d983-1588-4c16-af29-0a6d6c22a187 admin admin] PATH_INFO: `/v3/projects/14f1faa3206943a7b16246c6b2f45a61` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:14:34.690641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8d983-1588-4c16-af29-0a6d6c22a187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14f1faa3206943a7b16246c6b2f45a61)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:14:34.692751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8d983-1588-4c16-af29-0a6d6c22a187 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:14:34.743889 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dac8d983-1588-4c16-af29-0a6d6c22a187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14f1faa3206943a7b16246c6b2f45a61', 'request_id': 'req-dac8d983-1588-4c16-af29-0a6d6c22a187'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:34.752962 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dac8d983-1588-4c16-af29-0a6d6c22a187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14f1faa3206943a7b16246c6b2f45a61', 'request_id': 'req-dac8d983-1588-4c16-af29-0a6d6c22a187'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:34.759252 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dac8d983-1588-4c16-af29-0a6d6c22a187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14f1faa3206943a7b16246c6b2f45a61', 'request_id': 'req-dac8d983-1588-4c16-af29-0a6d6c22a187'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:34.769383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:34.774416 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dac8d983-1588-4c16-af29-0a6d6c22a187 admin admin] The token cache is being invalidate because project 14f1faa3206943a7b16246c6b2f45a61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:14:34.774997 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dac8d983-1588-4c16-af29-0a6d6c22a187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:34.775764 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-dac8d983-1588-4c16-af29-0a6d6c22a187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:14:34.778521 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1360/2765] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:14:34 2022] DELETE /identity/v3/projects/14f1faa3206943a7b16246c6b2f45a61 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:14:44.105226 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=67,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:10.426560 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf675f-11ac-4c0a-b329-e64584a0e0b7 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:10.428400 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7fbf675f-11ac-4c0a-b329-e64584a0e0b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:10.441418 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf675f-11ac-4c0a-b329-e64584a0e0b7 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:10.491691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef520443-83b3-4169-80fa-68fffbbbc633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:10.492341 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef520443-83b3-4169-80fa-68fffbbbc633 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:10.492623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef520443-83b3-4169-80fa-68fffbbbc633 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:10.492897 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef520443-83b3-4169-80fa-68fffbbbc633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:10.495565 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ef520443-83b3-4169-80fa-68fffbbbc633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:10.567467 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef520443-83b3-4169-80fa-68fffbbbc633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:10.568951 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef520443-83b3-4169-80fa-68fffbbbc633 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:10.578862 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1406/2766] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:15:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:15:20.574507 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=50 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:21.383861 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8d983-1588-4c16-af29-0a6d6c22a187 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:21.385956 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-dac8d983-1588-4c16-af29-0a6d6c22a187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:21.455567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8d983-1588-4c16-af29-0a6d6c22a187 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:21.460171 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315360b3-63f3-47dc-b73d-ea775630633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:21.461111 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315360b3-63f3-47dc-b73d-ea775630633d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:21.461391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315360b3-63f3-47dc-b73d-ea775630633d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:21.461670 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315360b3-63f3-47dc-b73d-ea775630633d admin admin] PATH_INFO: `/v3/users/6f29b4d80e5c44aabbc4aa8cc8fbd7d7` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:21.462907 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315360b3-63f3-47dc-b73d-ea775630633d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f29b4d80e5c44aabbc4aa8cc8fbd7d7)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:21.466061 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315360b3-63f3-47dc-b73d-ea775630633d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:21.518170 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-315360b3-63f3-47dc-b73d-ea775630633d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f29b4d80e5c44aabbc4aa8cc8fbd7d7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:21.525219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-315360b3-63f3-47dc-b73d-ea775630633d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f29b4d80e5c44aabbc4aa8cc8fbd7d7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:21.537400 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-315360b3-63f3-47dc-b73d-ea775630633d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f29b4d80e5c44aabbc4aa8cc8fbd7d7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:21.545251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-315360b3-63f3-47dc-b73d-ea775630633d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f29b4d80e5c44aabbc4aa8cc8fbd7d7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:21.545999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-315360b3-63f3-47dc-b73d-ea775630633d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f29b4d80e5c44aabbc4aa8cc8fbd7d7'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:21.552207 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1361/2767] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:15:21 2022] DELETE /identity/v3/users/6f29b4d80e5c44aabbc4aa8cc8fbd7d7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:15:21.557304 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09396256-ed50-4555-b5e1-d10e06bdb283 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:21.557594 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09396256-ed50-4555-b5e1-d10e06bdb283 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:21.557912 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09396256-ed50-4555-b5e1-d10e06bdb283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:21.576518 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-09396256-ed50-4555-b5e1-d10e06bdb283 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:15:21.577740 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-09396256-ed50-4555-b5e1-d10e06bdb283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:21.639586 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1407/2768] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:15:21.649615 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315360b3-63f3-47dc-b73d-ea775630633d admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:21.651599 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-315360b3-63f3-47dc-b73d-ea775630633d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:21.709891 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315360b3-63f3-47dc-b73d-ea775630633d admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:21.713508 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d8250-f8b4-4100-b517-dc9a79447b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:21.714189 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d8250-f8b4-4100-b517-dc9a79447b62 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:21.714477 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d8250-f8b4-4100-b517-dc9a79447b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:21.714753 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d8250-f8b4-4100-b517-dc9a79447b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:21.723856 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d8250-f8b4-4100-b517-dc9a79447b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:21.725299 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d8250-f8b4-4100-b517-dc9a79447b62 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:21.735985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1362/2769] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:15:22.050486 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09396256-ed50-4555-b5e1-d10e06bdb283 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:22.052031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-09396256-ed50-4555-b5e1-d10e06bdb283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:22.067313 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09396256-ed50-4555-b5e1-d10e06bdb283 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:22.073612 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2aa33f-56e2-43fe-be84-f88658b4ec0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:22.075103 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2aa33f-56e2-43fe-be84-f88658b4ec0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:22.075785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2aa33f-56e2-43fe-be84-f88658b4ec0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:22.076287 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2aa33f-56e2-43fe-be84-f88658b4ec0e admin admin] PATH_INFO: `/v3/projects/c8a9c61af1634730bffd94759f02358f` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:22.078007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2aa33f-56e2-43fe-be84-f88658b4ec0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8a9c61af1634730bffd94759f02358f)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:22.085179 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2aa33f-56e2-43fe-be84-f88658b4ec0e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:22.142476 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-de2aa33f-56e2-43fe-be84-f88658b4ec0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8a9c61af1634730bffd94759f02358f', 'request_id': 'req-de2aa33f-56e2-43fe-be84-f88658b4ec0e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:22.148516 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-de2aa33f-56e2-43fe-be84-f88658b4ec0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8a9c61af1634730bffd94759f02358f', 'request_id': 'req-de2aa33f-56e2-43fe-be84-f88658b4ec0e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:22.158577 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-de2aa33f-56e2-43fe-be84-f88658b4ec0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8a9c61af1634730bffd94759f02358f', 'request_id': 'req-de2aa33f-56e2-43fe-be84-f88658b4ec0e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:22.172025 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-de2aa33f-56e2-43fe-be84-f88658b4ec0e admin admin] The token cache is being invalidate because project c8a9c61af1634730bffd94759f02358f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:15:22.172315 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-de2aa33f-56e2-43fe-be84-f88658b4ec0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:22.172967 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-de2aa33f-56e2-43fe-be84-f88658b4ec0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:22.174581 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1408/2770] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:15:22 2022] DELETE /identity/v3/projects/c8a9c61af1634730bffd94759f02358f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:15:22.179525 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc5db1-fbd8-4680-beaf-88f4c00cfc16 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:22.179812 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc5db1-fbd8-4680-beaf-88f4c00cfc16 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:22.180085 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc5db1-fbd8-4680-beaf-88f4c00cfc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:22.197692 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-6cbc5db1-fbd8-4680-beaf-88f4c00cfc16 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:15:22.199013 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6cbc5db1-fbd8-4680-beaf-88f4c00cfc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:22.217133 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:22.261410 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1363/2771] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:15:22.269295 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53ec1c-73d2-4fa5-975a-9239bb6430cd None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:22.269589 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53ec1c-73d2-4fa5-975a-9239bb6430cd None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:22.269901 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53ec1c-73d2-4fa5-975a-9239bb6430cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:22.289598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-0d53ec1c-73d2-4fa5-975a-9239bb6430cd None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:15:22.290850 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0d53ec1c-73d2-4fa5-975a-9239bb6430cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:22.300298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1409/2772] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:15:22.304633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc5db1-fbd8-4680-beaf-88f4c00cfc16 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:22.315223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc5db1-fbd8-4680-beaf-88f4c00cfc16 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:22.319792 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63001a51-7596-4f90-9d1e-dab9ec6e3d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:22.320466 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63001a51-7596-4f90-9d1e-dab9ec6e3d2b admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:22.320749 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63001a51-7596-4f90-9d1e-dab9ec6e3d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:22.321022 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63001a51-7596-4f90-9d1e-dab9ec6e3d2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:22.321740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63001a51-7596-4f90-9d1e-dab9ec6e3d2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:15:22.322043 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63001a51-7596-4f90-9d1e-dab9ec6e3d2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:22.324476 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63001a51-7596-4f90-9d1e-dab9ec6e3d2b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:22.339687 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1364/2773] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:15:22.343281 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53ec1c-73d2-4fa5-975a-9239bb6430cd None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:22.353293 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53ec1c-73d2-4fa5-975a-9239bb6430cd None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:22.359163 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b7b46-e0d4-40bf-8e0a-bdf8232f6c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:22.359836 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b7b46-e0d4-40bf-8e0a-bdf8232f6c8c admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:22.360125 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b7b46-e0d4-40bf-8e0a-bdf8232f6c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:22.360432 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b7b46-e0d4-40bf-8e0a-bdf8232f6c8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:22.361290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b7b46-e0d4-40bf-8e0a-bdf8232f6c8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:22.363271 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b7b46-e0d4-40bf-8e0a-bdf8232f6c8c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:22.392848 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1410/2774] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:15:22 2022] POST /identity/v3/projects => generated 361 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:15:22.397256 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63001a51-7596-4f90-9d1e-dab9ec6e3d2b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:22.408052 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63001a51-7596-4f90-9d1e-dab9ec6e3d2b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:22.447959 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b7b46-e0d4-40bf-8e0a-bdf8232f6c8c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:22.449940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-145b7b46-e0d4-40bf-8e0a-bdf8232f6c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:22.474700 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6c685-e6ef-4a70-a2b3-2be3678135d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:22.475379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6c685-e6ef-4a70-a2b3-2be3678135d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:22.475663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6c685-e6ef-4a70-a2b3-2be3678135d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:22.475940 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6c685-e6ef-4a70-a2b3-2be3678135d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:22.476642 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6c685-e6ef-4a70-a2b3-2be3678135d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:22.479207 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6c685-e6ef-4a70-a2b3-2be3678135d0 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:22.504260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1365/2775] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:15:22 2022] POST /identity/v3/users => generated 281 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:15:22.509214 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6c685-e6ef-4a70-a2b3-2be3678135d0 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:22.521280 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6c685-e6ef-4a70-a2b3-2be3678135d0 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:22.525951 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb1fb3-8d15-4986-b1ca-7599b9bb254b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:22.526641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb1fb3-8d15-4986-b1ca-7599b9bb254b admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:22.526922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb1fb3-8d15-4986-b1ca-7599b9bb254b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:22.527194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb1fb3-8d15-4986-b1ca-7599b9bb254b admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:22.527914 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb1fb3-8d15-4986-b1ca-7599b9bb254b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:22.529518 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb1fb3-8d15-4986-b1ca-7599b9bb254b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:22.530461 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b7b46-e0d4-40bf-8e0a-bdf8232f6c8c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:22.539286 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170dff6-cd64-46fa-83c9-9f273ee2b8f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:22.543744 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1366/2776] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 16:15:22.543929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170dff6-cd64-46fa-83c9-9f273ee2b8f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:22.543929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170dff6-cd64-46fa-83c9-9f273ee2b8f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:22.543929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170dff6-cd64-46fa-83c9-9f273ee2b8f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:22.543929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1170dff6-cd64-46fa-83c9-9f273ee2b8f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:22.545048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb1fb3-8d15-4986-b1ca-7599b9bb254b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:22.555460 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb1fb3-8d15-4986-b1ca-7599b9bb254b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:22.559793 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170dff6-cd64-46fa-83c9-9f273ee2b8f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:22.561615 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170dff6-cd64-46fa-83c9-9f273ee2b8f7 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:22.562145 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c4f97-6fd1-4175-94e3-b59961892a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:22.562854 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c4f97-6fd1-4175-94e3-b59961892a81 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:22.563138 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c4f97-6fd1-4175-94e3-b59961892a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:22.563621 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c4f97-6fd1-4175-94e3-b59961892a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:22.564497 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c4f97-6fd1-4175-94e3-b59961892a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:22.566747 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:22.566888 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c4f97-6fd1-4175-94e3-b59961892a81 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:22.571054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1411/2777] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:15:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:15:22.579174 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1367/2778] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 16:15:22.583377 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170dff6-cd64-46fa-83c9-9f273ee2b8f7 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:22.595578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170dff6-cd64-46fa-83c9-9f273ee2b8f7 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:22.600181 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbb2bc-5f63-4696-947c-9f21bb7dbae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:22.601068 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbb2bc-5f63-4696-947c-9f21bb7dbae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:22.601549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbb2bc-5f63-4696-947c-9f21bb7dbae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:22.601859 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbb2bc-5f63-4696-947c-9f21bb7dbae5 admin admin] PATH_INFO: `/v3/projects/a1eb9648432c4b57b3bc029bf82e3fde/users/f9a7bed5a69a4a8986c0f48d00f31872/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:22.619990 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbb2bc-5f63-4696-947c-9f21bb7dbae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1eb9648432c4b57b3bc029bf82e3fde, user_id=f9a7bed5a69a4a8986c0f48d00f31872, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:22.623510 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbb2bc-5f63-4696-947c-9f21bb7dbae5 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:22.637903 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1412/2779] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:15:22 2022] PUT /identity/v3/projects/a1eb9648432c4b57b3bc029bf82e3fde/users/f9a7bed5a69a4a8986c0f48d00f31872/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:15:22.648863 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6e82a-0a81-4e16-8bf2-86ec33cd85c5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:22.649157 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6e82a-0a81-4e16-8bf2-86ec33cd85c5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:22.649441 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6e82a-0a81-4e16-8bf2-86ec33cd85c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:22.680248 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-7aa6e82a-0a81-4e16-8bf2-86ec33cd85c5 None None] MFA Rules not processed for user `f9a7bed5a69a4a8986c0f48d00f31872`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:15:22.682254 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-7aa6e82a-0a81-4e16-8bf2-86ec33cd85c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:22.755624 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1368/2780] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:15:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:15:22.798179 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbb2bc-5f63-4696-947c-9f21bb7dbae5 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:22.799980 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a7dbb2bc-5f63-4696-947c-9f21bb7dbae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:22.861336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbb2bc-5f63-4696-947c-9f21bb7dbae5 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:22.865477 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d86d8e-b9e3-461c-b493-606aabae4317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:22.866174 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d86d8e-b9e3-461c-b493-606aabae4317 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:22.866526 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d86d8e-b9e3-461c-b493-606aabae4317 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:22.866958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d86d8e-b9e3-461c-b493-606aabae4317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:22.880151 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d86d8e-b9e3-461c-b493-606aabae4317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:22.882667 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d86d8e-b9e3-461c-b493-606aabae4317 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:22.901054 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1413/2781] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:15:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:15:22.916164 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6e82a-0a81-4e16-8bf2-86ec33cd85c5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:22.927976 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:23.003345 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6e82a-0a81-4e16-8bf2-86ec33cd85c5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:23.008556 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d58155-8a4d-4776-b31c-d31de29b64a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:23.009517 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d58155-8a4d-4776-b31c-d31de29b64a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:23.010716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d58155-8a4d-4776-b31c-d31de29b64a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:23.011069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d58155-8a4d-4776-b31c-d31de29b64a1 admin admin] PATH_INFO: `/v3/users/f9a7bed5a69a4a8986c0f48d00f31872` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:23.012357 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d58155-8a4d-4776-b31c-d31de29b64a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a7bed5a69a4a8986c0f48d00f31872)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:23.014435 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d58155-8a4d-4776-b31c-d31de29b64a1 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:23.067911 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-97d58155-8a4d-4776-b31c-d31de29b64a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a7bed5a69a4a8986c0f48d00f31872'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:23.075979 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-97d58155-8a4d-4776-b31c-d31de29b64a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a7bed5a69a4a8986c0f48d00f31872'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:23.088669 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-97d58155-8a4d-4776-b31c-d31de29b64a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a7bed5a69a4a8986c0f48d00f31872'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:23.098377 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-97d58155-8a4d-4776-b31c-d31de29b64a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a7bed5a69a4a8986c0f48d00f31872'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:23.099130 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-97d58155-8a4d-4776-b31c-d31de29b64a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a7bed5a69a4a8986c0f48d00f31872'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:23.106399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1369/2782] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:15:22 2022] DELETE /identity/v3/users/f9a7bed5a69a4a8986c0f48d00f31872 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:15:23.112669 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9b549-3c58-4fc9-891a-b58faddb7c26 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:23.113484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9b549-3c58-4fc9-891a-b58faddb7c26 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:23.114261 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9b549-3c58-4fc9-891a-b58faddb7c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:23.135675 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-87b9b549-3c58-4fc9-891a-b58faddb7c26 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:15:23.136922 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-87b9b549-3c58-4fc9-891a-b58faddb7c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:23.204035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1414/2783] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:15:23.215715 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d58155-8a4d-4776-b31c-d31de29b64a1 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:23.217669 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-97d58155-8a4d-4776-b31c-d31de29b64a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:23.292291 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d58155-8a4d-4776-b31c-d31de29b64a1 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:23.298047 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2edc3-f735-4501-b4a2-5896bf6e7085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:23.299223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2edc3-f735-4501-b4a2-5896bf6e7085 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:23.299764 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2edc3-f735-4501-b4a2-5896bf6e7085 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:23.300110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2edc3-f735-4501-b4a2-5896bf6e7085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:23.313950 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2edc3-f735-4501-b4a2-5896bf6e7085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:23.315991 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2edc3-f735-4501-b4a2-5896bf6e7085 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:23.327554 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1370/2784] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:15:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:15:23.614841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9b549-3c58-4fc9-891a-b58faddb7c26 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:23.616661 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-87b9b549-3c58-4fc9-891a-b58faddb7c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:23.631447 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9b549-3c58-4fc9-891a-b58faddb7c26 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:23.637798 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2a9d5-152c-4e7e-82c9-165969e0ea5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:23.638635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2a9d5-152c-4e7e-82c9-165969e0ea5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:23.638929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2a9d5-152c-4e7e-82c9-165969e0ea5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:23.639194 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2a9d5-152c-4e7e-82c9-165969e0ea5a admin admin] PATH_INFO: `/v3/projects/a1eb9648432c4b57b3bc029bf82e3fde` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:23.640436 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2a9d5-152c-4e7e-82c9-165969e0ea5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1eb9648432c4b57b3bc029bf82e3fde)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:23.642548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2a9d5-152c-4e7e-82c9-165969e0ea5a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:23.694300 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-43a2a9d5-152c-4e7e-82c9-165969e0ea5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1eb9648432c4b57b3bc029bf82e3fde', 'request_id': 'req-43a2a9d5-152c-4e7e-82c9-165969e0ea5a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:23.700426 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-43a2a9d5-152c-4e7e-82c9-165969e0ea5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1eb9648432c4b57b3bc029bf82e3fde', 'request_id': 'req-43a2a9d5-152c-4e7e-82c9-165969e0ea5a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:23.707938 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-43a2a9d5-152c-4e7e-82c9-165969e0ea5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1eb9648432c4b57b3bc029bf82e3fde', 'request_id': 'req-43a2a9d5-152c-4e7e-82c9-165969e0ea5a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:23.717056 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:23.721069 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-43a2a9d5-152c-4e7e-82c9-165969e0ea5a admin admin] The token cache is being invalidate because project a1eb9648432c4b57b3bc029bf82e3fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:15:23.721372 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-43a2a9d5-152c-4e7e-82c9-165969e0ea5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:23.722559 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-43a2a9d5-152c-4e7e-82c9-165969e0ea5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:23.724123 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1415/2785] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:15:23 2022] DELETE /identity/v3/projects/a1eb9648432c4b57b3bc029bf82e3fde => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:15:23.730274 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81351fab-acae-4205-884b-e18b14586548 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:23.730846 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81351fab-acae-4205-884b-e18b14586548 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:23.730974 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81351fab-acae-4205-884b-e18b14586548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:23.748483 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-81351fab-acae-4205-884b-e18b14586548 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:15:23.749815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-81351fab-acae-4205-884b-e18b14586548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:23.774708 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:23.814131 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1371/2786] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:15:23.823723 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c9262-2f37-4296-ab96-7245c9464234 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:23.824019 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c9262-2f37-4296-ab96-7245c9464234 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:23.824303 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c9262-2f37-4296-ab96-7245c9464234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:23.843634 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d99c9262-2f37-4296-ab96-7245c9464234 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:15:23.844853 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d99c9262-2f37-4296-ab96-7245c9464234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:23.852903 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1416/2787] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:15:23.857898 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81351fab-acae-4205-884b-e18b14586548 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:23.867609 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81351fab-acae-4205-884b-e18b14586548 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:23.873567 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf937d-656c-4790-a306-0e19feb8e230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:23.874274 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf937d-656c-4790-a306-0e19feb8e230 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:23.874562 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf937d-656c-4790-a306-0e19feb8e230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:23.874840 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf937d-656c-4790-a306-0e19feb8e230 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:23.875568 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf937d-656c-4790-a306-0e19feb8e230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:15:23.875879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf937d-656c-4790-a306-0e19feb8e230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:23.877813 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf937d-656c-4790-a306-0e19feb8e230 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:23.890009 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1372/2788] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:15:23.894499 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c9262-2f37-4296-ab96-7245c9464234 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:23.904907 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c9262-2f37-4296-ab96-7245c9464234 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:23.909667 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc1bb7-e468-4f37-a65e-796ca7500cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:23.910371 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc1bb7-e468-4f37-a65e-796ca7500cae admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:23.910689 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc1bb7-e468-4f37-a65e-796ca7500cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:23.910967 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc1bb7-e468-4f37-a65e-796ca7500cae admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:23.911660 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc1bb7-e468-4f37-a65e-796ca7500cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:23.913579 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc1bb7-e468-4f37-a65e-796ca7500cae admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:23.940500 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1417/2789] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:15:23 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:15:23.944833 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf937d-656c-4790-a306-0e19feb8e230 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:23.955015 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf937d-656c-4790-a306-0e19feb8e230 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:24.016367 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468e0d6-311b-4ed5-b67a-7bdebcec8f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:24.017057 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468e0d6-311b-4ed5-b67a-7bdebcec8f55 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:24.017348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468e0d6-311b-4ed5-b67a-7bdebcec8f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:24.017628 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468e0d6-311b-4ed5-b67a-7bdebcec8f55 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:24.018349 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468e0d6-311b-4ed5-b67a-7bdebcec8f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:24.020363 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468e0d6-311b-4ed5-b67a-7bdebcec8f55 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:24.043417 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1373/2790] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:15:23 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:15:24.050428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc1bb7-e468-4f37-a65e-796ca7500cae admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:24.066009 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc1bb7-e468-4f37-a65e-796ca7500cae admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:24.070945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541855a4-0923-4c75-9e37-091586f96d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:24.071803 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541855a4-0923-4c75-9e37-091586f96d24 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:24.072253 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541855a4-0923-4c75-9e37-091586f96d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:24.072666 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541855a4-0923-4c75-9e37-091586f96d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:24.073677 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541855a4-0923-4c75-9e37-091586f96d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:24.075244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541855a4-0923-4c75-9e37-091586f96d24 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:24.086270 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1418/2791] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:15:24.090844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468e0d6-311b-4ed5-b67a-7bdebcec8f55 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:24.101982 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468e0d6-311b-4ed5-b67a-7bdebcec8f55 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:24.110509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51164202-21b6-4d11-9322-80d7b1e237ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:24.110509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51164202-21b6-4d11-9322-80d7b1e237ab admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:24.110509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51164202-21b6-4d11-9322-80d7b1e237ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:24.110509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51164202-21b6-4d11-9322-80d7b1e237ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:24.110871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51164202-21b6-4d11-9322-80d7b1e237ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:24.111892 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51164202-21b6-4d11-9322-80d7b1e237ab admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:24.127922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1374/2792] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:15:24.129226 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541855a4-0923-4c75-9e37-091586f96d24 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:24.140577 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541855a4-0923-4c75-9e37-091586f96d24 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:24.145968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f00cb-9c6d-4ea0-8659-e04f93644380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:24.146905 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f00cb-9c6d-4ea0-8659-e04f93644380 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:24.147244 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f00cb-9c6d-4ea0-8659-e04f93644380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:24.147535 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f00cb-9c6d-4ea0-8659-e04f93644380 admin admin] PATH_INFO: `/v3/projects/8b4fb19b4f484cec8fdaab568c2f04ee/users/a985942f4e4a4fe3aca89ddea03963e6/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:24.164044 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f00cb-9c6d-4ea0-8659-e04f93644380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b4fb19b4f484cec8fdaab568c2f04ee, user_id=a985942f4e4a4fe3aca89ddea03963e6, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:24.167321 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f00cb-9c6d-4ea0-8659-e04f93644380 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:24.180799 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1419/2793] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:15:24 2022] PUT /identity/v3/projects/8b4fb19b4f484cec8fdaab568c2f04ee/users/a985942f4e4a4fe3aca89ddea03963e6/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:15:24.192700 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0884c2-767b-4247-9f90-385647e6da81 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:24.193238 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0884c2-767b-4247-9f90-385647e6da81 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:24.193521 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0884c2-767b-4247-9f90-385647e6da81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:24.220642 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-9d0884c2-767b-4247-9f90-385647e6da81 None None] MFA Rules not processed for user `a985942f4e4a4fe3aca89ddea03963e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:15:24.221887 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9d0884c2-767b-4247-9f90-385647e6da81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:24.293768 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1375/2794] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:15:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:15:24.298333 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f00cb-9c6d-4ea0-8659-e04f93644380 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:24.363126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f00cb-9c6d-4ea0-8659-e04f93644380 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:24.367840 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3445e0-431e-4fd8-897f-b106e323d371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:24.368497 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3445e0-431e-4fd8-897f-b106e323d371 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:24.368785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3445e0-431e-4fd8-897f-b106e323d371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:24.369722 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3445e0-431e-4fd8-897f-b106e323d371 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:24.370628 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3445e0-431e-4fd8-897f-b106e323d371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:24.372404 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3445e0-431e-4fd8-897f-b106e323d371 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:24.402427 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1420/2795] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:15:24 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:15:24.406605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0884c2-767b-4247-9f90-385647e6da81 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:24.419813 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0884c2-767b-4247-9f90-385647e6da81 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:24.443435 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:24.492224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c12489-a7da-4ad1-9917-4fe41ba2ed87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:24.492942 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c12489-a7da-4ad1-9917-4fe41ba2ed87 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:24.493227 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c12489-a7da-4ad1-9917-4fe41ba2ed87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:24.493640 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c12489-a7da-4ad1-9917-4fe41ba2ed87 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:24.495041 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c12489-a7da-4ad1-9917-4fe41ba2ed87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:24.497031 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c12489-a7da-4ad1-9917-4fe41ba2ed87 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:24.519022 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1376/2796] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:15:24 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:15:24.522879 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3445e0-431e-4fd8-897f-b106e323d371 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:24.533423 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3445e0-431e-4fd8-897f-b106e323d371 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:24.537997 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492d64e-c442-4144-930c-440a4c47b5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:24.538682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492d64e-c442-4144-930c-440a4c47b5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:24.538968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492d64e-c442-4144-930c-440a4c47b5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:24.539245 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492d64e-c442-4144-930c-440a4c47b5e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:24.539960 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492d64e-c442-4144-930c-440a4c47b5e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:24.541631 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492d64e-c442-4144-930c-440a4c47b5e5 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:24.553157 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1421/2797] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:15:24.559073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c12489-a7da-4ad1-9917-4fe41ba2ed87 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:24.571475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c12489-a7da-4ad1-9917-4fe41ba2ed87 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:24.577223 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882fd76-69fd-4df9-b8f8-5ba1949b6b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:24.577898 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882fd76-69fd-4df9-b8f8-5ba1949b6b9d admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:24.578218 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882fd76-69fd-4df9-b8f8-5ba1949b6b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:24.578499 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882fd76-69fd-4df9-b8f8-5ba1949b6b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:24.579235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882fd76-69fd-4df9-b8f8-5ba1949b6b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:24.580852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882fd76-69fd-4df9-b8f8-5ba1949b6b9d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:24.591215 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1377/2798] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:15:24.595447 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492d64e-c442-4144-930c-440a4c47b5e5 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:24.606600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492d64e-c442-4144-930c-440a4c47b5e5 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:24.611331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cc1af-3acf-4f52-91eb-c931a1e50f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:24.612216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cc1af-3acf-4f52-91eb-c931a1e50f15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:24.612499 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cc1af-3acf-4f52-91eb-c931a1e50f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:24.612779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cc1af-3acf-4f52-91eb-c931a1e50f15 admin admin] PATH_INFO: `/v3/projects/f6655654c39146a38e14a0eeb8c4b9a1/users/c8ecd1bb45ef44e4a855feabb97fe1ad/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:24.628962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cc1af-3acf-4f52-91eb-c931a1e50f15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6655654c39146a38e14a0eeb8c4b9a1, user_id=c8ecd1bb45ef44e4a855feabb97fe1ad, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:24.631607 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cc1af-3acf-4f52-91eb-c931a1e50f15 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:24.645331 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1422/2799] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:15:24 2022] PUT /identity/v3/projects/f6655654c39146a38e14a0eeb8c4b9a1/users/c8ecd1bb45ef44e4a855feabb97fe1ad/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:15:24.655948 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a6f54-ab0b-46b2-94af-8a49533402ce None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:24.656238 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a6f54-ab0b-46b2-94af-8a49533402ce None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:24.656517 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a6f54-ab0b-46b2-94af-8a49533402ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:24.684149 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-5c9a6f54-ab0b-46b2-94af-8a49533402ce None None] MFA Rules not processed for user `c8ecd1bb45ef44e4a855feabb97fe1ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:15:24.685378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-5c9a6f54-ab0b-46b2-94af-8a49533402ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:24.751273 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1378/2800] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:15:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:15:24.756120 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cc1af-3acf-4f52-91eb-c931a1e50f15 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:24.803544 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:24.822800 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cc1af-3acf-4f52-91eb-c931a1e50f15 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:24.827804 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2af72e-f67e-4432-a6e8-245de722e7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:24.828463 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2af72e-f67e-4432-a6e8-245de722e7c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:24.828749 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2af72e-f67e-4432-a6e8-245de722e7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:24.829030 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2af72e-f67e-4432-a6e8-245de722e7c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:24.829721 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2af72e-f67e-4432-a6e8-245de722e7c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:24.831665 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2af72e-f67e-4432-a6e8-245de722e7c2 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:24.868545 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1423/2801] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:15:24 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:15:24.873498 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a6f54-ab0b-46b2-94af-8a49533402ce None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:24.886597 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a6f54-ab0b-46b2-94af-8a49533402ce None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:24.953542 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602b663-0c93-41ac-8755-eb5a769d2d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:24.954251 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602b663-0c93-41ac-8755-eb5a769d2d65 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:24.954541 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602b663-0c93-41ac-8755-eb5a769d2d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:24.954822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602b663-0c93-41ac-8755-eb5a769d2d65 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:24.955513 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602b663-0c93-41ac-8755-eb5a769d2d65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:24.957432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602b663-0c93-41ac-8755-eb5a769d2d65 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:24.977353 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1379/2802] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:15:24 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:15:24.981957 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2af72e-f67e-4432-a6e8-245de722e7c2 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:24.992392 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2af72e-f67e-4432-a6e8-245de722e7c2 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:24.999685 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8df997-312d-4aed-9c16-69b4e2a58a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:25.000364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8df997-312d-4aed-9c16-69b4e2a58a67 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:25.000869 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8df997-312d-4aed-9c16-69b4e2a58a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:25.001162 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8df997-312d-4aed-9c16-69b4e2a58a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:25.001894 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8df997-312d-4aed-9c16-69b4e2a58a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:25.003823 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8df997-312d-4aed-9c16-69b4e2a58a67 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:25.015847 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1424/2803] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 16:15:25.020064 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602b663-0c93-41ac-8755-eb5a769d2d65 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:25.031168 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602b663-0c93-41ac-8755-eb5a769d2d65 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:25.035990 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f6eb9-7ab7-4279-b6d3-4e09508ca597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:25.037095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f6eb9-7ab7-4279-b6d3-4e09508ca597 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:25.037384 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f6eb9-7ab7-4279-b6d3-4e09508ca597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:25.037667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f6eb9-7ab7-4279-b6d3-4e09508ca597 admin admin] PATH_INFO: `/v3/projects/1f6c25963aed4240a19754e27085a0f4/users/6de1d15a236641c1b3aa22dde319e238/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:25.054379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f6eb9-7ab7-4279-b6d3-4e09508ca597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f6c25963aed4240a19754e27085a0f4, user_id=6de1d15a236641c1b3aa22dde319e238, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:25.057224 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f6eb9-7ab7-4279-b6d3-4e09508ca597 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:25.066129 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:25.071906 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1380/2804] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:15:25 2022] PUT /identity/v3/projects/1f6c25963aed4240a19754e27085a0f4/users/6de1d15a236641c1b3aa22dde319e238/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:15:25.076049 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8df997-312d-4aed-9c16-69b4e2a58a67 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:25.086042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8df997-312d-4aed-9c16-69b4e2a58a67 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:25.144484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477ead1-1bba-43d8-9c93-59d51435c08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:25.145060 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477ead1-1bba-43d8-9c93-59d51435c08b admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:25.145346 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477ead1-1bba-43d8-9c93-59d51435c08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:25.145627 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477ead1-1bba-43d8-9c93-59d51435c08b admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:25.146385 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477ead1-1bba-43d8-9c93-59d51435c08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:25.147998 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477ead1-1bba-43d8-9c93-59d51435c08b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:25.158933 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1425/2805] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:15:25 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 16:15:25.164716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f6eb9-7ab7-4279-b6d3-4e09508ca597 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:25.179372 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f6eb9-7ab7-4279-b6d3-4e09508ca597 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:25.187401 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07186c98-a912-404b-bd51-3333d6263326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:25.187401 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07186c98-a912-404b-bd51-3333d6263326 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:25.187401 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07186c98-a912-404b-bd51-3333d6263326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:25.187401 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07186c98-a912-404b-bd51-3333d6263326 admin admin] PATH_INFO: `/v3/projects/1f6c25963aed4240a19754e27085a0f4/users/6de1d15a236641c1b3aa22dde319e238/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:25.189439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07186c98-a912-404b-bd51-3333d6263326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f6c25963aed4240a19754e27085a0f4, user_id=6de1d15a236641c1b3aa22dde319e238, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:25.192334 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07186c98-a912-404b-bd51-3333d6263326 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:25.193816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477ead1-1bba-43d8-9c93-59d51435c08b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:25.195570 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7477ead1-1bba-43d8-9c93-59d51435c08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:25.206731 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1381/2806] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:15:25 2022] PUT /identity/v3/projects/1f6c25963aed4240a19754e27085a0f4/users/6de1d15a236641c1b3aa22dde319e238/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:15:25.219340 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5682f6-59f3-4a72-8cdb-8cbe0390cce4 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:25.219647 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5682f6-59f3-4a72-8cdb-8cbe0390cce4 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:25.219900 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5682f6-59f3-4a72-8cdb-8cbe0390cce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:25.255658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-cd5682f6-59f3-4a72-8cdb-8cbe0390cce4 None None] MFA Rules not processed for user `6de1d15a236641c1b3aa22dde319e238`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:15:25.255658 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cd5682f6-59f3-4a72-8cdb-8cbe0390cce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:25.267078 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477ead1-1bba-43d8-9c93-59d51435c08b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:25.322040 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6336a0-b610-4d4c-aeea-1214980961c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:25.323404 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6336a0-b610-4d4c-aeea-1214980961c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:25.323694 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6336a0-b610-4d4c-aeea-1214980961c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:25.323973 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6336a0-b610-4d4c-aeea-1214980961c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:25.325807 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ce6336a0-b610-4d4c-aeea-1214980961c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:25.333452 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1382/2807] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:15:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:15:25.345790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5682f6-59f3-4a72-8cdb-8cbe0390cce4 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:25.347236 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cd5682f6-59f3-4a72-8cdb-8cbe0390cce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:25.358015 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:25.398008 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6336a0-b610-4d4c-aeea-1214980961c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:25.399409 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6336a0-b610-4d4c-aeea-1214980961c6 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:25.410041 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1426/2808] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:15:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:15:25.410268 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5682f6-59f3-4a72-8cdb-8cbe0390cce4 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:25.413867 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff8017-db90-4a1b-a58a-82b2106fb928 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:25.419728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff8017-db90-4a1b-a58a-82b2106fb928 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:25.419728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff8017-db90-4a1b-a58a-82b2106fb928 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:25.419728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff8017-db90-4a1b-a58a-82b2106fb928 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:25.479981 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff8017-db90-4a1b-a58a-82b2106fb928 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:25.481560 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff8017-db90-4a1b-a58a-82b2106fb928 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:25.491155 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1383/2809] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:15:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:15:25.904089 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6336a0-b610-4d4c-aeea-1214980961c6 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:25.905586 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ce6336a0-b610-4d4c-aeea-1214980961c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:25.959915 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff8017-db90-4a1b-a58a-82b2106fb928 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:25.961484 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c4ff8017-db90-4a1b-a58a-82b2106fb928 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:25.976169 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff8017-db90-4a1b-a58a-82b2106fb928 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:25.981562 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b65fe-864e-499d-b346-260887aa881f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:25.982481 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b65fe-864e-499d-b346-260887aa881f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:25.982761 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b65fe-864e-499d-b346-260887aa881f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:25.983036 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b65fe-864e-499d-b346-260887aa881f admin admin] PATH_INFO: `/v3/users/221d83c6dbb845fda216ea043b301c54` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:25.984235 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b65fe-864e-499d-b346-260887aa881f admin admin] RBAC: Authorizing `identity:delete_user(user_id=221d83c6dbb845fda216ea043b301c54)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:25.986199 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b65fe-864e-499d-b346-260887aa881f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:25.988071 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6336a0-b610-4d4c-aeea-1214980961c6 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:25.993228 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85cbad-0bbd-4071-8d22-63096a582e02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:25.994499 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85cbad-0bbd-4071-8d22-63096a582e02 service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:25.994961 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85cbad-0bbd-4071-8d22-63096a582e02 service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:25.995486 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85cbad-0bbd-4071-8d22-63096a582e02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:25.999217 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7c85cbad-0bbd-4071-8d22-63096a582e02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:26.011542 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:26.014209 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85cbad-0bbd-4071-8d22-63096a582e02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:26.016682 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85cbad-0bbd-4071-8d22-63096a582e02 service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:26.029644 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1427/2810] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:15:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:15:26.041170 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1a8b65fe-864e-499d-b346-260887aa881f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '221d83c6dbb845fda216ea043b301c54'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:26.052403 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1a8b65fe-864e-499d-b346-260887aa881f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '221d83c6dbb845fda216ea043b301c54'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:26.067515 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1a8b65fe-864e-499d-b346-260887aa881f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '221d83c6dbb845fda216ea043b301c54'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:26.076565 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1a8b65fe-864e-499d-b346-260887aa881f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '221d83c6dbb845fda216ea043b301c54'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:26.077242 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-1a8b65fe-864e-499d-b346-260887aa881f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '221d83c6dbb845fda216ea043b301c54'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:26.083475 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1384/2811] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:15:25 2022] DELETE /identity/v3/users/221d83c6dbb845fda216ea043b301c54 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:15:26.266780 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85cbad-0bbd-4071-8d22-63096a582e02 service placement] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:26.278388 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85cbad-0bbd-4071-8d22-63096a582e02 service placement] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:26.338955 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b30daf-95aa-492c-b863-5c7a01ea0a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:26.339818 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b30daf-95aa-492c-b863-5c7a01ea0a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:26.340114 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b30daf-95aa-492c-b863-5c7a01ea0a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:26.340378 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b30daf-95aa-492c-b863-5c7a01ea0a82 admin admin] PATH_INFO: `/v3/projects/95e9d5494fe84dc3a36b7352535bccf7` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:26.341548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b30daf-95aa-492c-b863-5c7a01ea0a82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95e9d5494fe84dc3a36b7352535bccf7)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:26.343477 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b30daf-95aa-492c-b863-5c7a01ea0a82 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:26.391538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-86b30daf-95aa-492c-b863-5c7a01ea0a82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95e9d5494fe84dc3a36b7352535bccf7', 'request_id': 'req-86b30daf-95aa-492c-b863-5c7a01ea0a82'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:26.395342 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:26.397733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-86b30daf-95aa-492c-b863-5c7a01ea0a82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95e9d5494fe84dc3a36b7352535bccf7', 'request_id': 'req-86b30daf-95aa-492c-b863-5c7a01ea0a82'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:26.407659 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-86b30daf-95aa-492c-b863-5c7a01ea0a82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95e9d5494fe84dc3a36b7352535bccf7', 'request_id': 'req-86b30daf-95aa-492c-b863-5c7a01ea0a82'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:26.420491 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-86b30daf-95aa-492c-b863-5c7a01ea0a82 admin admin] The token cache is being invalidate because project 95e9d5494fe84dc3a36b7352535bccf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:15:26.421428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-86b30daf-95aa-492c-b863-5c7a01ea0a82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:26.421428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-86b30daf-95aa-492c-b863-5c7a01ea0a82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:26.423211 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1428/2812] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:15:26 2022] DELETE /identity/v3/projects/95e9d5494fe84dc3a36b7352535bccf7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:15:27.032982 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b65fe-864e-499d-b346-260887aa881f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:27.034514 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-1a8b65fe-864e-499d-b346-260887aa881f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:27.092305 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b65fe-864e-499d-b346-260887aa881f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:27.141939 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd426bbe-33c1-4457-b80c-f41a1b9e7810 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:27.142535 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd426bbe-33c1-4457-b80c-f41a1b9e7810 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:27.142820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd426bbe-33c1-4457-b80c-f41a1b9e7810 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:27.143098 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd426bbe-33c1-4457-b80c-f41a1b9e7810 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:27.145036 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cd426bbe-33c1-4457-b80c-f41a1b9e7810 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:27.208052 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd426bbe-33c1-4457-b80c-f41a1b9e7810 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:27.209507 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd426bbe-33c1-4457-b80c-f41a1b9e7810 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:27.218812 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1385/2813] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:15:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:15:27.760987 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b30daf-95aa-492c-b863-5c7a01ea0a82 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:27.762677 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-86b30daf-95aa-492c-b863-5c7a01ea0a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:27.781359 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b30daf-95aa-492c-b863-5c7a01ea0a82 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:27.785678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ec099-42d4-4b74-bf3c-708c815fc3c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:27.786364 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ec099-42d4-4b74-bf3c-708c815fc3c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:27.786654 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ec099-42d4-4b74-bf3c-708c815fc3c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:27.786945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ec099-42d4-4b74-bf3c-708c815fc3c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:27.788753 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a12ec099-42d4-4b74-bf3c-708c815fc3c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:27.857078 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ec099-42d4-4b74-bf3c-708c815fc3c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:27.858576 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ec099-42d4-4b74-bf3c-708c815fc3c7 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:27.869533 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1429/2814] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:15:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:15:31.772986 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd426bbe-33c1-4457-b80c-f41a1b9e7810 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:31.774539 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-cd426bbe-33c1-4457-b80c-f41a1b9e7810 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:31.785885 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:31.846408 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd426bbe-33c1-4457-b80c-f41a1b9e7810 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:31.851000 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893af5ce-17c5-4e22-a067-6a40cf253cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:31.851868 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893af5ce-17c5-4e22-a067-6a40cf253cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:31.852248 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893af5ce-17c5-4e22-a067-6a40cf253cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:31.852421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893af5ce-17c5-4e22-a067-6a40cf253cbb admin admin] PATH_INFO: `/v3/users/a985942f4e4a4fe3aca89ddea03963e6` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:31.853650 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893af5ce-17c5-4e22-a067-6a40cf253cbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a985942f4e4a4fe3aca89ddea03963e6)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:31.855768 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893af5ce-17c5-4e22-a067-6a40cf253cbb admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:31.912944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-893af5ce-17c5-4e22-a067-6a40cf253cbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a985942f4e4a4fe3aca89ddea03963e6'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:31.921796 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-893af5ce-17c5-4e22-a067-6a40cf253cbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a985942f4e4a4fe3aca89ddea03963e6'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:31.934358 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-893af5ce-17c5-4e22-a067-6a40cf253cbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a985942f4e4a4fe3aca89ddea03963e6'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:31.943912 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-893af5ce-17c5-4e22-a067-6a40cf253cbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a985942f4e4a4fe3aca89ddea03963e6'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:31.944898 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-893af5ce-17c5-4e22-a067-6a40cf253cbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a985942f4e4a4fe3aca89ddea03963e6'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:31.954399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1386/2815] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:15:31 2022] DELETE /identity/v3/users/a985942f4e4a4fe3aca89ddea03963e6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:15:31.958909 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b560f-1c4a-4425-b5e9-6aa602dc02f6 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:31.959387 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b560f-1c4a-4425-b5e9-6aa602dc02f6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:31.959481 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b560f-1c4a-4425-b5e9-6aa602dc02f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:31.976875 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-038b560f-1c4a-4425-b5e9-6aa602dc02f6 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:15:31.978134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-038b560f-1c4a-4425-b5e9-6aa602dc02f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:32.043010 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1430/2816] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:15:32.053076 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893af5ce-17c5-4e22-a067-6a40cf253cbb admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:32.054565 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-893af5ce-17c5-4e22-a067-6a40cf253cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:32.120681 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893af5ce-17c5-4e22-a067-6a40cf253cbb admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:32.130515 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d547d0-d3f7-450b-9b15-3b8c85c703cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:32.131189 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d547d0-d3f7-450b-9b15-3b8c85c703cd service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:32.131473 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d547d0-d3f7-450b-9b15-3b8c85c703cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:32.131756 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d547d0-d3f7-450b-9b15-3b8c85c703cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:32.142288 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d547d0-d3f7-450b-9b15-3b8c85c703cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:32.143748 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d547d0-d3f7-450b-9b15-3b8c85c703cd service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:32.155048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1387/2817] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:15:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:15:32.528231 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b560f-1c4a-4425-b5e9-6aa602dc02f6 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:32.529840 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-038b560f-1c4a-4425-b5e9-6aa602dc02f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:32.547392 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b560f-1c4a-4425-b5e9-6aa602dc02f6 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:32.556998 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1cfc2-4a93-4c6b-a797-c5db3cfd99f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:32.558168 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1cfc2-4a93-4c6b-a797-c5db3cfd99f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:32.560445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1cfc2-4a93-4c6b-a797-c5db3cfd99f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:32.560445 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1cfc2-4a93-4c6b-a797-c5db3cfd99f8 admin admin] PATH_INFO: `/v3/projects/8b4fb19b4f484cec8fdaab568c2f04ee` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:32.561146 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1cfc2-4a93-4c6b-a797-c5db3cfd99f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b4fb19b4f484cec8fdaab568c2f04ee)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:32.564132 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1cfc2-4a93-4c6b-a797-c5db3cfd99f8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:32.647207 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3fc1cfc2-4a93-4c6b-a797-c5db3cfd99f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b4fb19b4f484cec8fdaab568c2f04ee', 'request_id': 'req-3fc1cfc2-4a93-4c6b-a797-c5db3cfd99f8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:32.653864 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3fc1cfc2-4a93-4c6b-a797-c5db3cfd99f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b4fb19b4f484cec8fdaab568c2f04ee', 'request_id': 'req-3fc1cfc2-4a93-4c6b-a797-c5db3cfd99f8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:32.662199 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3fc1cfc2-4a93-4c6b-a797-c5db3cfd99f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b4fb19b4f484cec8fdaab568c2f04ee', 'request_id': 'req-3fc1cfc2-4a93-4c6b-a797-c5db3cfd99f8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:32.673877 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:32.678567 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3fc1cfc2-4a93-4c6b-a797-c5db3cfd99f8 admin admin] The token cache is being invalidate because project 8b4fb19b4f484cec8fdaab568c2f04ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:15:32.678930 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3fc1cfc2-4a93-4c6b-a797-c5db3cfd99f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:32.680197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3fc1cfc2-4a93-4c6b-a797-c5db3cfd99f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:32.683623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1431/2818] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:15:32 2022] DELETE /identity/v3/projects/8b4fb19b4f484cec8fdaab568c2f04ee => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:15:32.689004 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d547d0-d3f7-450b-9b15-3b8c85c703cd service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:32.704347 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d547d0-d3f7-450b-9b15-3b8c85c703cd service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:32.738380 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:32.774422 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9324b-f0c1-4ddd-9a6c-e5597ed4b77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:32.776175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9324b-f0c1-4ddd-9a6c-e5597ed4b77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:32.776662 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9324b-f0c1-4ddd-9a6c-e5597ed4b77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:32.777150 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9324b-f0c1-4ddd-9a6c-e5597ed4b77e admin admin] PATH_INFO: `/v3/users/c8ecd1bb45ef44e4a855feabb97fe1ad` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:32.778663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9324b-f0c1-4ddd-9a6c-e5597ed4b77e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8ecd1bb45ef44e4a855feabb97fe1ad)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:32.780888 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9324b-f0c1-4ddd-9a6c-e5597ed4b77e admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:32.840352 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2bc9324b-f0c1-4ddd-9a6c-e5597ed4b77e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8ecd1bb45ef44e4a855feabb97fe1ad'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:32.850359 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2bc9324b-f0c1-4ddd-9a6c-e5597ed4b77e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8ecd1bb45ef44e4a855feabb97fe1ad'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:32.867333 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2bc9324b-f0c1-4ddd-9a6c-e5597ed4b77e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8ecd1bb45ef44e4a855feabb97fe1ad'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:32.878740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2bc9324b-f0c1-4ddd-9a6c-e5597ed4b77e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8ecd1bb45ef44e4a855feabb97fe1ad'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:32.879869 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2bc9324b-f0c1-4ddd-9a6c-e5597ed4b77e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8ecd1bb45ef44e4a855feabb97fe1ad'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:32.889816 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1388/2819] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:15:32 2022] DELETE /identity/v3/users/c8ecd1bb45ef44e4a855feabb97fe1ad => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:15:33.186361 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1cfc2-4a93-4c6b-a797-c5db3cfd99f8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:33.187841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3fc1cfc2-4a93-4c6b-a797-c5db3cfd99f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:33.203848 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1cfc2-4a93-4c6b-a797-c5db3cfd99f8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:33.279129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747e3e4-0a39-4305-864c-e809dbe9ade0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:33.280001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747e3e4-0a39-4305-864c-e809dbe9ade0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:33.280292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747e3e4-0a39-4305-864c-e809dbe9ade0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:33.280583 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747e3e4-0a39-4305-864c-e809dbe9ade0 admin admin] PATH_INFO: `/v3/projects/f6655654c39146a38e14a0eeb8c4b9a1` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:33.281975 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b747e3e4-0a39-4305-864c-e809dbe9ade0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6655654c39146a38e14a0eeb8c4b9a1)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:33.283945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b747e3e4-0a39-4305-864c-e809dbe9ade0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:33.342546 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b747e3e4-0a39-4305-864c-e809dbe9ade0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6655654c39146a38e14a0eeb8c4b9a1', 'request_id': 'req-b747e3e4-0a39-4305-864c-e809dbe9ade0'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:33.348340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b747e3e4-0a39-4305-864c-e809dbe9ade0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6655654c39146a38e14a0eeb8c4b9a1', 'request_id': 'req-b747e3e4-0a39-4305-864c-e809dbe9ade0'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:33.355699 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b747e3e4-0a39-4305-864c-e809dbe9ade0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6655654c39146a38e14a0eeb8c4b9a1', 'request_id': 'req-b747e3e4-0a39-4305-864c-e809dbe9ade0'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:33.367441 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b747e3e4-0a39-4305-864c-e809dbe9ade0 admin admin] The token cache is being invalidate because project f6655654c39146a38e14a0eeb8c4b9a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:15:33.367738 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b747e3e4-0a39-4305-864c-e809dbe9ade0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:33.368410 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b747e3e4-0a39-4305-864c-e809dbe9ade0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:33.370534 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1432/2820] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:15:33 2022] DELETE /identity/v3/projects/f6655654c39146a38e14a0eeb8c4b9a1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:15:33.374689 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9324b-f0c1-4ddd-9a6c-e5597ed4b77e admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:33.376134 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2bc9324b-f0c1-4ddd-9a6c-e5597ed4b77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:33.390566 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9324b-f0c1-4ddd-9a6c-e5597ed4b77e admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:33.450143 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbe2d9-c142-4b64-b424-696b74b4f253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:33.451027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbe2d9-c142-4b64-b424-696b74b4f253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:33.451311 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbe2d9-c142-4b64-b424-696b74b4f253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:33.451579 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbe2d9-c142-4b64-b424-696b74b4f253 admin admin] PATH_INFO: `/v3/users/6de1d15a236641c1b3aa22dde319e238` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:33.452790 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbe2d9-c142-4b64-b424-696b74b4f253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6de1d15a236641c1b3aa22dde319e238)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:33.454786 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbe2d9-c142-4b64-b424-696b74b4f253 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:33.507487 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-fcbbe2d9-c142-4b64-b424-696b74b4f253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6de1d15a236641c1b3aa22dde319e238'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:33.510187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:33.516999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-fcbbe2d9-c142-4b64-b424-696b74b4f253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6de1d15a236641c1b3aa22dde319e238'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:33.530576 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-fcbbe2d9-c142-4b64-b424-696b74b4f253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6de1d15a236641c1b3aa22dde319e238'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:33.538237 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-fcbbe2d9-c142-4b64-b424-696b74b4f253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6de1d15a236641c1b3aa22dde319e238'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:33.538914 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-fcbbe2d9-c142-4b64-b424-696b74b4f253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6de1d15a236641c1b3aa22dde319e238'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:33.545287 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1389/2821] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:15:33 2022] DELETE /identity/v3/users/6de1d15a236641c1b3aa22dde319e238 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:15:33.831550 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747e3e4-0a39-4305-864c-e809dbe9ade0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:15:33.833164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b747e3e4-0a39-4305-864c-e809dbe9ade0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:15:33.848639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747e3e4-0a39-4305-864c-e809dbe9ade0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:15:33.913457 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76651f2-9a79-450f-8246-3ef1f2538cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:15:33.914302 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76651f2-9a79-450f-8246-3ef1f2538cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:15:33.914733 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76651f2-9a79-450f-8246-3ef1f2538cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:15:33.914872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76651f2-9a79-450f-8246-3ef1f2538cb9 admin admin] PATH_INFO: `/v3/projects/1f6c25963aed4240a19754e27085a0f4` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:15:33.916689 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76651f2-9a79-450f-8246-3ef1f2538cb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f6c25963aed4240a19754e27085a0f4)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:15:33.918747 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76651f2-9a79-450f-8246-3ef1f2538cb9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:15:33.959721 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:33.973801 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e76651f2-9a79-450f-8246-3ef1f2538cb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f6c25963aed4240a19754e27085a0f4', 'request_id': 'req-e76651f2-9a79-450f-8246-3ef1f2538cb9'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:33.980087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e76651f2-9a79-450f-8246-3ef1f2538cb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f6c25963aed4240a19754e27085a0f4', 'request_id': 'req-e76651f2-9a79-450f-8246-3ef1f2538cb9'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:33.988477 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e76651f2-9a79-450f-8246-3ef1f2538cb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f6c25963aed4240a19754e27085a0f4', 'request_id': 'req-e76651f2-9a79-450f-8246-3ef1f2538cb9'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:34.001152 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e76651f2-9a79-450f-8246-3ef1f2538cb9 admin admin] The token cache is being invalidate because project 1f6c25963aed4240a19754e27085a0f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:15:34.001443 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e76651f2-9a79-450f-8246-3ef1f2538cb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:34.002373 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e76651f2-9a79-450f-8246-3ef1f2538cb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:15:34.003925 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1433/2822] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:15:33 2022] DELETE /identity/v3/projects/1f6c25963aed4240a19754e27085a0f4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:15:43.541467 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=11,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:15:43.997947 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:16:15.318430 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbe2d9-c142-4b64-b424-696b74b4f253 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:16:15.319957 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-fcbbe2d9-c142-4b64-b424-696b74b4f253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:16:15.388985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbe2d9-c142-4b64-b424-696b74b4f253 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:16:15.451446 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cea67-9640-49c2-8d71-8be29ab3b5be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:16:15.452246 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cea67-9640-49c2-8d71-8be29ab3b5be service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:16:15.452533 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cea67-9640-49c2-8d71-8be29ab3b5be service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:16:15.452811 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605cea67-9640-49c2-8d71-8be29ab3b5be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:16:15.454692 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-605cea67-9640-49c2-8d71-8be29ab3b5be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:16:15.530409 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cea67-9640-49c2-8d71-8be29ab3b5be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:16:15.531879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605cea67-9640-49c2-8d71-8be29ab3b5be service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:16:15.543167 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1390/2823] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:16:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:16:16.746092 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76651f2-9a79-450f-8246-3ef1f2538cb9 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:16:16.750557 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e76651f2-9a79-450f-8246-3ef1f2538cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:16:16.769493 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76651f2-9a79-450f-8246-3ef1f2538cb9 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:16:16.773142 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75c1a1-5208-4e7a-be41-a86b891abb5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:16:16.773785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75c1a1-5208-4e7a-be41-a86b891abb5e service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:16:16.774086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75c1a1-5208-4e7a-be41-a86b891abb5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:16:16.774367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75c1a1-5208-4e7a-be41-a86b891abb5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:16:16.776586 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-bd75c1a1-5208-4e7a-be41-a86b891abb5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:16:16.791999 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75c1a1-5208-4e7a-be41-a86b891abb5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:16:16.793452 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75c1a1-5208-4e7a-be41-a86b891abb5e service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:16:16.806102 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1434/2824] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:16:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:16:25.538096 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=74 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:16:26.800675 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:17:13.713084 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cea67-9640-49c2-8d71-8be29ab3b5be service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:17:13.714544 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-605cea67-9640-49c2-8d71-8be29ab3b5be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:17:13.842526 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605cea67-9640-49c2-8d71-8be29ab3b5be service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:17:13.848018 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fc8d9-8af8-47f5-b7e5-11c878a153e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:17:13.848675 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fc8d9-8af8-47f5-b7e5-11c878a153e5 service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:17:13.848962 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fc8d9-8af8-47f5-b7e5-11c878a153e5 service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:17:13.849241 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fc8d9-8af8-47f5-b7e5-11c878a153e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:17:13.851579 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-297fc8d9-8af8-47f5-b7e5-11c878a153e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:17:13.863630 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297fc8d9-8af8-47f5-b7e5-11c878a153e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:17:13.865247 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297fc8d9-8af8-47f5-b7e5-11c878a153e5 service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:17:13.875960 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1391/2825] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:17:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:17:23.871378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=56 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:17:31.686347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75c1a1-5208-4e7a-be41-a86b891abb5e service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:17:31.687896 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-bd75c1a1-5208-4e7a-be41-a86b891abb5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:17:31.752096 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75c1a1-5208-4e7a-be41-a86b891abb5e service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:17:31.757965 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e581d6e-4d46-4859-85de-767bce87a9e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:17:31.758689 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e581d6e-4d46-4859-85de-767bce87a9e3 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:17:31.758985 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e581d6e-4d46-4859-85de-767bce87a9e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:17:31.759264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e581d6e-4d46-4859-85de-767bce87a9e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:17:31.761562 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2e581d6e-4d46-4859-85de-767bce87a9e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:17:31.775383 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e581d6e-4d46-4859-85de-767bce87a9e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:17:31.778094 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e581d6e-4d46-4859-85de-767bce87a9e3 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:17:31.789859 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1435/2826] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:17:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:17:41.730411 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b3425-2b0a-4137-9249-794254b21ce1 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:17:41.730921 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b3425-2b0a-4137-9249-794254b21ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:17:41.731105 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b3425-2b0a-4137-9249-794254b21ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:17:41.754644 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d86b3425-2b0a-4137-9249-794254b21ce1 None None] MFA Rules not processed for user `8103402ac83c4b4191a3ec4d55038e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:17:41.755889 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d86b3425-2b0a-4137-9249-794254b21ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:17:41.784864 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=21 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:17:41.820042 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1392/2827] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jul 14 16:17:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:17:41.864046 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e581d6e-4d46-4859-85de-767bce87a9e3 service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:17:41.865499 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2e581d6e-4d46-4859-85de-767bce87a9e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:17:41.945009 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e581d6e-4d46-4859-85de-767bce87a9e3 service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:17:41.950864 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b41021-0dd2-46c4-b233-14142efd566c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edbbc94ca71c42c0aac562c8c2ec83db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:17:41.951515 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b41021-0dd2-46c4-b233-14142efd566c service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:17:41.951802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b41021-0dd2-46c4-b233-14142efd566c service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:17:41.952083 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b41021-0dd2-46c4-b233-14142efd566c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:17:41.960636 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b41021-0dd2-46c4-b233-14142efd566c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:17:41.962389 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b41021-0dd2-46c4-b233-14142efd566c service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:17:41.971386 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1436/2828] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jul 14 16:17:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:17:45.606038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b3425-2b0a-4137-9249-794254b21ce1 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:17:45.622345 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b3425-2b0a-4137-9249-794254b21ce1 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:17:45.629932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06e8f1-3e27-43ff-a613-d3d6610d9980 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:17:45.631141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06e8f1-3e27-43ff-a613-d3d6610d9980 service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:17:45.631540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06e8f1-3e27-43ff-a613-d3d6610d9980 service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:17:45.631972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06e8f1-3e27-43ff-a613-d3d6610d9980 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:17:45.637698 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-9b06e8f1-3e27-43ff-a613-d3d6610d9980 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:17:45.659714 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06e8f1-3e27-43ff-a613-d3d6610d9980 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:17:45.669243 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06e8f1-3e27-43ff-a613-d3d6610d9980 service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:17:45.682052 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1393/2829] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:17:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:17:49.032454 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b41021-0dd2-46c4-b233-14142efd566c service swift] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:17:49.034189 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d6b41021-0dd2-46c4-b233-14142efd566c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:17:49.137360 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b41021-0dd2-46c4-b233-14142efd566c service swift] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:17:49.141949 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80680e7-41c3-4c31-93e8-5acdca8ee090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:17:49.142871 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80680e7-41c3-4c31-93e8-5acdca8ee090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:17:49.143129 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80680e7-41c3-4c31-93e8-5acdca8ee090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:17:49.143406 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80680e7-41c3-4c31-93e8-5acdca8ee090 admin admin] PATH_INFO: `/v3/users/8fb90913af24468cb2a63ba0afd8d7f9` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:17:49.144605 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80680e7-41c3-4c31-93e8-5acdca8ee090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fb90913af24468cb2a63ba0afd8d7f9)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:17:49.146551 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80680e7-41c3-4c31-93e8-5acdca8ee090 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:17:49.200242 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d80680e7-41c3-4c31-93e8-5acdca8ee090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fb90913af24468cb2a63ba0afd8d7f9'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:17:49.200932 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d80680e7-41c3-4c31-93e8-5acdca8ee090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fb90913af24468cb2a63ba0afd8d7f9'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:17:49.208476 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d80680e7-41c3-4c31-93e8-5acdca8ee090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fb90913af24468cb2a63ba0afd8d7f9'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:17:49.217411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d80680e7-41c3-4c31-93e8-5acdca8ee090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fb90913af24468cb2a63ba0afd8d7f9'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:17:49.230446 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d80680e7-41c3-4c31-93e8-5acdca8ee090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fb90913af24468cb2a63ba0afd8d7f9'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:17:49.237056 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1437/2830] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:17:49 2022] DELETE /identity/v3/users/8fb90913af24468cb2a63ba0afd8d7f9 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:17:49.419614 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06e8f1-3e27-43ff-a613-d3d6610d9980 service placement] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:17:49.431215 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06e8f1-3e27-43ff-a613-d3d6610d9980 service placement] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:17:49.490973 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90c074-6b00-48a9-b063-4a62aa8d6ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:17:49.491845 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90c074-6b00-48a9-b063-4a62aa8d6ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:17:49.492121 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90c074-6b00-48a9-b063-4a62aa8d6ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:17:49.492391 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90c074-6b00-48a9-b063-4a62aa8d6ab0 admin admin] PATH_INFO: `/v3/projects/484ac628506b4579bb4423cdd8957688` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:17:49.493621 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90c074-6b00-48a9-b063-4a62aa8d6ab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=484ac628506b4579bb4423cdd8957688)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:17:49.496090 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90c074-6b00-48a9-b063-4a62aa8d6ab0 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:17:49.541302 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ca90c074-6b00-48a9-b063-4a62aa8d6ab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '484ac628506b4579bb4423cdd8957688', 'request_id': 'req-ca90c074-6b00-48a9-b063-4a62aa8d6ab0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:17:49.548326 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ca90c074-6b00-48a9-b063-4a62aa8d6ab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '484ac628506b4579bb4423cdd8957688', 'request_id': 'req-ca90c074-6b00-48a9-b063-4a62aa8d6ab0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:17:49.553831 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ca90c074-6b00-48a9-b063-4a62aa8d6ab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '484ac628506b4579bb4423cdd8957688', 'request_id': 'req-ca90c074-6b00-48a9-b063-4a62aa8d6ab0'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:17:49.567101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ca90c074-6b00-48a9-b063-4a62aa8d6ab0 admin admin] The token cache is being invalidate because project 484ac628506b4579bb4423cdd8957688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:17:49.567318 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ca90c074-6b00-48a9-b063-4a62aa8d6ab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:17:49.567935 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-ca90c074-6b00-48a9-b063-4a62aa8d6ab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:17:49.569510 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1394/2831] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:17:49 2022] DELETE /identity/v3/projects/484ac628506b4579bb4423cdd8957688 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:17:49.573750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80680e7-41c3-4c31-93e8-5acdca8ee090 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:17:49.575234 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d80680e7-41c3-4c31-93e8-5acdca8ee090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:17:49.588428 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80680e7-41c3-4c31-93e8-5acdca8ee090 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:17:49.593347 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:17:49.648460 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219d06d-3402-4830-80f7-75b256c4eb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:17:49.649340 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219d06d-3402-4830-80f7-75b256c4eb12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:17:49.649628 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219d06d-3402-4830-80f7-75b256c4eb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:17:49.649914 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219d06d-3402-4830-80f7-75b256c4eb12 admin admin] PATH_INFO: `/v3/users/2e9ad1a73978407ba6d65c00a677a5d6` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:17:49.651764 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219d06d-3402-4830-80f7-75b256c4eb12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e9ad1a73978407ba6d65c00a677a5d6)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:17:49.654045 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219d06d-3402-4830-80f7-75b256c4eb12 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:17:49.700715 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4219d06d-3402-4830-80f7-75b256c4eb12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9ad1a73978407ba6d65c00a677a5d6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:17:49.701370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4219d06d-3402-4830-80f7-75b256c4eb12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9ad1a73978407ba6d65c00a677a5d6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:17:49.708399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4219d06d-3402-4830-80f7-75b256c4eb12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9ad1a73978407ba6d65c00a677a5d6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:17:49.717298 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4219d06d-3402-4830-80f7-75b256c4eb12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9ad1a73978407ba6d65c00a677a5d6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:17:49.730302 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4219d06d-3402-4830-80f7-75b256c4eb12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9ad1a73978407ba6d65c00a677a5d6'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:17:49.736296 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1438/2832] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:17:49 2022] DELETE /identity/v3/users/2e9ad1a73978407ba6d65c00a677a5d6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:17:49.915038 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90c074-6b00-48a9-b063-4a62aa8d6ab0 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:17:49.917415 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-ca90c074-6b00-48a9-b063-4a62aa8d6ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:17:49.933361 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90c074-6b00-48a9-b063-4a62aa8d6ab0 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:17:49.952546 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:17:49.994335 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107a442-561e-4e0a-bd1f-94a35168a8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:17:49.995595 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107a442-561e-4e0a-bd1f-94a35168a8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:17:49.995889 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107a442-561e-4e0a-bd1f-94a35168a8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:17:49.996175 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d107a442-561e-4e0a-bd1f-94a35168a8bc admin admin] PATH_INFO: `/v3/projects/53fee8192b154fb3a1867f6b429b9db2` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:17:49.997379 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107a442-561e-4e0a-bd1f-94a35168a8bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=53fee8192b154fb3a1867f6b429b9db2)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:17:49.999366 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d107a442-561e-4e0a-bd1f-94a35168a8bc admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:17:50.046730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d107a442-561e-4e0a-bd1f-94a35168a8bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53fee8192b154fb3a1867f6b429b9db2', 'request_id': 'req-d107a442-561e-4e0a-bd1f-94a35168a8bc'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:17:50.052834 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d107a442-561e-4e0a-bd1f-94a35168a8bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53fee8192b154fb3a1867f6b429b9db2', 'request_id': 'req-d107a442-561e-4e0a-bd1f-94a35168a8bc'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:17:50.059042 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d107a442-561e-4e0a-bd1f-94a35168a8bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53fee8192b154fb3a1867f6b429b9db2', 'request_id': 'req-d107a442-561e-4e0a-bd1f-94a35168a8bc'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:17:50.071471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d107a442-561e-4e0a-bd1f-94a35168a8bc admin admin] The token cache is being invalidate because project 53fee8192b154fb3a1867f6b429b9db2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:17:50.071757 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d107a442-561e-4e0a-bd1f-94a35168a8bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:17:50.072378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d107a442-561e-4e0a-bd1f-94a35168a8bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:17:50.074780 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1395/2833] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:17:49 2022] DELETE /identity/v3/projects/53fee8192b154fb3a1867f6b429b9db2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:17:59.732703 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:18:00.068306 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:19:08.210109 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219d06d-3402-4830-80f7-75b256c4eb12 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:19:08.213785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4219d06d-3402-4830-80f7-75b256c4eb12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:19:08.294351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219d06d-3402-4830-80f7-75b256c4eb12 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:19:08.352969 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bd412-c519-41b1-8e6a-491d078cd5a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:19:08.354109 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bd412-c519-41b1-8e6a-491d078cd5a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:19:08.354611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bd412-c519-41b1-8e6a-491d078cd5a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:19:08.355056 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bd412-c519-41b1-8e6a-491d078cd5a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:19:08.357820 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3c0bd412-c519-41b1-8e6a-491d078cd5a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:19:08.442642 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bd412-c519-41b1-8e6a-491d078cd5a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:19:08.444103 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bd412-c519-41b1-8e6a-491d078cd5a0 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:19:08.454192 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1439/2834] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:19:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:19:18.449753 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=68 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:42.511322 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107a442-561e-4e0a-bd1f-94a35168a8bc admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:42.512758 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d107a442-561e-4e0a-bd1f-94a35168a8bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:42.607583 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d107a442-561e-4e0a-bd1f-94a35168a8bc admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:42.611403 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39425df4-4f5a-4f58-8975-2a1af22da647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:42.611985 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39425df4-4f5a-4f58-8975-2a1af22da647 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:42.612271 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39425df4-4f5a-4f58-8975-2a1af22da647 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:42.612550 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39425df4-4f5a-4f58-8975-2a1af22da647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:42.614374 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-39425df4-4f5a-4f58-8975-2a1af22da647 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:42.677699 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39425df4-4f5a-4f58-8975-2a1af22da647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:42.679187 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39425df4-4f5a-4f58-8975-2a1af22da647 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:42.689515 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1396/2835] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:20:45.850794 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bd412-c519-41b1-8e6a-491d078cd5a0 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:45.852277 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3c0bd412-c519-41b1-8e6a-491d078cd5a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:45.868035 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bd412-c519-41b1-8e6a-491d078cd5a0 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:45.872984 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2756a52-064a-44bc-bba1-42cfeabd3bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:45.873863 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2756a52-064a-44bc-bba1-42cfeabd3bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:45.874215 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2756a52-064a-44bc-bba1-42cfeabd3bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:45.874489 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2756a52-064a-44bc-bba1-42cfeabd3bb2 admin admin] PATH_INFO: `/v3/users/7791b825f4274af19051fd0fd884274f` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:45.892859 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2756a52-064a-44bc-bba1-42cfeabd3bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7791b825f4274af19051fd0fd884274f)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:45.895021 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2756a52-064a-44bc-bba1-42cfeabd3bb2 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:45.945203 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d2756a52-064a-44bc-bba1-42cfeabd3bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7791b825f4274af19051fd0fd884274f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:45.945841 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d2756a52-064a-44bc-bba1-42cfeabd3bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7791b825f4274af19051fd0fd884274f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:45.953757 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d2756a52-064a-44bc-bba1-42cfeabd3bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7791b825f4274af19051fd0fd884274f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:45.961599 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d2756a52-064a-44bc-bba1-42cfeabd3bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7791b825f4274af19051fd0fd884274f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:45.974715 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d2756a52-064a-44bc-bba1-42cfeabd3bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7791b825f4274af19051fd0fd884274f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:45.980627 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1440/2836] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:20:45 2022] DELETE /identity/v3/users/7791b825f4274af19051fd0fd884274f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:20:46.158980 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39425df4-4f5a-4f58-8975-2a1af22da647 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:46.169160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39425df4-4f5a-4f58-8975-2a1af22da647 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:46.232692 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323e97b-6ccd-4e6c-8a03-45b817825808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:46.233684 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323e97b-6ccd-4e6c-8a03-45b817825808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:46.233981 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323e97b-6ccd-4e6c-8a03-45b817825808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:46.234311 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323e97b-6ccd-4e6c-8a03-45b817825808 admin admin] PATH_INFO: `/v3/projects/61b987d3312b42abbe4f5512aee6a0a8` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:46.244738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323e97b-6ccd-4e6c-8a03-45b817825808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61b987d3312b42abbe4f5512aee6a0a8)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:46.246973 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323e97b-6ccd-4e6c-8a03-45b817825808 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:46.256043 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:46.294624 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7323e97b-6ccd-4e6c-8a03-45b817825808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61b987d3312b42abbe4f5512aee6a0a8', 'request_id': 'req-7323e97b-6ccd-4e6c-8a03-45b817825808'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:46.301372 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7323e97b-6ccd-4e6c-8a03-45b817825808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61b987d3312b42abbe4f5512aee6a0a8', 'request_id': 'req-7323e97b-6ccd-4e6c-8a03-45b817825808'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:46.307460 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7323e97b-6ccd-4e6c-8a03-45b817825808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61b987d3312b42abbe4f5512aee6a0a8', 'request_id': 'req-7323e97b-6ccd-4e6c-8a03-45b817825808'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:46.320605 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7323e97b-6ccd-4e6c-8a03-45b817825808 admin admin] The token cache is being invalidate because project 61b987d3312b42abbe4f5512aee6a0a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:20:46.320894 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7323e97b-6ccd-4e6c-8a03-45b817825808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:46.321517 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-7323e97b-6ccd-4e6c-8a03-45b817825808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:46.323080 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1397/2837] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:20:46 2022] DELETE /identity/v3/projects/61b987d3312b42abbe4f5512aee6a0a8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:20:46.329792 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0562e4c-95b6-4b00-a7a2-44867d76e487 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:46.330098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0562e4c-95b6-4b00-a7a2-44867d76e487 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:46.330390 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0562e4c-95b6-4b00-a7a2-44867d76e487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:46.348697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c0562e4c-95b6-4b00-a7a2-44867d76e487 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:20:46.349897 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c0562e4c-95b6-4b00-a7a2-44867d76e487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:46.410977 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1441/2838] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:20:46.418573 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848a6be-0fdc-4b78-bf58-369cb79ae9d5 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:46.418868 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848a6be-0fdc-4b78-bf58-369cb79ae9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:46.419150 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848a6be-0fdc-4b78-bf58-369cb79ae9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:46.438000 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-6848a6be-0fdc-4b78-bf58-369cb79ae9d5 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:20:46.439247 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-6848a6be-0fdc-4b78-bf58-369cb79ae9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:46.447118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1398/2839] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:20:46.451477 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0562e4c-95b6-4b00-a7a2-44867d76e487 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:46.461681 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0562e4c-95b6-4b00-a7a2-44867d76e487 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:46.466337 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0591fd-7112-4030-af0d-df48fed37946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:46.466988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0591fd-7112-4030-af0d-df48fed37946 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:46.467274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0591fd-7112-4030-af0d-df48fed37946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:46.467586 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0591fd-7112-4030-af0d-df48fed37946 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:46.468493 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0591fd-7112-4030-af0d-df48fed37946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:20:46.468808 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0591fd-7112-4030-af0d-df48fed37946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:46.470578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0591fd-7112-4030-af0d-df48fed37946 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:46.482292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1442/2840] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:20:46.487133 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848a6be-0fdc-4b78-bf58-369cb79ae9d5 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:46.496569 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848a6be-0fdc-4b78-bf58-369cb79ae9d5 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:46.502330 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb2eee-cbe2-47b1-a39e-4f6e2fa1a15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:46.502979 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb2eee-cbe2-47b1-a39e-4f6e2fa1a15a admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:46.503267 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb2eee-cbe2-47b1-a39e-4f6e2fa1a15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:46.503543 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb2eee-cbe2-47b1-a39e-4f6e2fa1a15a admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:46.504238 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb2eee-cbe2-47b1-a39e-4f6e2fa1a15a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:46.506166 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb2eee-cbe2-47b1-a39e-4f6e2fa1a15a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:46.532805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1399/2841] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:20:46 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:20:46.537621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0591fd-7112-4030-af0d-df48fed37946 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:46.548794 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0591fd-7112-4030-af0d-df48fed37946 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:46.593251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:46.606187 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6480c-d0ee-45b0-88a5-db7cbdaad3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:46.606864 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6480c-d0ee-45b0-88a5-db7cbdaad3e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:46.607153 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6480c-d0ee-45b0-88a5-db7cbdaad3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:46.607436 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6480c-d0ee-45b0-88a5-db7cbdaad3e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:46.608168 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6480c-d0ee-45b0-88a5-db7cbdaad3e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:46.610988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6480c-d0ee-45b0-88a5-db7cbdaad3e8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:46.632722 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1443/2842] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:20:46 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:20:46.637207 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb2eee-cbe2-47b1-a39e-4f6e2fa1a15a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:46.647852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb2eee-cbe2-47b1-a39e-4f6e2fa1a15a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:46.652464 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1fd7e-7e6d-48c0-b206-409b9c2fe052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:46.653133 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1fd7e-7e6d-48c0-b206-409b9c2fe052 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:46.653408 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1fd7e-7e6d-48c0-b206-409b9c2fe052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:46.653690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1fd7e-7e6d-48c0-b206-409b9c2fe052 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:46.654543 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1fd7e-7e6d-48c0-b206-409b9c2fe052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:46.656308 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1fd7e-7e6d-48c0-b206-409b9c2fe052 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:46.666351 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1400/2843] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:20:46.670348 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6480c-d0ee-45b0-88a5-db7cbdaad3e8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:46.681493 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6480c-d0ee-45b0-88a5-db7cbdaad3e8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:46.686179 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec696cc4-72d4-405b-a17e-37a0d4770df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:46.687697 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec696cc4-72d4-405b-a17e-37a0d4770df9 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:46.688043 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec696cc4-72d4-405b-a17e-37a0d4770df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:46.688329 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec696cc4-72d4-405b-a17e-37a0d4770df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:46.689062 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec696cc4-72d4-405b-a17e-37a0d4770df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:46.690700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec696cc4-72d4-405b-a17e-37a0d4770df9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:46.700786 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1444/2844] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:20:46.705072 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1fd7e-7e6d-48c0-b206-409b9c2fe052 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:46.715043 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1fd7e-7e6d-48c0-b206-409b9c2fe052 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:46.719858 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9deb1-8506-414e-a577-15b144ef96c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:46.720727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9deb1-8506-414e-a577-15b144ef96c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:46.721008 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9deb1-8506-414e-a577-15b144ef96c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:46.721285 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9deb1-8506-414e-a577-15b144ef96c3 admin admin] PATH_INFO: `/v3/projects/91f309c433034bca8342b1d7e15fd0d9/users/6afdc74caaaa49829ef492bb5ffdc8d7/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:46.736693 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9deb1-8506-414e-a577-15b144ef96c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91f309c433034bca8342b1d7e15fd0d9, user_id=6afdc74caaaa49829ef492bb5ffdc8d7, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:46.739388 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9deb1-8506-414e-a577-15b144ef96c3 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:46.753118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1401/2845] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:20:46 2022] PUT /identity/v3/projects/91f309c433034bca8342b1d7e15fd0d9/users/6afdc74caaaa49829ef492bb5ffdc8d7/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:20:46.763172 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c8593-a781-410e-866d-c919c8015117 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:46.763486 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c8593-a781-410e-866d-c919c8015117 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:46.763773 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c8593-a781-410e-866d-c919c8015117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:46.792967 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e97c8593-a781-410e-866d-c919c8015117 None None] MFA Rules not processed for user `6afdc74caaaa49829ef492bb5ffdc8d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:20:46.794221 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e97c8593-a781-410e-866d-c919c8015117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:46.872187 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1445/2846] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:20:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:20:46.884486 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9deb1-8506-414e-a577-15b144ef96c3 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:46.887923 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d3c9deb1-8506-414e-a577-15b144ef96c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:46.969028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9deb1-8506-414e-a577-15b144ef96c3 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:46.974698 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce744e43-3273-4a0f-850e-324c5b1ca4c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:46.975340 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce744e43-3273-4a0f-850e-324c5b1ca4c9 service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:46.975623 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce744e43-3273-4a0f-850e-324c5b1ca4c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:46.975898 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce744e43-3273-4a0f-850e-324c5b1ca4c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:46.984727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce744e43-3273-4a0f-850e-324c5b1ca4c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:46.986330 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce744e43-3273-4a0f-850e-324c5b1ca4c9 service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:46.994974 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1402/2847] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:20:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:20:47.218598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c8593-a781-410e-866d-c919c8015117 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:47.279596 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c8593-a781-410e-866d-c919c8015117 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:47.284851 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3878eb-6d14-4580-ae27-cd39729ef446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:47.285719 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3878eb-6d14-4580-ae27-cd39729ef446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:47.285999 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3878eb-6d14-4580-ae27-cd39729ef446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:47.286313 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3878eb-6d14-4580-ae27-cd39729ef446 admin admin] PATH_INFO: `/v3/users/6afdc74caaaa49829ef492bb5ffdc8d7` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:47.287487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3878eb-6d14-4580-ae27-cd39729ef446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6afdc74caaaa49829ef492bb5ffdc8d7)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:47.289444 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3878eb-6d14-4580-ae27-cd39729ef446 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:47.335351 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1f3878eb-6d14-4580-ae27-cd39729ef446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6afdc74caaaa49829ef492bb5ffdc8d7'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:47.336020 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1f3878eb-6d14-4580-ae27-cd39729ef446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6afdc74caaaa49829ef492bb5ffdc8d7'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:47.344967 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1f3878eb-6d14-4580-ae27-cd39729ef446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6afdc74caaaa49829ef492bb5ffdc8d7'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:47.347753 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:47.354492 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1f3878eb-6d14-4580-ae27-cd39729ef446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6afdc74caaaa49829ef492bb5ffdc8d7'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:47.368380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1f3878eb-6d14-4580-ae27-cd39729ef446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6afdc74caaaa49829ef492bb5ffdc8d7'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:47.375152 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1446/2848] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:20:47 2022] DELETE /identity/v3/users/6afdc74caaaa49829ef492bb5ffdc8d7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:20:47.379724 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271d611-ca9b-427b-b589-1467f8c5e536 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:47.380276 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271d611-ca9b-427b-b589-1467f8c5e536 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:47.380397 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271d611-ca9b-427b-b589-1467f8c5e536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:47.398096 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-d271d611-ca9b-427b-b589-1467f8c5e536 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:20:47.399332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d271d611-ca9b-427b-b589-1467f8c5e536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:47.411931 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:47.462216 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1403/2849] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:20:47.473468 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3878eb-6d14-4580-ae27-cd39729ef446 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:47.479048 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1f3878eb-6d14-4580-ae27-cd39729ef446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:47.538193 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3878eb-6d14-4580-ae27-cd39729ef446 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:47.541799 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b25e8-15bb-44a4-b325-9167af70057c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:47.542466 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b25e8-15bb-44a4-b325-9167af70057c service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:47.542750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b25e8-15bb-44a4-b325-9167af70057c service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:47.543027 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b25e8-15bb-44a4-b325-9167af70057c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:47.552272 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b25e8-15bb-44a4-b325-9167af70057c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:47.553742 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b25e8-15bb-44a4-b325-9167af70057c service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:47.563698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1447/2850] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:20:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:20:47.832429 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271d611-ca9b-427b-b589-1467f8c5e536 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:47.834011 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d271d611-ca9b-427b-b589-1467f8c5e536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:47.848751 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271d611-ca9b-427b-b589-1467f8c5e536 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:47.853473 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f516816-95f9-4ed9-abe5-e4b461a43e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:47.854515 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f516816-95f9-4ed9-abe5-e4b461a43e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:47.855247 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f516816-95f9-4ed9-abe5-e4b461a43e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:47.855540 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f516816-95f9-4ed9-abe5-e4b461a43e31 admin admin] PATH_INFO: `/v3/projects/91f309c433034bca8342b1d7e15fd0d9` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:47.856750 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f516816-95f9-4ed9-abe5-e4b461a43e31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91f309c433034bca8342b1d7e15fd0d9)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:47.858775 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f516816-95f9-4ed9-abe5-e4b461a43e31 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:47.907301 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4f516816-95f9-4ed9-abe5-e4b461a43e31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91f309c433034bca8342b1d7e15fd0d9', 'request_id': 'req-4f516816-95f9-4ed9-abe5-e4b461a43e31'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:47.913444 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4f516816-95f9-4ed9-abe5-e4b461a43e31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91f309c433034bca8342b1d7e15fd0d9', 'request_id': 'req-4f516816-95f9-4ed9-abe5-e4b461a43e31'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:47.919399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4f516816-95f9-4ed9-abe5-e4b461a43e31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91f309c433034bca8342b1d7e15fd0d9', 'request_id': 'req-4f516816-95f9-4ed9-abe5-e4b461a43e31'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:47.932910 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4f516816-95f9-4ed9-abe5-e4b461a43e31 admin admin] The token cache is being invalidate because project 91f309c433034bca8342b1d7e15fd0d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:20:47.933458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4f516816-95f9-4ed9-abe5-e4b461a43e31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:47.934583 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4f516816-95f9-4ed9-abe5-e4b461a43e31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:47.936471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1404/2851] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:20:47 2022] DELETE /identity/v3/projects/91f309c433034bca8342b1d7e15fd0d9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:20:47.942027 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3cde8-dd1c-4f4b-9e44-9ef847163b97 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:47.942549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3cde8-dd1c-4f4b-9e44-9ef847163b97 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:47.942665 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3cde8-dd1c-4f4b-9e44-9ef847163b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:47.960937 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-68e3cde8-dd1c-4f4b-9e44-9ef847163b97 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:20:47.962179 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-68e3cde8-dd1c-4f4b-9e44-9ef847163b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:48.026785 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1448/2852] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:20:48.036080 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9216cc6-7cc7-40a2-9039-d4aa67619acc None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:48.036368 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9216cc6-7cc7-40a2-9039-d4aa67619acc None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:48.036645 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9216cc6-7cc7-40a2-9039-d4aa67619acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:48.055083 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c9216cc6-7cc7-40a2-9039-d4aa67619acc None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:20:48.056284 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c9216cc6-7cc7-40a2-9039-d4aa67619acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:48.064738 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1405/2853] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:20:48.069056 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3cde8-dd1c-4f4b-9e44-9ef847163b97 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:48.079005 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3cde8-dd1c-4f4b-9e44-9ef847163b97 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:48.083484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d52567-7077-4c6c-9a11-ace4581ab167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:48.084134 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d52567-7077-4c6c-9a11-ace4581ab167 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:48.084415 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d52567-7077-4c6c-9a11-ace4581ab167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:48.084691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d52567-7077-4c6c-9a11-ace4581ab167 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:48.085407 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d52567-7077-4c6c-9a11-ace4581ab167 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:20:48.085711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d52567-7077-4c6c-9a11-ace4581ab167 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:48.087346 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d52567-7077-4c6c-9a11-ace4581ab167 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:48.099336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1449/2854] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:20:48.103657 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9216cc6-7cc7-40a2-9039-d4aa67619acc None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:48.113529 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9216cc6-7cc7-40a2-9039-d4aa67619acc None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:48.118226 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6de0e-c341-49c3-8b0d-bbd237515453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:48.118876 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6de0e-c341-49c3-8b0d-bbd237515453 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:48.119159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6de0e-c341-49c3-8b0d-bbd237515453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:48.119466 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6de0e-c341-49c3-8b0d-bbd237515453 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:48.120151 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6de0e-c341-49c3-8b0d-bbd237515453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:48.122354 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6de0e-c341-49c3-8b0d-bbd237515453 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:48.148281 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1406/2855] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:20:48 2022] POST /identity/v3/projects => generated 403 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:20:48.152418 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d52567-7077-4c6c-9a11-ace4581ab167 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:48.162403 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d52567-7077-4c6c-9a11-ace4581ab167 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:48.219085 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af39e1-9163-4368-82d0-53247b302010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:48.219752 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af39e1-9163-4368-82d0-53247b302010 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:48.220033 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af39e1-9163-4368-82d0-53247b302010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:48.220313 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af39e1-9163-4368-82d0-53247b302010 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:48.220988 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af39e1-9163-4368-82d0-53247b302010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:48.222965 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af39e1-9163-4368-82d0-53247b302010 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:48.232403 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:48.245043 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1450/2856] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:20:48 2022] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:20:48.249708 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6de0e-c341-49c3-8b0d-bbd237515453 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:48.260094 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6de0e-c341-49c3-8b0d-bbd237515453 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:48.264747 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a03764-ce1c-4dbc-b8e7-26f4c5e5ed0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:48.265399 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a03764-ce1c-4dbc-b8e7-26f4c5e5ed0f admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:48.265685 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a03764-ce1c-4dbc-b8e7-26f4c5e5ed0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:48.265972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a03764-ce1c-4dbc-b8e7-26f4c5e5ed0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:48.266728 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a03764-ce1c-4dbc-b8e7-26f4c5e5ed0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:48.268338 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a03764-ce1c-4dbc-b8e7-26f4c5e5ed0f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:48.279683 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1407/2857] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:20:48.284237 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af39e1-9163-4368-82d0-53247b302010 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:48.294111 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af39e1-9163-4368-82d0-53247b302010 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:48.299865 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9edbb9-ffe1-4f11-935e-e32d9349c9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:48.300530 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9edbb9-ffe1-4f11-935e-e32d9349c9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:48.300815 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9edbb9-ffe1-4f11-935e-e32d9349c9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:48.301094 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9edbb9-ffe1-4f11-935e-e32d9349c9c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:48.301812 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9edbb9-ffe1-4f11-935e-e32d9349c9c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:48.303458 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9edbb9-ffe1-4f11-935e-e32d9349c9c1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:48.315599 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1451/2858] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:20:48.319772 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a03764-ce1c-4dbc-b8e7-26f4c5e5ed0f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:48.329838 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a03764-ce1c-4dbc-b8e7-26f4c5e5ed0f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:48.334716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3899cc-17fa-4294-942f-18f2302e475c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:48.335598 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3899cc-17fa-4294-942f-18f2302e475c admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:48.335878 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3899cc-17fa-4294-942f-18f2302e475c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:48.336155 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3899cc-17fa-4294-942f-18f2302e475c admin admin] PATH_INFO: `/v3/projects/87c51713201545ca91b73a61e4b023c6/users/010097c57c9e4f4f975556b35f5fee52/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:48.355027 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3899cc-17fa-4294-942f-18f2302e475c admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c51713201545ca91b73a61e4b023c6, user_id=010097c57c9e4f4f975556b35f5fee52, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:48.357687 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3899cc-17fa-4294-942f-18f2302e475c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:48.372722 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1408/2859] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:20:48 2022] PUT /identity/v3/projects/87c51713201545ca91b73a61e4b023c6/users/010097c57c9e4f4f975556b35f5fee52/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:20:48.434599 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c91f6-0a61-48fc-a33b-e21cf56d6477 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:48.434893 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c91f6-0a61-48fc-a33b-e21cf56d6477 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:48.435176 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c91f6-0a61-48fc-a33b-e21cf56d6477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:48.461816 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2a6c91f6-0a61-48fc-a33b-e21cf56d6477 None None] MFA Rules not processed for user `010097c57c9e4f4f975556b35f5fee52`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:20:48.463087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2a6c91f6-0a61-48fc-a33b-e21cf56d6477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:48.533974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1452/2860] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:20:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:20:48.538744 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3899cc-17fa-4294-942f-18f2302e475c admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:48.579933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:48.603368 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3899cc-17fa-4294-942f-18f2302e475c admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:48.609051 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd3838-9b4a-4c7e-a62b-d9f17b7f6606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:48.609727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd3838-9b4a-4c7e-a62b-d9f17b7f6606 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:48.610019 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd3838-9b4a-4c7e-a62b-d9f17b7f6606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:48.610336 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd3838-9b4a-4c7e-a62b-d9f17b7f6606 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:48.611130 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd3838-9b4a-4c7e-a62b-d9f17b7f6606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:48.613107 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd3838-9b4a-4c7e-a62b-d9f17b7f6606 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:48.638727 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1409/2861] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:20:48 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:20:48.642977 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c91f6-0a61-48fc-a33b-e21cf56d6477 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:48.653408 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c91f6-0a61-48fc-a33b-e21cf56d6477 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:48.715574 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b93ef-e264-4d0d-ad2a-71ea436ed1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:48.716156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b93ef-e264-4d0d-ad2a-71ea436ed1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:48.716439 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b93ef-e264-4d0d-ad2a-71ea436ed1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:48.716724 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b93ef-e264-4d0d-ad2a-71ea436ed1f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:48.717405 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b93ef-e264-4d0d-ad2a-71ea436ed1f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:48.719965 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b93ef-e264-4d0d-ad2a-71ea436ed1f6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:48.741337 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1453/2862] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:20:48 2022] POST /identity/v3/users => generated 308 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:20:48.745418 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd3838-9b4a-4c7e-a62b-d9f17b7f6606 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:48.757078 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd3838-9b4a-4c7e-a62b-d9f17b7f6606 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:48.761739 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed4988-eed1-42a8-8692-18962229589b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:48.762423 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed4988-eed1-42a8-8692-18962229589b admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:48.762711 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed4988-eed1-42a8-8692-18962229589b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:48.762989 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed4988-eed1-42a8-8692-18962229589b admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:48.763716 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed4988-eed1-42a8-8692-18962229589b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:48.765900 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed4988-eed1-42a8-8692-18962229589b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:48.776542 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1410/2863] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:20:48.780929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b93ef-e264-4d0d-ad2a-71ea436ed1f6 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:48.791635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b93ef-e264-4d0d-ad2a-71ea436ed1f6 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:48.796477 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459ce40-0744-4564-ba7c-032d0d498c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:48.797419 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459ce40-0744-4564-ba7c-032d0d498c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:48.797699 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459ce40-0744-4564-ba7c-032d0d498c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:48.797976 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459ce40-0744-4564-ba7c-032d0d498c58 admin admin] PATH_INFO: `/v3/projects/8e38830175544ce69738f9e6d864ba6a/users/c5cdbe8fcc834f93b3f7b84f59831cab/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:48.814380 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459ce40-0744-4564-ba7c-032d0d498c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e38830175544ce69738f9e6d864ba6a, user_id=c5cdbe8fcc834f93b3f7b84f59831cab, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:48.817308 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3459ce40-0744-4564-ba7c-032d0d498c58 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:48.831738 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1454/2864] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:20:48 2022] PUT /identity/v3/projects/8e38830175544ce69738f9e6d864ba6a/users/c5cdbe8fcc834f93b3f7b84f59831cab/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:20:48.835921 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed4988-eed1-42a8-8692-18962229589b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:48.847203 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed4988-eed1-42a8-8692-18962229589b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:48.906263 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca110836-f19b-4323-833a-baf4dd55152a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:48.906922 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca110836-f19b-4323-833a-baf4dd55152a admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:48.907206 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca110836-f19b-4323-833a-baf4dd55152a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:48.907483 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca110836-f19b-4323-833a-baf4dd55152a admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:48.908196 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca110836-f19b-4323-833a-baf4dd55152a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:48.909786 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca110836-f19b-4323-833a-baf4dd55152a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:48.919459 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1411/2865] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:20:48.923844 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459ce40-0744-4564-ba7c-032d0d498c58 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:48.934224 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3459ce40-0744-4564-ba7c-032d0d498c58 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:48.939098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f3714-6000-4775-aee1-0f1744d6230d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:48.939973 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f3714-6000-4775-aee1-0f1744d6230d admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:48.940262 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f3714-6000-4775-aee1-0f1744d6230d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:48.940543 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f3714-6000-4775-aee1-0f1744d6230d admin admin] PATH_INFO: `/v3/projects/8e38830175544ce69738f9e6d864ba6a/users/c5cdbe8fcc834f93b3f7b84f59831cab/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:48.942578 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f3714-6000-4775-aee1-0f1744d6230d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e38830175544ce69738f9e6d864ba6a, user_id=c5cdbe8fcc834f93b3f7b84f59831cab, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:48.945222 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f3714-6000-4775-aee1-0f1744d6230d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:48.956604 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1455/2866] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:20:48 2022] PUT /identity/v3/projects/8e38830175544ce69738f9e6d864ba6a/users/c5cdbe8fcc834f93b3f7b84f59831cab/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:20:48.966857 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bf5d9-ee46-455a-a59a-2982724e74ae None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:48.967095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bf5d9-ee46-455a-a59a-2982724e74ae None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:48.967382 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bf5d9-ee46-455a-a59a-2982724e74ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:48.994115 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-dd7bf5d9-ee46-455a-a59a-2982724e74ae None None] MFA Rules not processed for user `c5cdbe8fcc834f93b3f7b84f59831cab`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:20:48.995337 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-dd7bf5d9-ee46-455a-a59a-2982724e74ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:49.066252 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1412/2867] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:20:48 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:20:49.077802 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f3714-6000-4775-aee1-0f1744d6230d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:49.079546 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e49f3714-6000-4775-aee1-0f1744d6230d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:49.109725 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:49.151477 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f3714-6000-4775-aee1-0f1744d6230d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:49.155164 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a682f1f-3b04-472b-a794-da52fe6d01ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:49.155814 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a682f1f-3b04-472b-a794-da52fe6d01ee service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:49.156098 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a682f1f-3b04-472b-a794-da52fe6d01ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:49.156373 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a682f1f-3b04-472b-a794-da52fe6d01ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:49.165399 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a682f1f-3b04-472b-a794-da52fe6d01ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:49.166882 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a682f1f-3b04-472b-a794-da52fe6d01ee service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:49.179994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1456/2868] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:20:49 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:20:49.322563 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bf5d9-ee46-455a-a59a-2982724e74ae None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:49.356866 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:49.386512 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bf5d9-ee46-455a-a59a-2982724e74ae None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:49.391938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592be06-2c89-4540-baa4-29c62b650f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:49.392815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592be06-2c89-4540-baa4-29c62b650f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:49.393101 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592be06-2c89-4540-baa4-29c62b650f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:49.393378 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592be06-2c89-4540-baa4-29c62b650f32 admin admin] PATH_INFO: `/v3/users/010097c57c9e4f4f975556b35f5fee52` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:49.394618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592be06-2c89-4540-baa4-29c62b650f32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=010097c57c9e4f4f975556b35f5fee52)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:49.396552 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592be06-2c89-4540-baa4-29c62b650f32 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:49.446040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d592be06-2c89-4540-baa4-29c62b650f32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '010097c57c9e4f4f975556b35f5fee52'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:49.453517 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d592be06-2c89-4540-baa4-29c62b650f32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '010097c57c9e4f4f975556b35f5fee52'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:49.465386 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d592be06-2c89-4540-baa4-29c62b650f32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '010097c57c9e4f4f975556b35f5fee52'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:49.472928 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d592be06-2c89-4540-baa4-29c62b650f32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '010097c57c9e4f4f975556b35f5fee52'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:49.473554 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-d592be06-2c89-4540-baa4-29c62b650f32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '010097c57c9e4f4f975556b35f5fee52'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:49.479690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1413/2869] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:20:49 2022] DELETE /identity/v3/users/010097c57c9e4f4f975556b35f5fee52 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:20:49.484929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0e109-930d-4b5e-9cbe-01674a101d04 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:49.485215 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0e109-930d-4b5e-9cbe-01674a101d04 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:49.485493 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0e109-930d-4b5e-9cbe-01674a101d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:49.503872 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-25f0e109-930d-4b5e-9cbe-01674a101d04 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:20:49.505081 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-25f0e109-930d-4b5e-9cbe-01674a101d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:49.563274 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1457/2870] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:20:49.572945 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592be06-2c89-4540-baa4-29c62b650f32 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:49.574439 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-d592be06-2c89-4540-baa4-29c62b650f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:49.632108 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592be06-2c89-4540-baa4-29c62b650f32 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:49.635804 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993060f-4698-4935-bdcc-72f6cc0e5041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:49.636444 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993060f-4698-4935-bdcc-72f6cc0e5041 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:49.636729 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993060f-4698-4935-bdcc-72f6cc0e5041 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:49.637006 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993060f-4698-4935-bdcc-72f6cc0e5041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:49.646425 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993060f-4698-4935-bdcc-72f6cc0e5041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:49.647857 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5993060f-4698-4935-bdcc-72f6cc0e5041 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:49.657244 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1414/2871] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:20:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:20:49.940643 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0e109-930d-4b5e-9cbe-01674a101d04 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:49.942273 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-25f0e109-930d-4b5e-9cbe-01674a101d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:49.955127 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0e109-930d-4b5e-9cbe-01674a101d04 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:49.960219 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451a91c-3d09-462c-8987-23c6e37f5459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:49.966113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451a91c-3d09-462c-8987-23c6e37f5459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:49.966391 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451a91c-3d09-462c-8987-23c6e37f5459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:49.966691 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e451a91c-3d09-462c-8987-23c6e37f5459 admin admin] PATH_INFO: `/v3/projects/87c51713201545ca91b73a61e4b023c6` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:49.968721 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451a91c-3d09-462c-8987-23c6e37f5459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c51713201545ca91b73a61e4b023c6)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:49.970702 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e451a91c-3d09-462c-8987-23c6e37f5459 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:50.018994 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e451a91c-3d09-462c-8987-23c6e37f5459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c51713201545ca91b73a61e4b023c6', 'request_id': 'req-e451a91c-3d09-462c-8987-23c6e37f5459'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:50.024403 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e451a91c-3d09-462c-8987-23c6e37f5459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c51713201545ca91b73a61e4b023c6', 'request_id': 'req-e451a91c-3d09-462c-8987-23c6e37f5459'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:50.032093 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e451a91c-3d09-462c-8987-23c6e37f5459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c51713201545ca91b73a61e4b023c6', 'request_id': 'req-e451a91c-3d09-462c-8987-23c6e37f5459'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:50.043656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e451a91c-3d09-462c-8987-23c6e37f5459 admin admin] The token cache is being invalidate because project 87c51713201545ca91b73a61e4b023c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:20:50.043940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e451a91c-3d09-462c-8987-23c6e37f5459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:50.044570 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e451a91c-3d09-462c-8987-23c6e37f5459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:50.046819 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1458/2872] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:20:49 2022] DELETE /identity/v3/projects/87c51713201545ca91b73a61e4b023c6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:20:50.050918 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993060f-4698-4935-bdcc-72f6cc0e5041 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:50.060440 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993060f-4698-4935-bdcc-72f6cc0e5041 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:50.109581 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:50.117632 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f5e67-fb3e-4bf2-aecf-cbc5457a616f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:50.118633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f5e67-fb3e-4bf2-aecf-cbc5457a616f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:50.119103 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f5e67-fb3e-4bf2-aecf-cbc5457a616f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:50.119422 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f5e67-fb3e-4bf2-aecf-cbc5457a616f admin admin] PATH_INFO: `/v3/users/c5cdbe8fcc834f93b3f7b84f59831cab` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:50.120936 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f5e67-fb3e-4bf2-aecf-cbc5457a616f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5cdbe8fcc834f93b3f7b84f59831cab)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:50.123140 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f5e67-fb3e-4bf2-aecf-cbc5457a616f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:50.168761 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a25f5e67-fb3e-4bf2-aecf-cbc5457a616f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5cdbe8fcc834f93b3f7b84f59831cab'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:50.176178 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a25f5e67-fb3e-4bf2-aecf-cbc5457a616f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5cdbe8fcc834f93b3f7b84f59831cab'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:50.187807 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a25f5e67-fb3e-4bf2-aecf-cbc5457a616f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5cdbe8fcc834f93b3f7b84f59831cab'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:50.194915 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a25f5e67-fb3e-4bf2-aecf-cbc5457a616f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5cdbe8fcc834f93b3f7b84f59831cab'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:50.195536 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-a25f5e67-fb3e-4bf2-aecf-cbc5457a616f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5cdbe8fcc834f93b3f7b84f59831cab'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:50.201579 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1415/2873] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:20:50 2022] DELETE /identity/v3/users/c5cdbe8fcc834f93b3f7b84f59831cab => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:20:50.490088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451a91c-3d09-462c-8987-23c6e37f5459 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:50.491527 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e451a91c-3d09-462c-8987-23c6e37f5459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:50.507531 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e451a91c-3d09-462c-8987-23c6e37f5459 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:50.552492 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:50.570356 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4259b-9a21-45b0-90c5-54a6210c452d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:50.571151 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4259b-9a21-45b0-90c5-54a6210c452d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:50.571572 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4259b-9a21-45b0-90c5-54a6210c452d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:50.571856 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4259b-9a21-45b0-90c5-54a6210c452d admin admin] PATH_INFO: `/v3/projects/8e38830175544ce69738f9e6d864ba6a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:50.573074 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc4259b-9a21-45b0-90c5-54a6210c452d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e38830175544ce69738f9e6d864ba6a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:50.575040 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc4259b-9a21-45b0-90c5-54a6210c452d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:50.628328 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9dc4259b-9a21-45b0-90c5-54a6210c452d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e38830175544ce69738f9e6d864ba6a', 'request_id': 'req-9dc4259b-9a21-45b0-90c5-54a6210c452d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:50.635639 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9dc4259b-9a21-45b0-90c5-54a6210c452d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e38830175544ce69738f9e6d864ba6a', 'request_id': 'req-9dc4259b-9a21-45b0-90c5-54a6210c452d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:50.645648 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9dc4259b-9a21-45b0-90c5-54a6210c452d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e38830175544ce69738f9e6d864ba6a', 'request_id': 'req-9dc4259b-9a21-45b0-90c5-54a6210c452d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:50.657599 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9dc4259b-9a21-45b0-90c5-54a6210c452d admin admin] The token cache is being invalidate because project 8e38830175544ce69738f9e6d864ba6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:20:50.657890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9dc4259b-9a21-45b0-90c5-54a6210c452d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:50.658572 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9dc4259b-9a21-45b0-90c5-54a6210c452d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:50.660109 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1459/2874] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:20:50 2022] DELETE /identity/v3/projects/8e38830175544ce69738f9e6d864ba6a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:20:50.665784 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39615ac7-8b87-4fb8-ae8e-f31027cfbac3 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:50.666302 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39615ac7-8b87-4fb8-ae8e-f31027cfbac3 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:50.666398 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39615ac7-8b87-4fb8-ae8e-f31027cfbac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:50.685505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-39615ac7-8b87-4fb8-ae8e-f31027cfbac3 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:20:50.687243 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-39615ac7-8b87-4fb8-ae8e-f31027cfbac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:50.745909 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1416/2875] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:20:50.755761 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c129c-c527-4587-b174-932282eb448a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:50.756053 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c129c-c527-4587-b174-932282eb448a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:50.756336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c129c-c527-4587-b174-932282eb448a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:50.776663 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7b1c129c-c527-4587-b174-932282eb448a None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:20:50.777886 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7b1c129c-c527-4587-b174-932282eb448a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:50.785962 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1460/2876] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:20:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:20:50.790162 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39615ac7-8b87-4fb8-ae8e-f31027cfbac3 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:50.800233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39615ac7-8b87-4fb8-ae8e-f31027cfbac3 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:50.804879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17dc943-776b-4449-b4db-bbc76d216662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:50.805544 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dc943-776b-4449-b4db-bbc76d216662 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:50.805836 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dc943-776b-4449-b4db-bbc76d216662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:50.806127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17dc943-776b-4449-b4db-bbc76d216662 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:50.806882 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17dc943-776b-4449-b4db-bbc76d216662 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:20:50.807196 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17dc943-776b-4449-b4db-bbc76d216662 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:50.808793 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17dc943-776b-4449-b4db-bbc76d216662 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:50.821170 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1417/2877] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:20:50.825330 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c129c-c527-4587-b174-932282eb448a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:50.836027 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c129c-c527-4587-b174-932282eb448a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:50.840735 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa96dc2-1ac7-406b-a575-83298aeb5be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:50.841387 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa96dc2-1ac7-406b-a575-83298aeb5be6 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:50.841672 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa96dc2-1ac7-406b-a575-83298aeb5be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:50.841951 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa96dc2-1ac7-406b-a575-83298aeb5be6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:50.842756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa96dc2-1ac7-406b-a575-83298aeb5be6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:50.850572 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa96dc2-1ac7-406b-a575-83298aeb5be6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:50.882114 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1461/2878] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:20:50 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:20:50.884704 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17dc943-776b-4449-b4db-bbc76d216662 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:50.895523 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17dc943-776b-4449-b4db-bbc76d216662 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:50.965275 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a4175-5111-4a5d-a3d0-6dfe92f6c574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:50.965951 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a4175-5111-4a5d-a3d0-6dfe92f6c574 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:50.966274 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a4175-5111-4a5d-a3d0-6dfe92f6c574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:50.966561 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a4175-5111-4a5d-a3d0-6dfe92f6c574 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:50.967254 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a4175-5111-4a5d-a3d0-6dfe92f6c574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:50.969323 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a4175-5111-4a5d-a3d0-6dfe92f6c574 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:50.977173 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:50.996141 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1418/2879] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:20:50 2022] POST /identity/v3/users => generated 283 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:20:51.001768 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa96dc2-1ac7-406b-a575-83298aeb5be6 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:51.013800 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa96dc2-1ac7-406b-a575-83298aeb5be6 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:51.018598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e91c48-cbcc-465a-81d9-f1d04fa7ce49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:51.019259 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e91c48-cbcc-465a-81d9-f1d04fa7ce49 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:51.019547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e91c48-cbcc-465a-81d9-f1d04fa7ce49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:51.019833 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e91c48-cbcc-465a-81d9-f1d04fa7ce49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:51.020592 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e91c48-cbcc-465a-81d9-f1d04fa7ce49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:51.022243 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e91c48-cbcc-465a-81d9-f1d04fa7ce49 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:51.033001 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1462/2880] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 16:20:51.037197 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a4175-5111-4a5d-a3d0-6dfe92f6c574 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:51.048157 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a4175-5111-4a5d-a3d0-6dfe92f6c574 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:51.052771 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c8085-164e-4965-9239-838074b4cf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:51.053422 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c8085-164e-4965-9239-838074b4cf5b admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:51.053706 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c8085-164e-4965-9239-838074b4cf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:51.053982 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c8085-164e-4965-9239-838074b4cf5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:51.054735 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c8085-164e-4965-9239-838074b4cf5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:51.056321 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c8085-164e-4965-9239-838074b4cf5b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:51.066819 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1419/2881] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:20:51.071007 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e91c48-cbcc-465a-81d9-f1d04fa7ce49 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:51.081349 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e91c48-cbcc-465a-81d9-f1d04fa7ce49 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:51.085936 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64657c52-3fba-454c-a772-2e50a303179c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:51.086848 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64657c52-3fba-454c-a772-2e50a303179c admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:51.087133 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64657c52-3fba-454c-a772-2e50a303179c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:51.087412 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64657c52-3fba-454c-a772-2e50a303179c admin admin] PATH_INFO: `/v3/projects/5a6a275279f74aa49a3257347d66d802/users/2af8dfaaab5e4791ba1add2d6a14ac77/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:51.102290 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64657c52-3fba-454c-a772-2e50a303179c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6a275279f74aa49a3257347d66d802, user_id=2af8dfaaab5e4791ba1add2d6a14ac77, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:51.104959 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64657c52-3fba-454c-a772-2e50a303179c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:51.119358 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1463/2882] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:20:51 2022] PUT /identity/v3/projects/5a6a275279f74aa49a3257347d66d802/users/2af8dfaaab5e4791ba1add2d6a14ac77/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:20:51.130568 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d9245-c3cf-4ea2-898a-e6b89162ba8a None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:51.130884 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d9245-c3cf-4ea2-898a-e6b89162ba8a None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:51.131168 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d9245-c3cf-4ea2-898a-e6b89162ba8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:51.157117 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-451d9245-c3cf-4ea2-898a-e6b89162ba8a None None] MFA Rules not processed for user `2af8dfaaab5e4791ba1add2d6a14ac77`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:20:51.158361 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-451d9245-c3cf-4ea2-898a-e6b89162ba8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:51.220844 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1420/2883] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:20:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:20:51.225326 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64657c52-3fba-454c-a772-2e50a303179c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:51.287429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64657c52-3fba-454c-a772-2e50a303179c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:51.292108 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f9f72-8d39-4f7d-b5d9-f19e480de8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:51.292762 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f9f72-8d39-4f7d-b5d9-f19e480de8ee admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:51.293050 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f9f72-8d39-4f7d-b5d9-f19e480de8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:51.293334 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f9f72-8d39-4f7d-b5d9-f19e480de8ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:51.294028 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f9f72-8d39-4f7d-b5d9-f19e480de8ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:51.296582 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f9f72-8d39-4f7d-b5d9-f19e480de8ee admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:51.310939 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:51.325297 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1464/2884] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:20:51 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:20:51.329327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d9245-c3cf-4ea2-898a-e6b89162ba8a None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:51.340486 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d9245-c3cf-4ea2-898a-e6b89162ba8a None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:51.398479 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e1bde-263e-415a-8711-9e449a070c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:51.399153 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e1bde-263e-415a-8711-9e449a070c55 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:51.399437 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e1bde-263e-415a-8711-9e449a070c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:51.399712 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e1bde-263e-415a-8711-9e449a070c55 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:51.400393 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e1bde-263e-415a-8711-9e449a070c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:51.402360 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e1bde-263e-415a-8711-9e449a070c55 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:51.424006 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1421/2885] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:20:51 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:20:51.427940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f9f72-8d39-4f7d-b5d9-f19e480de8ee admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:51.438411 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f9f72-8d39-4f7d-b5d9-f19e480de8ee admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:51.443234 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65cc3e-7084-424e-933d-c1f685b07033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:51.443890 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65cc3e-7084-424e-933d-c1f685b07033 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:51.444169 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65cc3e-7084-424e-933d-c1f685b07033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:51.444442 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65cc3e-7084-424e-933d-c1f685b07033 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:51.445219 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65cc3e-7084-424e-933d-c1f685b07033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:51.446857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65cc3e-7084-424e-933d-c1f685b07033 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:51.457598 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1465/2886] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:20:51.461793 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e1bde-263e-415a-8711-9e449a070c55 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:51.472510 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e1bde-263e-415a-8711-9e449a070c55 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:51.477092 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf1c8a-dc40-438b-92f4-adea5d35c1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:51.477963 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf1c8a-dc40-438b-92f4-adea5d35c1b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:51.478285 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf1c8a-dc40-438b-92f4-adea5d35c1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:51.478560 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf1c8a-dc40-438b-92f4-adea5d35c1b5 admin admin] PATH_INFO: `/v3/projects/3de07721558c465abbfae4e61cba0c4b/users/d7c61a72425f4c218c8bae508576c1c4/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:51.493785 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf1c8a-dc40-438b-92f4-adea5d35c1b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de07721558c465abbfae4e61cba0c4b, user_id=d7c61a72425f4c218c8bae508576c1c4, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:51.496785 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf1c8a-dc40-438b-92f4-adea5d35c1b5 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:51.510352 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1422/2887] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:20:51 2022] PUT /identity/v3/projects/3de07721558c465abbfae4e61cba0c4b/users/d7c61a72425f4c218c8bae508576c1c4/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:20:51.514319 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65cc3e-7084-424e-933d-c1f685b07033 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:51.524335 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65cc3e-7084-424e-933d-c1f685b07033 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:51.581317 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c94a54-04cf-451b-8d69-de58ca503c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:51.581976 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c94a54-04cf-451b-8d69-de58ca503c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:51.582377 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c94a54-04cf-451b-8d69-de58ca503c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:51.582656 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c94a54-04cf-451b-8d69-de58ca503c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:51.583378 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c94a54-04cf-451b-8d69-de58ca503c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:51.584981 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c94a54-04cf-451b-8d69-de58ca503c60 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:51.596042 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1466/2888] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:20:51.600031 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf1c8a-dc40-438b-92f4-adea5d35c1b5 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:51.611253 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf1c8a-dc40-438b-92f4-adea5d35c1b5 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:51.615923 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff548d-bde0-475b-b385-dada24c9d28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:51.616798 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff548d-bde0-475b-b385-dada24c9d28f admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:51.617088 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff548d-bde0-475b-b385-dada24c9d28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:51.617371 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff548d-bde0-475b-b385-dada24c9d28f admin admin] PATH_INFO: `/v3/projects/3de07721558c465abbfae4e61cba0c4b/users/d7c61a72425f4c218c8bae508576c1c4/roles/87f040877bfa47bda56305eb022af09e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:51.619420 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff548d-bde0-475b-b385-dada24c9d28f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de07721558c465abbfae4e61cba0c4b, user_id=d7c61a72425f4c218c8bae508576c1c4, role_id=87f040877bfa47bda56305eb022af09e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:51.622376 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff548d-bde0-475b-b385-dada24c9d28f admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:51.632910 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1423/2889] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:20:51 2022] PUT /identity/v3/projects/3de07721558c465abbfae4e61cba0c4b/users/d7c61a72425f4c218c8bae508576c1c4/roles/87f040877bfa47bda56305eb022af09e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:20:51.643384 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3273ee-b2d8-4591-903c-8f93949c504a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:51.643679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3273ee-b2d8-4591-903c-8f93949c504a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:51.643963 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3273ee-b2d8-4591-903c-8f93949c504a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:51.670494 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-dd3273ee-b2d8-4591-903c-8f93949c504a None None] MFA Rules not processed for user `d7c61a72425f4c218c8bae508576c1c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:20:51.672895 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dd3273ee-b2d8-4591-903c-8f93949c504a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:51.744942 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1467/2890] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:20:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:20:51.756364 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff548d-bde0-475b-b385-dada24c9d28f admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:51.758133 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-8fff548d-bde0-475b-b385-dada24c9d28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:51.785183 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:51.816986 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff548d-bde0-475b-b385-dada24c9d28f admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:51.820714 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d5c8c-676b-4f11-a3cc-357d140449a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:51.821355 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d5c8c-676b-4f11-a3cc-357d140449a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:51.821645 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d5c8c-676b-4f11-a3cc-357d140449a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:51.821928 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d5c8c-676b-4f11-a3cc-357d140449a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:51.831990 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d5c8c-676b-4f11-a3cc-357d140449a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:51.833444 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d5c8c-676b-4f11-a3cc-357d140449a8 service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:51.843692 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1424/2891] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:20:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:20:51.916076 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3273ee-b2d8-4591-903c-8f93949c504a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:51.926495 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3273ee-b2d8-4591-903c-8f93949c504a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:51.930100 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeafd10c-242c-47e6-92fe-3d07a6b07fdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:51.930745 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafd10c-242c-47e6-92fe-3d07a6b07fdd service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:51.931033 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafd10c-242c-47e6-92fe-3d07a6b07fdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:51.931319 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeafd10c-242c-47e6-92fe-3d07a6b07fdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:51.989708 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeafd10c-242c-47e6-92fe-3d07a6b07fdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:51.991197 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeafd10c-242c-47e6-92fe-3d07a6b07fdd service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:52.000489 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1468/2892] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:20:51 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:20:54.720248 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d5c8c-676b-4f11-a3cc-357d140449a8 service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:54.785748 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d5c8c-676b-4f11-a3cc-357d140449a8 service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:54.790364 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4ee72-170b-42e7-b3e2-8826be8c3644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:54.791230 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4ee72-170b-42e7-b3e2-8826be8c3644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:54.791515 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4ee72-170b-42e7-b3e2-8826be8c3644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:54.791792 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4ee72-170b-42e7-b3e2-8826be8c3644 admin admin] PATH_INFO: `/v3/users/2af8dfaaab5e4791ba1add2d6a14ac77` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:54.793011 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4ee72-170b-42e7-b3e2-8826be8c3644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2af8dfaaab5e4791ba1add2d6a14ac77)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:54.794981 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae4ee72-170b-42e7-b3e2-8826be8c3644 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:54.840850 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2ae4ee72-170b-42e7-b3e2-8826be8c3644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2af8dfaaab5e4791ba1add2d6a14ac77'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:54.854025 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2ae4ee72-170b-42e7-b3e2-8826be8c3644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2af8dfaaab5e4791ba1add2d6a14ac77'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:54.868995 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2ae4ee72-170b-42e7-b3e2-8826be8c3644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2af8dfaaab5e4791ba1add2d6a14ac77'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:54.876510 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2ae4ee72-170b-42e7-b3e2-8826be8c3644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2af8dfaaab5e4791ba1add2d6a14ac77'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:54.877158 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-2ae4ee72-170b-42e7-b3e2-8826be8c3644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2af8dfaaab5e4791ba1add2d6a14ac77'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:54.883327 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1425/2893] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:20:54 2022] DELETE /identity/v3/users/2af8dfaaab5e4791ba1add2d6a14ac77 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:20:54.888038 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ad120-1660-4404-bd4a-6dd9a443a708 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:54.888575 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ad120-1660-4404-bd4a-6dd9a443a708 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:54.888681 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ad120-1660-4404-bd4a-6dd9a443a708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:54.895729 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:54.908524 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-033ad120-1660-4404-bd4a-6dd9a443a708 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:20:54.909803 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-033ad120-1660-4404-bd4a-6dd9a443a708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:54.972006 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1469/2894] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:20:54.981589 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4ee72-170b-42e7-b3e2-8826be8c3644 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:54.983040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-2ae4ee72-170b-42e7-b3e2-8826be8c3644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:55.030733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:55.047424 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae4ee72-170b-42e7-b3e2-8826be8c3644 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:55.052777 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0a503-bb46-434b-beac-e4282d4c93ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:55.053703 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0a503-bb46-434b-beac-e4282d4c93ee service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:55.054163 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0a503-bb46-434b-beac-e4282d4c93ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:55.054577 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0a503-bb46-434b-beac-e4282d4c93ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:55.068403 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f0a503-bb46-434b-beac-e4282d4c93ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:55.070757 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f0a503-bb46-434b-beac-e4282d4c93ee service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:55.087667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1426/2895] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:20:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:20:55.362846 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ad120-1660-4404-bd4a-6dd9a443a708 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:55.364264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-033ad120-1660-4404-bd4a-6dd9a443a708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:55.377695 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ad120-1660-4404-bd4a-6dd9a443a708 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:55.383249 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcaf86-6a29-4824-8864-05361b9ff011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:55.384113 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcaf86-6a29-4824-8864-05361b9ff011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:55.384397 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcaf86-6a29-4824-8864-05361b9ff011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:55.384703 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbcaf86-6a29-4824-8864-05361b9ff011 admin admin] PATH_INFO: `/v3/projects/5a6a275279f74aa49a3257347d66d802` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:55.385919 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbcaf86-6a29-4824-8864-05361b9ff011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a6a275279f74aa49a3257347d66d802)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:55.387893 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbcaf86-6a29-4824-8864-05361b9ff011 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:55.438633 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9bbcaf86-6a29-4824-8864-05361b9ff011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a6a275279f74aa49a3257347d66d802', 'request_id': 'req-9bbcaf86-6a29-4824-8864-05361b9ff011'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:55.444336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9bbcaf86-6a29-4824-8864-05361b9ff011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a6a275279f74aa49a3257347d66d802', 'request_id': 'req-9bbcaf86-6a29-4824-8864-05361b9ff011'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:55.451424 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9bbcaf86-6a29-4824-8864-05361b9ff011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a6a275279f74aa49a3257347d66d802', 'request_id': 'req-9bbcaf86-6a29-4824-8864-05361b9ff011'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:55.462605 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9bbcaf86-6a29-4824-8864-05361b9ff011 admin admin] The token cache is being invalidate because project 5a6a275279f74aa49a3257347d66d802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:20:55.462892 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9bbcaf86-6a29-4824-8864-05361b9ff011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:55.463594 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9bbcaf86-6a29-4824-8864-05361b9ff011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:55.465187 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1470/2896] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:20:55 2022] DELETE /identity/v3/projects/5a6a275279f74aa49a3257347d66d802 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:20:55.469325 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0a503-bb46-434b-beac-e4282d4c93ee service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:55.479082 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0a503-bb46-434b-beac-e4282d4c93ee service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:55.536019 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d8022-d83d-4ffc-88b7-6b2752cb3d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:55.536916 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d8022-d83d-4ffc-88b7-6b2752cb3d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:55.537194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d8022-d83d-4ffc-88b7-6b2752cb3d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:55.537464 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d8022-d83d-4ffc-88b7-6b2752cb3d0d admin admin] PATH_INFO: `/v3/users/d7c61a72425f4c218c8bae508576c1c4` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:55.538667 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d8022-d83d-4ffc-88b7-6b2752cb3d0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c61a72425f4c218c8bae508576c1c4)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:55.540613 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d8022-d83d-4ffc-88b7-6b2752cb3d0d admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:55.587801 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6e9d8022-d83d-4ffc-88b7-6b2752cb3d0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c61a72425f4c218c8bae508576c1c4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:55.595060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6e9d8022-d83d-4ffc-88b7-6b2752cb3d0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c61a72425f4c218c8bae508576c1c4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:55.606677 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6e9d8022-d83d-4ffc-88b7-6b2752cb3d0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c61a72425f4c218c8bae508576c1c4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:55.614278 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6e9d8022-d83d-4ffc-88b7-6b2752cb3d0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c61a72425f4c218c8bae508576c1c4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:55.614909 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-6e9d8022-d83d-4ffc-88b7-6b2752cb3d0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c61a72425f4c218c8bae508576c1c4'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:55.620917 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1427/2897] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:20:55 2022] DELETE /identity/v3/users/d7c61a72425f4c218c8bae508576c1c4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:20:55.896106 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcaf86-6a29-4824-8864-05361b9ff011 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:55.897646 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9bbcaf86-6a29-4824-8864-05361b9ff011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:55.913549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbcaf86-6a29-4824-8864-05361b9ff011 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:55.972923 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6358ef-54db-4b2c-a231-0c09c54dda64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:55.973783 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6358ef-54db-4b2c-a231-0c09c54dda64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:55.974080 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6358ef-54db-4b2c-a231-0c09c54dda64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:55.974376 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6358ef-54db-4b2c-a231-0c09c54dda64 admin admin] PATH_INFO: `/v3/projects/3de07721558c465abbfae4e61cba0c4b` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:55.975554 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6358ef-54db-4b2c-a231-0c09c54dda64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3de07721558c465abbfae4e61cba0c4b)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:55.977456 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6358ef-54db-4b2c-a231-0c09c54dda64 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:56.010875 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:56.025511 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cf6358ef-54db-4b2c-a231-0c09c54dda64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de07721558c465abbfae4e61cba0c4b', 'request_id': 'req-cf6358ef-54db-4b2c-a231-0c09c54dda64'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:56.031484 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cf6358ef-54db-4b2c-a231-0c09c54dda64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de07721558c465abbfae4e61cba0c4b', 'request_id': 'req-cf6358ef-54db-4b2c-a231-0c09c54dda64'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:56.038686 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cf6358ef-54db-4b2c-a231-0c09c54dda64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de07721558c465abbfae4e61cba0c4b', 'request_id': 'req-cf6358ef-54db-4b2c-a231-0c09c54dda64'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:56.050608 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cf6358ef-54db-4b2c-a231-0c09c54dda64 admin admin] The token cache is being invalidate because project 3de07721558c465abbfae4e61cba0c4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:20:56.050899 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cf6358ef-54db-4b2c-a231-0c09c54dda64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:56.051548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cf6358ef-54db-4b2c-a231-0c09c54dda64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:20:56.053135 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1471/2898] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:20:55 2022] DELETE /identity/v3/projects/3de07721558c465abbfae4e61cba0c4b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:20:56.058972 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13bfeb-4647-496f-9756-298b7c01be93 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:56.059482 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13bfeb-4647-496f-9756-298b7c01be93 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:56.059590 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13bfeb-4647-496f-9756-298b7c01be93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:56.076618 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-3c13bfeb-4647-496f-9756-298b7c01be93 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:20:56.077871 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-3c13bfeb-4647-496f-9756-298b7c01be93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:56.139169 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1428/2899] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:20:56.147282 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5cbad-18a3-4208-b299-a62d4b413a2c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:56.147581 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5cbad-18a3-4208-b299-a62d4b413a2c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:56.147867 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5cbad-18a3-4208-b299-a62d4b413a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:56.167119 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-34e5cbad-18a3-4208-b299-a62d4b413a2c None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:20:56.168337 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-34e5cbad-18a3-4208-b299-a62d4b413a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:56.177460 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1472/2900] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:20:56.181763 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13bfeb-4647-496f-9756-298b7c01be93 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:56.191992 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13bfeb-4647-496f-9756-298b7c01be93 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:56.196600 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a26540-6c1f-4bc5-9fec-63ac6529dd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:56.197252 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a26540-6c1f-4bc5-9fec-63ac6529dd41 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:56.197538 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a26540-6c1f-4bc5-9fec-63ac6529dd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:56.197815 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a26540-6c1f-4bc5-9fec-63ac6529dd41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:56.198641 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a26540-6c1f-4bc5-9fec-63ac6529dd41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:20:56.198953 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a26540-6c1f-4bc5-9fec-63ac6529dd41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:56.200551 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a26540-6c1f-4bc5-9fec-63ac6529dd41 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:56.202690 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:56.216424 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1429/2901] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:20:56.220332 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5cbad-18a3-4208-b299-a62d4b413a2c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:56.229700 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5cbad-18a3-4208-b299-a62d4b413a2c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:56.234402 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd11849-7aee-43ae-9090-586ab5050934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:56.235184 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd11849-7aee-43ae-9090-586ab5050934 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:56.235381 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd11849-7aee-43ae-9090-586ab5050934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:56.235711 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd11849-7aee-43ae-9090-586ab5050934 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:56.236383 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd11849-7aee-43ae-9090-586ab5050934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:56.238326 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd11849-7aee-43ae-9090-586ab5050934 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:56.263874 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1473/2902] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:20:56 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:20:56.268946 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a26540-6c1f-4bc5-9fec-63ac6529dd41 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:56.279032 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a26540-6c1f-4bc5-9fec-63ac6529dd41 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:56.335118 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19366ab1-ad36-42c2-bb5c-99ae04167288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:56.335784 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19366ab1-ad36-42c2-bb5c-99ae04167288 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:56.336069 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19366ab1-ad36-42c2-bb5c-99ae04167288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:56.336347 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19366ab1-ad36-42c2-bb5c-99ae04167288 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:56.337064 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19366ab1-ad36-42c2-bb5c-99ae04167288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:56.339060 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19366ab1-ad36-42c2-bb5c-99ae04167288 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:56.367212 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1430/2903] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:20:56 2022] POST /identity/v3/users => generated 282 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 16:20:56.371763 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd11849-7aee-43ae-9090-586ab5050934 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:56.382722 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd11849-7aee-43ae-9090-586ab5050934 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:56.387327 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d296b8-4d89-4645-944c-afac863178f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:56.387981 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d296b8-4d89-4645-944c-afac863178f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:56.388269 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d296b8-4d89-4645-944c-afac863178f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:56.388552 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d296b8-4d89-4645-944c-afac863178f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:56.389828 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d296b8-4d89-4645-944c-afac863178f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:56.391621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d296b8-4d89-4645-944c-afac863178f8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:56.403044 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1474/2904] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:20:56.407651 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19366ab1-ad36-42c2-bb5c-99ae04167288 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:56.417820 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19366ab1-ad36-42c2-bb5c-99ae04167288 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:56.422697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf55c42-adb9-493c-a7dc-fe9b5ba671e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:56.423375 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf55c42-adb9-493c-a7dc-fe9b5ba671e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:56.423663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf55c42-adb9-493c-a7dc-fe9b5ba671e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:56.423944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf55c42-adb9-493c-a7dc-fe9b5ba671e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:56.424697 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf55c42-adb9-493c-a7dc-fe9b5ba671e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:56.426342 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf55c42-adb9-493c-a7dc-fe9b5ba671e4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:56.436999 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1431/2905] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:20:56.441123 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d296b8-4d89-4645-944c-afac863178f8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:56.452495 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d296b8-4d89-4645-944c-afac863178f8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:56.456498 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7694ea-1c7c-4706-b4e1-11f00cc17970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:56.457384 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7694ea-1c7c-4706-b4e1-11f00cc17970 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:56.457654 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7694ea-1c7c-4706-b4e1-11f00cc17970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:56.457929 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7694ea-1c7c-4706-b4e1-11f00cc17970 admin admin] PATH_INFO: `/v3/projects/34d2a6495b964df2ba2d070955c22f8b/users/30051c9a74c04140967c6062f9993a15/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:56.473328 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7694ea-1c7c-4706-b4e1-11f00cc17970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d2a6495b964df2ba2d070955c22f8b, user_id=30051c9a74c04140967c6062f9993a15, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:56.476013 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7694ea-1c7c-4706-b4e1-11f00cc17970 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:56.489031 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1475/2906] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:20:56 2022] PUT /identity/v3/projects/34d2a6495b964df2ba2d070955c22f8b/users/30051c9a74c04140967c6062f9993a15/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:20:56.499750 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0041537-4273-4344-9cef-63a060172db6 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:56.500046 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0041537-4273-4344-9cef-63a060172db6 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:56.500356 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0041537-4273-4344-9cef-63a060172db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:56.526526 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a0041537-4273-4344-9cef-63a060172db6 None None] MFA Rules not processed for user `30051c9a74c04140967c6062f9993a15`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:20:56.527740 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a0041537-4273-4344-9cef-63a060172db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:56.591330 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1432/2907] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:20:56 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:20:56.605600 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7694ea-1c7c-4706-b4e1-11f00cc17970 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:20:56.607417 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9c7694ea-1c7c-4706-b4e1-11f00cc17970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:20:56.665263 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7694ea-1c7c-4706-b4e1-11f00cc17970 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:20:56.668905 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16d3f6-de10-4f5a-a758-b857d5dc457a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:20:56.669541 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16d3f6-de10-4f5a-a758-b857d5dc457a service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:20:56.669827 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16d3f6-de10-4f5a-a758-b857d5dc457a service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:20:56.670136 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16d3f6-de10-4f5a-a758-b857d5dc457a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:20:56.678693 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16d3f6-de10-4f5a-a758-b857d5dc457a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:20:56.680133 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16d3f6-de10-4f5a-a758-b857d5dc457a service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:20:56.689527 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1476/2908] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:20:56 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:21:06.588366 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=69,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:06.684974 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=66,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:48.564095 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0041537-4273-4344-9cef-63a060172db6 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:21:48.626808 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0041537-4273-4344-9cef-63a060172db6 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:21:48.631305 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdc4ec-ecbe-4f5b-a6b9-ff3aa3ea8d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:21:48.632169 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdc4ec-ecbe-4f5b-a6b9-ff3aa3ea8d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:48.632449 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdc4ec-ecbe-4f5b-a6b9-ff3aa3ea8d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:48.632723 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdc4ec-ecbe-4f5b-a6b9-ff3aa3ea8d93 admin admin] PATH_INFO: `/v3/users/30051c9a74c04140967c6062f9993a15` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:48.633942 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdc4ec-ecbe-4f5b-a6b9-ff3aa3ea8d93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30051c9a74c04140967c6062f9993a15)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:21:48.635889 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdc4ec-ecbe-4f5b-a6b9-ff3aa3ea8d93 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:21:48.681656 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4ebdc4ec-ecbe-4f5b-a6b9-ff3aa3ea8d93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30051c9a74c04140967c6062f9993a15'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:21:48.689048 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4ebdc4ec-ecbe-4f5b-a6b9-ff3aa3ea8d93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30051c9a74c04140967c6062f9993a15'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:21:48.701261 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4ebdc4ec-ecbe-4f5b-a6b9-ff3aa3ea8d93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30051c9a74c04140967c6062f9993a15'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:21:48.708489 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4ebdc4ec-ecbe-4f5b-a6b9-ff3aa3ea8d93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30051c9a74c04140967c6062f9993a15'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:21:48.709207 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-4ebdc4ec-ecbe-4f5b-a6b9-ff3aa3ea8d93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30051c9a74c04140967c6062f9993a15'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:21:48.715205 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1433/2909] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:21:48 2022] DELETE /identity/v3/users/30051c9a74c04140967c6062f9993a15 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:21:48.719788 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6f008-c2f2-4a52-932f-c671f7d3cc71 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:48.720268 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6f008-c2f2-4a52-932f-c671f7d3cc71 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:48.720401 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6f008-c2f2-4a52-932f-c671f7d3cc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:48.738284 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a8b6f008-c2f2-4a52-932f-c671f7d3cc71 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:21:48.739493 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a8b6f008-c2f2-4a52-932f-c671f7d3cc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:48.802635 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1477/2910] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:21:48.813029 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdc4ec-ecbe-4f5b-a6b9-ff3aa3ea8d93 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:21:48.814495 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-4ebdc4ec-ecbe-4f5b-a6b9-ff3aa3ea8d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:48.875432 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdc4ec-ecbe-4f5b-a6b9-ff3aa3ea8d93 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:21:48.879232 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb33251-4f27-4cd5-a709-ec9f529a8914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:21:48.879931 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb33251-4f27-4cd5-a709-ec9f529a8914 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:48.880219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb33251-4f27-4cd5-a709-ec9f529a8914 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:48.880497 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb33251-4f27-4cd5-a709-ec9f529a8914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:48.889852 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb33251-4f27-4cd5-a709-ec9f529a8914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:21:48.891863 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb33251-4f27-4cd5-a709-ec9f529a8914 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:21:48.901594 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1434/2911] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:21:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:21:49.172737 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6f008-c2f2-4a52-932f-c671f7d3cc71 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:21:49.174645 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a8b6f008-c2f2-4a52-932f-c671f7d3cc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:49.188143 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6f008-c2f2-4a52-932f-c671f7d3cc71 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:21:49.193075 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a385997-9e3e-4209-8916-d78c95284e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:21:49.194263 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a385997-9e3e-4209-8916-d78c95284e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:49.194611 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a385997-9e3e-4209-8916-d78c95284e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:49.194819 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a385997-9e3e-4209-8916-d78c95284e7c admin admin] PATH_INFO: `/v3/projects/34d2a6495b964df2ba2d070955c22f8b` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:49.196038 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a385997-9e3e-4209-8916-d78c95284e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=34d2a6495b964df2ba2d070955c22f8b)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:21:49.197976 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a385997-9e3e-4209-8916-d78c95284e7c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:21:49.247589 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2a385997-9e3e-4209-8916-d78c95284e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34d2a6495b964df2ba2d070955c22f8b', 'request_id': 'req-2a385997-9e3e-4209-8916-d78c95284e7c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:21:49.253345 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2a385997-9e3e-4209-8916-d78c95284e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34d2a6495b964df2ba2d070955c22f8b', 'request_id': 'req-2a385997-9e3e-4209-8916-d78c95284e7c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:21:49.260647 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2a385997-9e3e-4209-8916-d78c95284e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34d2a6495b964df2ba2d070955c22f8b', 'request_id': 'req-2a385997-9e3e-4209-8916-d78c95284e7c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:21:49.272387 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2a385997-9e3e-4209-8916-d78c95284e7c admin admin] The token cache is being invalidate because project 34d2a6495b964df2ba2d070955c22f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:21:49.272679 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2a385997-9e3e-4209-8916-d78c95284e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:21:49.273314 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2a385997-9e3e-4209-8916-d78c95284e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:21:49.275036 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1478/2912] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:21:49 2022] DELETE /identity/v3/projects/34d2a6495b964df2ba2d070955c22f8b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:21:49.280725 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8224e48-9eec-4e4a-b5e7-5634e91f73a8 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:49.281093 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8224e48-9eec-4e4a-b5e7-5634e91f73a8 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:49.281474 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8224e48-9eec-4e4a-b5e7-5634e91f73a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:49.299309 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a8224e48-9eec-4e4a-b5e7-5634e91f73a8 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:21:49.300509 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a8224e48-9eec-4e4a-b5e7-5634e91f73a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:49.317874 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:49.365505 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1435/2913] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:21:49.373584 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ea8a5-f860-4577-a726-61aa8a87a117 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:49.373880 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ea8a5-f860-4577-a726-61aa8a87a117 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:49.374359 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ea8a5-f860-4577-a726-61aa8a87a117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:49.393033 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8a9ea8a5-f860-4577-a726-61aa8a87a117 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:21:49.394327 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8a9ea8a5-f860-4577-a726-61aa8a87a117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:49.402336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1479/2914] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:21:49.407160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8224e48-9eec-4e4a-b5e7-5634e91f73a8 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:21:49.417043 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8224e48-9eec-4e4a-b5e7-5634e91f73a8 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:21:49.422547 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad9b38-3d98-4035-92d6-e65784bd1562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:21:49.423209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad9b38-3d98-4035-92d6-e65784bd1562 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:49.423495 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad9b38-3d98-4035-92d6-e65784bd1562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:49.423774 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad9b38-3d98-4035-92d6-e65784bd1562 admin admin] PATH_INFO: `/v3/domains` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:49.424538 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad9b38-3d98-4035-92d6-e65784bd1562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80190) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:21:49.424847 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad9b38-3d98-4035-92d6-e65784bd1562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:21:49.426492 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad9b38-3d98-4035-92d6-e65784bd1562 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:21:49.438722 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1436/2915] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:21:49.443093 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ea8a5-f860-4577-a726-61aa8a87a117 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:21:49.452756 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ea8a5-f860-4577-a726-61aa8a87a117 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:21:49.457408 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03dbef-2f6d-499e-abfa-ece658ab6f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:21:49.458053 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03dbef-2f6d-499e-abfa-ece658ab6f63 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:49.458370 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03dbef-2f6d-499e-abfa-ece658ab6f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:49.458652 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03dbef-2f6d-499e-abfa-ece658ab6f63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:49.459353 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03dbef-2f6d-499e-abfa-ece658ab6f63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:21:49.461271 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e03dbef-2f6d-499e-abfa-ece658ab6f63 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:21:49.492441 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1480/2916] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:21:49 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:21:49.496849 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad9b38-3d98-4035-92d6-e65784bd1562 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:21:49.507532 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad9b38-3d98-4035-92d6-e65784bd1562 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:21:49.564348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a89f73-677a-4c14-bca3-329f68c77ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:21:49.565011 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a89f73-677a-4c14-bca3-329f68c77ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:49.565280 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a89f73-677a-4c14-bca3-329f68c77ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:49.565555 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a89f73-677a-4c14-bca3-329f68c77ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:49.566272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a89f73-677a-4c14-bca3-329f68c77ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:21:49.568197 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a89f73-677a-4c14-bca3-329f68c77ac4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:21:49.589445 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1437/2917] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:21:49 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:21:49.594344 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03dbef-2f6d-499e-abfa-ece658ab6f63 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:21:49.606513 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03dbef-2f6d-499e-abfa-ece658ab6f63 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:21:49.611538 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa994817-213c-4676-9f7b-2644f00b22a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:21:49.612203 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa994817-213c-4676-9f7b-2644f00b22a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:49.612491 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa994817-213c-4676-9f7b-2644f00b22a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:49.612774 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa994817-213c-4676-9f7b-2644f00b22a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:49.613504 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa994817-213c-4676-9f7b-2644f00b22a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:21:49.615154 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa994817-213c-4676-9f7b-2644f00b22a1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:21:49.626305 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1481/2918] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 16:21:49.630560 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a89f73-677a-4c14-bca3-329f68c77ac4 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:21:49.640994 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a89f73-677a-4c14-bca3-329f68c77ac4 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:21:49.645699 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda84715-7d10-47b9-97d3-2d32dd9355d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:21:49.646373 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda84715-7d10-47b9-97d3-2d32dd9355d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:49.646654 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda84715-7d10-47b9-97d3-2d32dd9355d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:49.646932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda84715-7d10-47b9-97d3-2d32dd9355d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:49.647654 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda84715-7d10-47b9-97d3-2d32dd9355d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:21:49.649248 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda84715-7d10-47b9-97d3-2d32dd9355d4 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:21:49.659835 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1438/2919] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:21:49.663981 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa994817-213c-4676-9f7b-2644f00b22a1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:21:49.674093 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa994817-213c-4676-9f7b-2644f00b22a1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:21:49.678780 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a583e-a9dc-487c-b810-11f90e2a115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:21:49.679657 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a583e-a9dc-487c-b810-11f90e2a115b admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:49.679945 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a583e-a9dc-487c-b810-11f90e2a115b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:49.680225 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a583e-a9dc-487c-b810-11f90e2a115b admin admin] PATH_INFO: `/v3/projects/0188e625ecff4c5db3858430016d3a60/users/0b1246e90ce147eb89aeb8ce12687b7c/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:49.695264 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a583e-a9dc-487c-b810-11f90e2a115b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0188e625ecff4c5db3858430016d3a60, user_id=0b1246e90ce147eb89aeb8ce12687b7c, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:21:49.697966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a583e-a9dc-487c-b810-11f90e2a115b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:21:49.711730 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1482/2920] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:21:49 2022] PUT /identity/v3/projects/0188e625ecff4c5db3858430016d3a60/users/0b1246e90ce147eb89aeb8ce12687b7c/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 16:21:49.723073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1064faf-6cb0-44aa-97cf-25ef97c11a70 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:49.723369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1064faf-6cb0-44aa-97cf-25ef97c11a70 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:49.723653 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1064faf-6cb0-44aa-97cf-25ef97c11a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:49.751091 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-a1064faf-6cb0-44aa-97cf-25ef97c11a70 None None] MFA Rules not processed for user `0b1246e90ce147eb89aeb8ce12687b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:21:49.752332 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a1064faf-6cb0-44aa-97cf-25ef97c11a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:49.817709 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1439/2921] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:21:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:21:49.829386 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a583e-a9dc-487c-b810-11f90e2a115b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:21:49.831305 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dd1a583e-a9dc-487c-b810-11f90e2a115b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:49.864807 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:49.918198 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a583e-a9dc-487c-b810-11f90e2a115b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:21:49.921824 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddbdf5-e43f-4c13-be1c-a32d2730aeff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:21:49.922665 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddbdf5-e43f-4c13-be1c-a32d2730aeff service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:49.922954 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddbdf5-e43f-4c13-be1c-a32d2730aeff service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:49.923251 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddbdf5-e43f-4c13-be1c-a32d2730aeff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:49.931549 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddbdf5-e43f-4c13-be1c-a32d2730aeff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:21:49.932971 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddbdf5-e43f-4c13-be1c-a32d2730aeff service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:21:49.942367 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1483/2922] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:21:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:21:51.289191 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4d539-c624-46f4-b9d5-281903394e96 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:51.289705 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4d539-c624-46f4-b9d5-281903394e96 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:51.289823 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4d539-c624-46f4-b9d5-281903394e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:51.309933 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-84e4d539-c624-46f4-b9d5-281903394e96 None None] MFA Rules not processed for user `0b1246e90ce147eb89aeb8ce12687b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:21:51.311165 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-84e4d539-c624-46f4-b9d5-281903394e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:51.318594 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1440/2923] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:21:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:21:51.356734 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddbdf5-e43f-4c13-be1c-a32d2730aeff service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:21:51.358239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-54ddbdf5-e43f-4c13-be1c-a32d2730aeff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:51.420313 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddbdf5-e43f-4c13-be1c-a32d2730aeff service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:21:51.423997 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857804a4-82f5-4d4e-93c1-ab2aa783eceb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14c582c1127142f8a4ebf64bb7b34516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:21:51.424690 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857804a4-82f5-4d4e-93c1-ab2aa783eceb service glance] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:51.424975 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857804a4-82f5-4d4e-93c1-ab2aa783eceb service glance] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:51.425365 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857804a4-82f5-4d4e-93c1-ab2aa783eceb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:51.427067 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-857804a4-82f5-4d4e-93c1-ab2aa783eceb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:51.516617 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857804a4-82f5-4d4e-93c1-ab2aa783eceb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:21:51.518064 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857804a4-82f5-4d4e-93c1-ab2aa783eceb service glance] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:21:51.538446 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1484/2924] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:21:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:21:51.975422 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4d539-c624-46f4-b9d5-281903394e96 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:21:51.976924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-84e4d539-c624-46f4-b9d5-281903394e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:51.986999 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857804a4-82f5-4d4e-93c1-ab2aa783eceb service glance] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:21:51.988423 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-857804a4-82f5-4d4e-93c1-ab2aa783eceb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:51.992548 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:52.022436 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:52.053151 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857804a4-82f5-4d4e-93c1-ab2aa783eceb service glance] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:21:52.054042 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4d539-c624-46f4-b9d5-281903394e96 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:21:52.056686 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b14191-fc74-49b9-a0eb-9f64225cafd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:21:52.057336 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b14191-fc74-49b9-a0eb-9f64225cafd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:52.057623 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b14191-fc74-49b9-a0eb-9f64225cafd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:52.057969 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b14191-fc74-49b9-a0eb-9f64225cafd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:52.059229 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b5aa0-70d4-4f2d-9e6a-2e83b1740058 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:21:52.059705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-75b14191-fc74-49b9-a0eb-9f64225cafd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:52.059897 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b5aa0-70d4-4f2d-9e6a-2e83b1740058 service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:52.060176 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b5aa0-70d4-4f2d-9e6a-2e83b1740058 service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:52.060458 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b5aa0-70d4-4f2d-9e6a-2e83b1740058 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:52.062633 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-826b5aa0-70d4-4f2d-9e6a-2e83b1740058 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:52.073403 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b14191-fc74-49b9-a0eb-9f64225cafd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:21:52.074160 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b5aa0-70d4-4f2d-9e6a-2e83b1740058 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:21:52.074940 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b14191-fc74-49b9-a0eb-9f64225cafd6 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:21:52.075788 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b5aa0-70d4-4f2d-9e6a-2e83b1740058 service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:21:52.086547 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1485/2925] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:21:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:21:52.086903 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1441/2926] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:21:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:21:54.055498 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b14191-fc74-49b9-a0eb-9f64225cafd6 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:21:54.066488 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b14191-fc74-49b9-a0eb-9f64225cafd6 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:21:54.070344 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fddb7b-ee25-484f-b97b-ce4cf84c14e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:21:54.070992 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fddb7b-ee25-484f-b97b-ce4cf84c14e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:21:54.071275 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fddb7b-ee25-484f-b97b-ce4cf84c14e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:21:54.071552 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fddb7b-ee25-484f-b97b-ce4cf84c14e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:21:54.073498 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d2fddb7b-ee25-484f-b97b-ce4cf84c14e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:21:54.085595 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fddb7b-ee25-484f-b97b-ce4cf84c14e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:21:54.087223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fddb7b-ee25-484f-b97b-ce4cf84c14e4 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:21:54.097332 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1486/2927] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:21:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:22:01.162480 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b5aa0-70d4-4f2d-9e6a-2e83b1740058 service placement] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:22:01.163953 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-826b5aa0-70d4-4f2d-9e6a-2e83b1740058 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:22:01.182720 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b5aa0-70d4-4f2d-9e6a-2e83b1740058 service placement] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:22:01.188209 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41acaa-da8d-4ca7-8845-f2cd2ac19f7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64f6b597a47c4a0eb08d1eabc4c0305c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:22:01.188938 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41acaa-da8d-4ca7-8845-f2cd2ac19f7e service nova] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:01.189896 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41acaa-da8d-4ca7-8845-f2cd2ac19f7e service nova] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:01.190206 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41acaa-da8d-4ca7-8845-f2cd2ac19f7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:01.192041 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-dd41acaa-da8d-4ca7-8845-f2cd2ac19f7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:22:01.204574 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41acaa-da8d-4ca7-8845-f2cd2ac19f7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:22:01.206369 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41acaa-da8d-4ca7-8845-f2cd2ac19f7e service nova] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:22:01.217663 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1442/2928] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:22:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:22:04.092250 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=20 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:22:07.739143 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f520155-6c48-4844-80a4-6ce66ad34a2f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:07.739750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f520155-6c48-4844-80a4-6ce66ad34a2f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:07.739750 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f520155-6c48-4844-80a4-6ce66ad34a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:07.758342 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2f520155-6c48-4844-80a4-6ce66ad34a2f None None] MFA Rules not processed for user `8103402ac83c4b4191a3ec4d55038e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:22:07.759548 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2f520155-6c48-4844-80a4-6ce66ad34a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:22:07.818180 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1487/2929] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jul 14 16:22:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:22:07.864014 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41acaa-da8d-4ca7-8845-f2cd2ac19f7e service nova] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:22:07.865443 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-dd41acaa-da8d-4ca7-8845-f2cd2ac19f7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:22:07.934368 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41acaa-da8d-4ca7-8845-f2cd2ac19f7e service nova] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:22:07.940049 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d91610-f7d0-467a-a736-3be430ce31ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edbbc94ca71c42c0aac562c8c2ec83db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:22:07.940705 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d91610-f7d0-467a-a736-3be430ce31ae service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:07.940992 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d91610-f7d0-467a-a736-3be430ce31ae service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:07.941272 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d91610-f7d0-467a-a736-3be430ce31ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:07.949421 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d91610-f7d0-467a-a736-3be430ce31ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:22:07.951046 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d91610-f7d0-467a-a736-3be430ce31ae service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:22:07.959803 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1443/2930] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jul 14 16:22:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:22:08.472325 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95976aeb-9e6d-4369-b771-d009c87b64b7 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:08.472622 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95976aeb-9e6d-4369-b771-d009c87b64b7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:08.472911 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95976aeb-9e6d-4369-b771-d009c87b64b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:08.491034 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-95976aeb-9e6d-4369-b771-d009c87b64b7 None None] MFA Rules not processed for user `8103402ac83c4b4191a3ec4d55038e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:22:08.492241 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-95976aeb-9e6d-4369-b771-d009c87b64b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:22:08.499647 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1488/2931] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jul 14 16:22:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:22:08.514927 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d91610-f7d0-467a-a736-3be430ce31ae service swift] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:22:08.526823 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d91610-f7d0-467a-a736-3be430ce31ae service swift] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:22:08.531973 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babeb123-7e60-47ff-a9ea-8a98f0df766e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edbbc94ca71c42c0aac562c8c2ec83db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:22:08.532819 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeb123-7e60-47ff-a9ea-8a98f0df766e service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:08.532819 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeb123-7e60-47ff-a9ea-8a98f0df766e service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:08.533556 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babeb123-7e60-47ff-a9ea-8a98f0df766e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:08.543188 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babeb123-7e60-47ff-a9ea-8a98f0df766e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:22:08.544778 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babeb123-7e60-47ff-a9ea-8a98f0df766e service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:22:08.554087 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1444/2932] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jul 14 16:22:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:22:08.745477 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd83155-0d6b-4c3c-b180-493e6a2482f7 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:08.745954 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd83155-0d6b-4c3c-b180-493e6a2482f7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:08.746055 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd83155-0d6b-4c3c-b180-493e6a2482f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:08.764966 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ecd83155-0d6b-4c3c-b180-493e6a2482f7 None None] MFA Rules not processed for user `8103402ac83c4b4191a3ec4d55038e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:22:08.766227 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ecd83155-0d6b-4c3c-b180-493e6a2482f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:22:08.774177 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1489/2933] 10.222.0.39 () {58 vars in 1009 bytes} [Thu Jul 14 16:22:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:22:08.786230 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babeb123-7e60-47ff-a9ea-8a98f0df766e service swift] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:22:08.796826 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babeb123-7e60-47ff-a9ea-8a98f0df766e service swift] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:22:08.803129 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9aa01-00a2-42f6-86c5-b0f8e4279c15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edbbc94ca71c42c0aac562c8c2ec83db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:22:08.803762 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9aa01-00a2-42f6-86c5-b0f8e4279c15 service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:08.804051 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9aa01-00a2-42f6-86c5-b0f8e4279c15 service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:08.804330 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9aa01-00a2-42f6-86c5-b0f8e4279c15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:08.812360 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9aa01-00a2-42f6-86c5-b0f8e4279c15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:22:08.814715 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9aa01-00a2-42f6-86c5-b0f8e4279c15 service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:22:08.823086 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1445/2934] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jul 14 16:22:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:22:09.165687 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34288718-8402-4757-a1ca-766bf760fdf6 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:09.165980 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34288718-8402-4757-a1ca-766bf760fdf6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:09.166292 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34288718-8402-4757-a1ca-766bf760fdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:09.185036 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-34288718-8402-4757-a1ca-766bf760fdf6 None None] MFA Rules not processed for user `8103402ac83c4b4191a3ec4d55038e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:22:09.186294 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-34288718-8402-4757-a1ca-766bf760fdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:22:09.194512 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1490/2935] 10.222.0.39 () {58 vars in 967 bytes} [Thu Jul 14 16:22:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:22:09.208040 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9aa01-00a2-42f6-86c5-b0f8e4279c15 service swift] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:22:09.218884 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9aa01-00a2-42f6-86c5-b0f8e4279c15 service swift] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:22:09.224094 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91efff-646c-41fd-8434-6e6e91dce952 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edbbc94ca71c42c0aac562c8c2ec83db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:22:09.224735 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91efff-646c-41fd-8434-6e6e91dce952 service swift] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:09.225110 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91efff-646c-41fd-8434-6e6e91dce952 service swift] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:09.225511 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91efff-646c-41fd-8434-6e6e91dce952 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:09.234042 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91efff-646c-41fd-8434-6e6e91dce952 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:22:09.235730 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91efff-646c-41fd-8434-6e6e91dce952 service swift] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:22:09.244021 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1446/2936] 10.222.0.39 () {60 vars in 1384 bytes} [Thu Jul 14 16:22:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 16:22:11.331764 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34288718-8402-4757-a1ca-766bf760fdf6 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:22:11.397056 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34288718-8402-4757-a1ca-766bf760fdf6 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:22:11.401613 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cf310-229a-4edf-aea1-a8d2a5c7e9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:22:11.402525 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cf310-229a-4edf-aea1-a8d2a5c7e9e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:11.402813 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cf310-229a-4edf-aea1-a8d2a5c7e9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:11.403087 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cf310-229a-4edf-aea1-a8d2a5c7e9e0 admin admin] PATH_INFO: `/v3/users/0b1246e90ce147eb89aeb8ce12687b7c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:11.404286 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cf310-229a-4edf-aea1-a8d2a5c7e9e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b1246e90ce147eb89aeb8ce12687b7c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:22:11.406250 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cf310-229a-4edf-aea1-a8d2a5c7e9e0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:22:11.465281 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-671cf310-229a-4edf-aea1-a8d2a5c7e9e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b1246e90ce147eb89aeb8ce12687b7c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:22:11.465939 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-671cf310-229a-4edf-aea1-a8d2a5c7e9e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b1246e90ce147eb89aeb8ce12687b7c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:22:11.473461 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-671cf310-229a-4edf-aea1-a8d2a5c7e9e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b1246e90ce147eb89aeb8ce12687b7c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:22:11.481238 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-671cf310-229a-4edf-aea1-a8d2a5c7e9e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b1246e90ce147eb89aeb8ce12687b7c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:22:11.494286 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-671cf310-229a-4edf-aea1-a8d2a5c7e9e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b1246e90ce147eb89aeb8ce12687b7c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:22:11.500681 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1491/2937] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:22:11 2022] DELETE /identity/v3/users/0b1246e90ce147eb89aeb8ce12687b7c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:22:11.505586 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65208730-b0f3-4f15-a591-a5b442af6675 None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:11.506127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65208730-b0f3-4f15-a591-a5b442af6675 None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:11.506309 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65208730-b0f3-4f15-a591-a5b442af6675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:11.526879 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-65208730-b0f3-4f15-a591-a5b442af6675 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:22:11.528146 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-65208730-b0f3-4f15-a591-a5b442af6675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:22:11.564625 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=100 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:22:11.604737 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1447/2938] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 16:22:11.615696 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cf310-229a-4edf-aea1-a8d2a5c7e9e0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:22:11.617181 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-671cf310-229a-4edf-aea1-a8d2a5c7e9e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:22:11.624203 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:22:11.680363 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cf310-229a-4edf-aea1-a8d2a5c7e9e0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:22:11.684096 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d38e90-5133-4542-b39f-20d6c6a88311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:22:11.684746 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d38e90-5133-4542-b39f-20d6c6a88311 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:11.685032 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d38e90-5133-4542-b39f-20d6c6a88311 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:11.685312 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d38e90-5133-4542-b39f-20d6c6a88311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:11.695698 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d38e90-5133-4542-b39f-20d6c6a88311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:22:11.697151 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d38e90-5133-4542-b39f-20d6c6a88311 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:22:11.708126 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1492/2939] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:22:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:22:11.884363 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65208730-b0f3-4f15-a591-a5b442af6675 None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:22:11.885824 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-65208730-b0f3-4f15-a591-a5b442af6675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:22:11.899452 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65208730-b0f3-4f15-a591-a5b442af6675 None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:22:11.904515 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7da7e-cff3-46d6-9982-6e81e3dd2b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:22:11.905383 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7da7e-cff3-46d6-9982-6e81e3dd2b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:11.905983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7da7e-cff3-46d6-9982-6e81e3dd2b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:11.905983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7da7e-cff3-46d6-9982-6e81e3dd2b1c admin admin] PATH_INFO: `/v3/projects/0188e625ecff4c5db3858430016d3a60` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:11.907273 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7da7e-cff3-46d6-9982-6e81e3dd2b1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0188e625ecff4c5db3858430016d3a60)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:22:11.909924 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7da7e-cff3-46d6-9982-6e81e3dd2b1c admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:22:11.958395 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c7d7da7e-cff3-46d6-9982-6e81e3dd2b1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0188e625ecff4c5db3858430016d3a60', 'request_id': 'req-c7d7da7e-cff3-46d6-9982-6e81e3dd2b1c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:22:11.964651 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c7d7da7e-cff3-46d6-9982-6e81e3dd2b1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0188e625ecff4c5db3858430016d3a60', 'request_id': 'req-c7d7da7e-cff3-46d6-9982-6e81e3dd2b1c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:22:11.970674 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c7d7da7e-cff3-46d6-9982-6e81e3dd2b1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0188e625ecff4c5db3858430016d3a60', 'request_id': 'req-c7d7da7e-cff3-46d6-9982-6e81e3dd2b1c'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:22:11.982973 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c7d7da7e-cff3-46d6-9982-6e81e3dd2b1c admin admin] The token cache is being invalidate because project 0188e625ecff4c5db3858430016d3a60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80190) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:22:11.983262 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c7d7da7e-cff3-46d6-9982-6e81e3dd2b1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:22:11.983870 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-c7d7da7e-cff3-46d6-9982-6e81e3dd2b1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:22:11.985412 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1448/2940] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:22:11 2022] DELETE /identity/v3/projects/0188e625ecff4c5db3858430016d3a60 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:22:11.990511 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc7f9a-5fee-4c8e-89aa-c92e11b871ef None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:11.990807 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc7f9a-5fee-4c8e-89aa-c92e11b871ef None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:11.991086 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc7f9a-5fee-4c8e-89aa-c92e11b871ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:12.009857 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e8cc7f9a-5fee-4c8e-89aa-c92e11b871ef None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:22:12.011105 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e8cc7f9a-5fee-4c8e-89aa-c92e11b871ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:22:12.071844 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1493/2941] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:22:12.080733 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8667d3c-1a8d-4dcc-bf7d-b48eb17b24ce None None] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:12.080955 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8667d3c-1a8d-4dcc-bf7d-b48eb17b24ce None None] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:12.081233 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8667d3c-1a8d-4dcc-bf7d-b48eb17b24ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:12.099558 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.auth.core [None req-c8667d3c-1a8d-4dcc-bf7d-b48eb17b24ce None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80190) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:22:12.100759 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-c8667d3c-1a8d-4dcc-bf7d-b48eb17b24ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:22:12.108579 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1449/2942] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:22:12.113150 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc7f9a-5fee-4c8e-89aa-c92e11b871ef None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:22:12.122882 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc7f9a-5fee-4c8e-89aa-c92e11b871ef None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:22:12.129056 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfb5d5-3ef0-4c58-a4f6-a1127e2ac36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:22:12.129713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfb5d5-3ef0-4c58-a4f6-a1127e2ac36f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:12.130003 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfb5d5-3ef0-4c58-a4f6-a1127e2ac36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:12.130444 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfb5d5-3ef0-4c58-a4f6-a1127e2ac36f admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:12.131177 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dfb5d5-3ef0-4c58-a4f6-a1127e2ac36f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 16:22:12.131487 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dfb5d5-3ef0-4c58-a4f6-a1127e2ac36f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:22:12.133102 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dfb5d5-3ef0-4c58-a4f6-a1127e2ac36f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:22:12.145666 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1494/2943] 10.222.0.39 () {58 vars in 1152 bytes} [Thu Jul 14 16:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 16:22:12.149945 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8667d3c-1a8d-4dcc-bf7d-b48eb17b24ce None None] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:22:12.159415 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8667d3c-1a8d-4dcc-bf7d-b48eb17b24ce None None] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:22:12.164059 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa0eb2-c28d-4ca5-b724-2e01f3d73d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:22:12.164702 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa0eb2-c28d-4ca5-b724-2e01f3d73d07 admin admin] REQUEST_METHOD: `POST` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:12.164983 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa0eb2-c28d-4ca5-b724-2e01f3d73d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:12.165262 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa0eb2-c28d-4ca5-b724-2e01f3d73d07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:12.165944 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa0eb2-c28d-4ca5-b724-2e01f3d73d07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:22:12.167914 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa0eb2-c28d-4ca5-b724-2e01f3d73d07 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:22:12.193946 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1450/2944] 10.222.0.39 () {60 vars in 1152 bytes} [Thu Jul 14 16:22:12 2022] POST /identity/v3/projects => generated 389 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:22:12.198378 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfb5d5-3ef0-4c58-a4f6-a1127e2ac36f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:22:12.209368 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfb5d5-3ef0-4c58-a4f6-a1127e2ac36f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:22:12.265416 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836bd37-0832-422b-a4cc-fcd43442b3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:22:12.266140 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836bd37-0832-422b-a4cc-fcd43442b3a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:12.266421 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836bd37-0832-422b-a4cc-fcd43442b3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:12.266705 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836bd37-0832-422b-a4cc-fcd43442b3a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:12.268088 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836bd37-0832-422b-a4cc-fcd43442b3a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:22:12.270012 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836bd37-0832-422b-a4cc-fcd43442b3a3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:22:12.290779 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1495/2945] 10.222.0.39 () {60 vars in 1143 bytes} [Thu Jul 14 16:22:12 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 16:22:12.294674 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa0eb2-c28d-4ca5-b724-2e01f3d73d07 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:22:12.305194 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa0eb2-c28d-4ca5-b724-2e01f3d73d07 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:22:12.309757 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd42b3-f081-481a-9c95-33aa8ae01d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:22:12.310448 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd42b3-f081-481a-9c95-33aa8ae01d6b admin admin] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:12.310743 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd42b3-f081-481a-9c95-33aa8ae01d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:12.311025 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd42b3-f081-481a-9c95-33aa8ae01d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:12.311750 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd42b3-f081-481a-9c95-33aa8ae01d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:22:12.313345 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd42b3-f081-481a-9c95-33aa8ae01d6b admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:22:12.324088 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1451/2946] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:22:12.328156 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836bd37-0832-422b-a4cc-fcd43442b3a3 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:22:12.338958 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836bd37-0832-422b-a4cc-fcd43442b3a3 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:22:12.343492 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597483ff-c008-4475-9bb0-228d843f9cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:22:12.344144 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597483ff-c008-4475-9bb0-228d843f9cfc admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:12.344429 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597483ff-c008-4475-9bb0-228d843f9cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:12.344707 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597483ff-c008-4475-9bb0-228d843f9cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:12.346039 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597483ff-c008-4475-9bb0-228d843f9cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:22:12.347677 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597483ff-c008-4475-9bb0-228d843f9cfc admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:22:12.357541 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1496/2947] 10.222.0.39 () {58 vars in 1121 bytes} [Thu Jul 14 16:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 16:22:12.361875 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd42b3-f081-481a-9c95-33aa8ae01d6b admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:22:12.372030 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd42b3-f081-481a-9c95-33aa8ae01d6b admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:22:12.377281 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8746b5b-9a62-4ea4-9c5b-bd4382040506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:22:12.378231 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8746b5b-9a62-4ea4-9c5b-bd4382040506 admin admin] REQUEST_METHOD: `PUT` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:12.378524 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8746b5b-9a62-4ea4-9c5b-bd4382040506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:12.378807 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8746b5b-9a62-4ea4-9c5b-bd4382040506 admin admin] PATH_INFO: `/v3/projects/e2e50980472842c998d58c56d54b75ea/users/c11255250d734843a4f1ccd3cf2a898e/roles/d98d81dd45ce4c4095c99ee0de89aab3` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:12.394219 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8746b5b-9a62-4ea4-9c5b-bd4382040506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e50980472842c998d58c56d54b75ea, user_id=c11255250d734843a4f1ccd3cf2a898e, role_id=d98d81dd45ce4c4095c99ee0de89aab3)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:22:12.396880 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8746b5b-9a62-4ea4-9c5b-bd4382040506 admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:22:12.410483 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1452/2948] 10.222.0.39 () {60 vars in 1482 bytes} [Thu Jul 14 16:22:12 2022] PUT /identity/v3/projects/e2e50980472842c998d58c56d54b75ea/users/c11255250d734843a4f1ccd3cf2a898e/roles/d98d81dd45ce4c4095c99ee0de89aab3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:22:12.421687 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee640c8-41e8-49a7-9f3d-dc78fff07900 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:12.422120 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee640c8-41e8-49a7-9f3d-dc78fff07900 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:12.422413 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee640c8-41e8-49a7-9f3d-dc78fff07900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:12.447021 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:22:12.450374 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-1ee640c8-41e8-49a7-9f3d-dc78fff07900 None None] MFA Rules not processed for user `c11255250d734843a4f1ccd3cf2a898e`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:22:12.452385 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1ee640c8-41e8-49a7-9f3d-dc78fff07900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:22:12.518855 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1497/2949] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:22:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:22:12.529822 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8746b5b-9a62-4ea4-9c5b-bd4382040506 admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:22:12.531623 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-a8746b5b-9a62-4ea4-9c5b-bd4382040506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:22:12.590230 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8746b5b-9a62-4ea4-9c5b-bd4382040506 admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:22:12.593818 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bc7c6-5e6d-43ca-a23d-d2641ee6a90b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78d5b8b2802a44eead863280df22b027', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:22:12.594495 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bc7c6-5e6d-43ca-a23d-d2641ee6a90b service cinder] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:12.594784 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bc7c6-5e6d-43ca-a23d-d2641ee6a90b service cinder] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:12.595182 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bc7c6-5e6d-43ca-a23d-d2641ee6a90b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:12.604519 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01bc7c6-5e6d-43ca-a23d-d2641ee6a90b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:22:12.606014 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01bc7c6-5e6d-43ca-a23d-d2641ee6a90b service cinder] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:22:12.611127 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:22:12.616562 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1453/2950] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:22:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:22:19.724288 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee640c8-41e8-49a7-9f3d-dc78fff07900 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:22:19.725713 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1ee640c8-41e8-49a7-9f3d-dc78fff07900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:22:19.799239 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee640c8-41e8-49a7-9f3d-dc78fff07900 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:22:19.804267 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc0634-aaa6-43fc-9680-34776052a852 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:22:19.804918 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc0634-aaa6-43fc-9680-34776052a852 service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:19.805205 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc0634-aaa6-43fc-9680-34776052a852 service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:19.805485 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc0634-aaa6-43fc-9680-34776052a852 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:19.807388 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-31bc0634-aaa6-43fc-9680-34776052a852 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:22:19.819033 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc0634-aaa6-43fc-9680-34776052a852 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:22:19.820621 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc0634-aaa6-43fc-9680-34776052a852 service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:22:19.831345 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1498/2951] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:22:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:22:29.826196 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=58 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:22:38.007485 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bc7c6-5e6d-43ca-a23d-d2641ee6a90b service cinder] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:22:38.068260 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bc7c6-5e6d-43ca-a23d-d2641ee6a90b service cinder] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:22:38.075880 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35206434-61a0-4fa0-8666-5f5a1df2e40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:22:38.076981 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35206434-61a0-4fa0-8666-5f5a1df2e40a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:38.077471 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35206434-61a0-4fa0-8666-5f5a1df2e40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:38.077932 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35206434-61a0-4fa0-8666-5f5a1df2e40a admin admin] PATH_INFO: `/v3/users/c11255250d734843a4f1ccd3cf2a898e` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:38.079159 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35206434-61a0-4fa0-8666-5f5a1df2e40a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c11255250d734843a4f1ccd3cf2a898e)` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:22:38.081074 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35206434-61a0-4fa0-8666-5f5a1df2e40a admin admin] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:22:38.127845 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-35206434-61a0-4fa0-8666-5f5a1df2e40a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c11255250d734843a4f1ccd3cf2a898e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:22:38.135894 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-35206434-61a0-4fa0-8666-5f5a1df2e40a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c11255250d734843a4f1ccd3cf2a898e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:22:38.147848 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-35206434-61a0-4fa0-8666-5f5a1df2e40a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c11255250d734843a4f1ccd3cf2a898e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:22:38.155352 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-35206434-61a0-4fa0-8666-5f5a1df2e40a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c11255250d734843a4f1ccd3cf2a898e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:22:38.156055 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.notifications [None req-35206434-61a0-4fa0-8666-5f5a1df2e40a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c11255250d734843a4f1ccd3cf2a898e'} {{(pid=80190) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:22:38.162028 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1454/2952] 10.222.0.39 () {58 vars in 1223 bytes} [Thu Jul 14 16:22:38 2022] DELETE /identity/v3/users/c11255250d734843a4f1ccd3cf2a898e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:22:38.167216 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef5c77-2a32-466f-88ef-5f241d5430b2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:38.167704 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef5c77-2a32-466f-88ef-5f241d5430b2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:38.167810 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef5c77-2a32-466f-88ef-5f241d5430b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:38.186449 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-82ef5c77-2a32-466f-88ef-5f241d5430b2 None None] MFA Rules not processed for user `d66fbdf53c464c5aaadd47b4124dad03`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 16:22:38.187053 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-82ef5c77-2a32-466f-88ef-5f241d5430b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:22:38.258460 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1499/2953] 10.222.0.39 () {58 vars in 957 bytes} [Thu Jul 14 16:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 16:22:38.268382 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35206434-61a0-4fa0-8666-5f5a1df2e40a admin admin] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:22:38.269834 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-35206434-61a0-4fa0-8666-5f5a1df2e40a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:22:38.328693 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35206434-61a0-4fa0-8666-5f5a1df2e40a admin admin] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:22:38.332425 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fb9e5-7f10-4d6a-aa4f-8245ad21b9e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b82de4816a244c0b62b5f9f894ccaf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:22:38.333073 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fb9e5-7f10-4d6a-aa4f-8245ad21b9e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:38.333362 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fb9e5-7f10-4d6a-aa4f-8245ad21b9e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:38.333679 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fb9e5-7f10-4d6a-aa4f-8245ad21b9e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:38.343382 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007fb9e5-7f10-4d6a-aa4f-8245ad21b9e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:22:38.344827 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007fb9e5-7f10-4d6a-aa4f-8245ad21b9e6 service neutron] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:22:38.354992 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1455/2954] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:22:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 16:22:38.636599 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef5c77-2a32-466f-88ef-5f241d5430b2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:22:38.638177 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-82ef5c77-2a32-466f-88ef-5f241d5430b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:22:38.652576 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef5c77-2a32-466f-88ef-5f241d5430b2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:22:38.657909 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf17f3-5830-489a-8aa3-f8590c93b3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd66fbdf53c464c5aaadd47b4124dad03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '758a2be557ed4a1ab6684561497d3b7f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:22:38.659644 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf17f3-5830-489a-8aa3-f8590c93b3b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:22:38.659939 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf17f3-5830-489a-8aa3-f8590c93b3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:22:38.660223 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf17f3-5830-489a-8aa3-f8590c93b3b2 admin admin] PATH_INFO: `/v3/projects/e2e50980472842c998d58c56d54b75ea` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:22:38.661584 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf17f3-5830-489a-8aa3-f8590c93b3b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2e50980472842c998d58c56d54b75ea)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:22:38.664393 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf17f3-5830-489a-8aa3-f8590c93b3b2 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:22:38.713210 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d7bf17f3-5830-489a-8aa3-f8590c93b3b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2e50980472842c998d58c56d54b75ea', 'request_id': 'req-d7bf17f3-5830-489a-8aa3-f8590c93b3b2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:22:38.718820 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d7bf17f3-5830-489a-8aa3-f8590c93b3b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2e50980472842c998d58c56d54b75ea', 'request_id': 'req-d7bf17f3-5830-489a-8aa3-f8590c93b3b2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:22:38.726709 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d7bf17f3-5830-489a-8aa3-f8590c93b3b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2e50980472842c998d58c56d54b75ea', 'request_id': 'req-d7bf17f3-5830-489a-8aa3-f8590c93b3b2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:22:38.737678 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d7bf17f3-5830-489a-8aa3-f8590c93b3b2 admin admin] The token cache is being invalidate because project e2e50980472842c998d58c56d54b75ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 16:22:38.737968 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d7bf17f3-5830-489a-8aa3-f8590c93b3b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:22:38.738636 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d7bf17f3-5830-489a-8aa3-f8590c93b3b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 16:22:38.740167 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1500/2955] 10.222.0.39 () {58 vars in 1232 bytes} [Thu Jul 14 16:22:38 2022] DELETE /identity/v3/projects/e2e50980472842c998d58c56d54b75ea => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 16:22:48.350078 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:22:48.734753 dv-cinder-831247-21-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:27:25.685270 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fb9e5-7f10-4d6a-aa4f-8245ad21b9e6 service neutron] Authenticating user token {{(pid=80190) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 16:27:25.686805 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-007fb9e5-7f10-4d6a-aa4f-8245ad21b9e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:27:25.781037 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fb9e5-7f10-4d6a-aa4f-8245ad21b9e6 service neutron] Validating token access rules against request {{(pid=80190) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 16:27:25.843142 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a797f9-feac-4a6f-a411-67ec9ef47613 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d1dbca57a4c43ce9bc37c2303417d05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba19b660ef1442289fb322231ce26f07', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80190) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 16:27:25.843786 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a797f9-feac-4a6f-a411-67ec9ef47613 service placement] REQUEST_METHOD: `GET` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 16:27:25.844068 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a797f9-feac-4a6f-a411-67ec9ef47613 service placement] SCRIPT_NAME: `/identity` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 16:27:25.844348 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a797f9-feac-4a6f-a411-67ec9ef47613 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80190) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 16:27:25.846403 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.fernet_utils [None req-b3a797f9-feac-4a6f-a411-67ec9ef47613 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80190) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 16:27:25.858400 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a797f9-feac-4a6f-a411-67ec9ef47613 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 16:27:25.859997 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a797f9-feac-4a6f-a411-67ec9ef47613 service placement] RBAC: Authorization granted {{(pid=80190) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 16:27:25.870418 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: [pid: 80190|app: 0|req: 1456/2956] 10.222.0.39 () {60 vars in 1365 bytes} [Thu Jul 14 16:27:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 16:27:35.865602 dv-cinder-831247-21-iscsi devstack@keystone.service[80190]: DEBUG dbcounter [-] [80190] Writing DB stats keystone:SELECT=67 {{(pid=80190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}